-- Logs begin at Tue 2022-10-04 09:41:08 UTC, end at Tue 2022-10-04 10:52:18 UTC. -- Oct 04 10:12:30.348972 dv-cinder-859193-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 04 10:12:30.358610 dv-cinder-859193-3-smb devstack@keystone.service[81565]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 10:12:30 2022] *** Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: nodename: dv-cinder-859193-3-smb Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: machine: x86_64 Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: clock source: unix Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: pcre jit disabled Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: detected number of CPU cores: 4 Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: current working directory: / Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: detected binary path: /usr/bin/uwsgi-core Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: your processes number limit is 47680 Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: your memory page size is 4096 bytes Oct 04 10:12:30.360727 dv-cinder-859193-3-smb devstack@keystone.service[81565]: detected max file descriptor number: 2048 Oct 04 10:12:30.361442 dv-cinder-859193-3-smb devstack@keystone.service[81565]: lock engine: pthread robust mutexes Oct 04 10:12:30.361442 dv-cinder-859193-3-smb devstack@keystone.service[81565]: thunder lock: enabled Oct 04 10:12:30.361442 dv-cinder-859193-3-smb devstack@keystone.service[81565]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 04 10:12:30.361442 dv-cinder-859193-3-smb devstack@keystone.service[81565]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 10:12:30.400097 dv-cinder-859193-3-smb devstack@keystone.service[81565]: Python main interpreter initialized at 0x55a2482559c0 Oct 04 10:12:30.400097 dv-cinder-859193-3-smb devstack@keystone.service[81565]: python threads support enabled Oct 04 10:12:30.400097 dv-cinder-859193-3-smb devstack@keystone.service[81565]: your server socket listen backlog is limited to 100 connections Oct 04 10:12:30.400097 dv-cinder-859193-3-smb devstack@keystone.service[81565]: your mercy for graceful operations on workers is 90 seconds Oct 04 10:12:30.400438 dv-cinder-859193-3-smb devstack@keystone.service[81565]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 10:12:30.400522 dv-cinder-859193-3-smb devstack@keystone.service[81565]: *** Operational MODE: preforking *** Oct 04 10:12:30.400776 dv-cinder-859193-3-smb devstack@keystone.service[81565]: *** uWSGI is running in multiple interpreter mode *** Oct 04 10:12:30.400776 dv-cinder-859193-3-smb devstack@keystone.service[81565]: spawned uWSGI master process (pid: 81565) Oct 04 10:12:30.400972 dv-cinder-859193-3-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 04 10:12:30.403495 dv-cinder-859193-3-smb devstack@keystone.service[81565]: spawned uWSGI worker 1 (pid: 81577, cores: 1) Oct 04 10:12:30.403495 dv-cinder-859193-3-smb devstack@keystone.service[81565]: spawned uWSGI worker 2 (pid: 81578, cores: 1) Oct 04 10:12:30.403495 dv-cinder-859193-3-smb devstack@keystone.service[81565]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 10:12:34.717634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:12:34.717634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: from cryptography.utils import int_from_bytes Oct 04 10:12:34.718429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:12:34.718429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: from cryptography.utils import int_from_bytes Oct 04 10:12:34.718429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:12:34.718429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: from cryptography.utils import int_from_bytes Oct 04 10:12:34.718946 dv-cinder-859193-3-smb devstack@keystone.service[81577]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:12:34.718946 dv-cinder-859193-3-smb devstack@keystone.service[81577]: from cryptography.utils import int_from_bytes Oct 04 10:12:34.768777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 10:12:34.769000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 10:12:34.769232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] command line args: [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 10:12:34.769515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 10:12:34.769604 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 10:12:34.769708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 10:12:34.769793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ================================================================================ {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 10:12:34.769898 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] command line args: [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 10:12:34.769990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] admin_token = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.770167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 10:12:34.770341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ================================================================================ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 10:12:34.770425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] config_dir = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.770593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] admin_token = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.770671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.770838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] config_dir = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.770917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] config_source = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.771024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.771107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] debug = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.771204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] config_source = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.771292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.771555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] debug = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.771555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.771765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.771871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.771995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.772100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.772197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.772294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.772447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.772564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.772674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.772773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.772868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] log_config_append = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.772969 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] log_config_append = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.773078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.773177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.773286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] log_dir = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.773390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] log_dir = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.773502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] log_file = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.773582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] log_file = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.773706 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.773787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.773868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.773985 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.774065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.774183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.774256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.774382 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.774467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.774548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.774665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.774740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.774863 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.774948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.775027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.775150 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.775226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.775417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.775544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.775651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.775735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.775882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.775983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.776156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.776255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.776429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.776506 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.776677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.776757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.777047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.777234 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.777417 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] publish_errors = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.777540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.777649 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.777733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] publish_errors = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.777878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.777961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.778055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.778183 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.778300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.778378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.778531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.778610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.778764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] standard_threads = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.778843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.778996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.779073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] standard_threads = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.779225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.779307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.779388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.779465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.779542 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] use_journal = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.779614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.779715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] use_json = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.779793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] use_journal = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.779872 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] use_stderr = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.779962 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] use_json = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.780074 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] use_syslog = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.780151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] use_stderr = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.780299 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] use_syslog = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.780383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.780531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:12:34.780618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.780772 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.780855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.781010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.781160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.781254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.781330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.781492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.781576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.781726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.781811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.781962 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.782039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.782195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.782271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.782430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.782513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.782672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.782749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.782913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.782996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.783144 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.783231 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.783377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.783453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.783612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.783696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.783845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.783930 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.784117 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.784193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.784353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.784441 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.784601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.784687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.784849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.784927 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.785092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.785171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.785328 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.785414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.785560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.785637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.785811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.785888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.786064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.786148 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.786310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.786394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.786539 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.786617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.786767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.786917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.786998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.787069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.787207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.787286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.787443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.787529 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.787685 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.787762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.787990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.788091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.788173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.788253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.788383 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.788467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.788627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.788703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.788863 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.788942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.789095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.789171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.789325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.789407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.789560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.789638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.789791 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.789867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.790021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.790096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.790248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.790326 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.790473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.790549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.790699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.790809 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.790927 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.791039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.791161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.791275 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.791377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.791473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.791610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.791724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.791829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.791927 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.792111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.792232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.792334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.792422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.792585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.792688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.792796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.792881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.793033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.793121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.793265 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.793342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.793498 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.793577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.793728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.793817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.793958 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.794035 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.794187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.794267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.794413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.794500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.794653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.794737 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.794885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.794959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.795114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.795238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.795411 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.795551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.795683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.795831 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.795974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.796052 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.796183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.796268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.796343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.796460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.796536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.796652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.796770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.796852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.797020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.797099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.797263 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.797385 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.797501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.797583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.797736 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.797813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.797967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.798093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.798246 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.798322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.798434 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.798513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.798664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.798749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.798897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.798981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.799128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.799205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.799366 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.799455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.799583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.799671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.799817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.799897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.800073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.800154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.800309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.800403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.800543 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.800628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.800786 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.800863 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.801026 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.801116 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.801273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.801350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.801510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.801590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.801745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.801832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.801982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.802060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.802217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.802299 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.802451 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.802537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.802682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.802759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.802911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.802991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.803138 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.803223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.803363 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.803441 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.803590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.803667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.803815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.803903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.804067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.804155 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.804302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.804381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.804535 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.804621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.804772 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.804850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.805005 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.805082 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.805260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.805350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.805498 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.805576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.805735 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.external = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.805824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.805963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.external = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.806042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.806193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.806284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.806475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.806555 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.806706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.password = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.806818 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.806927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.token = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.807010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.password = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.807157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.807240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.token = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.807392 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.807977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.808183 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.808299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.808413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.808491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.808649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.808728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.808891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.808979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.809122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.809201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.809348 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.809426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.809587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.809668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.809833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.809911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.810075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.810153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.810314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.810394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.810551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.810628 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.810783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.810862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.811014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.811101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.811258 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.811338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.811487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.811574 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.811737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.811818 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.812040 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.812124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.822626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.822747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.822908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.822987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.823060 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.823733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.823848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.823993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.824126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.824212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.824293 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.824367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.824440 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.824518 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.824603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.824678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.824751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.824823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.824895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.824967 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.825048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.825122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.825195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.825268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.825346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.825421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.825502 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.825577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.825650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.825770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.825847 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.825919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826192 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826494 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826864 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.826938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827304 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.827913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828030 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828108 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.828986 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829355 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829539 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829692 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.829989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830735 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.830878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831163 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831306 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831530 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831823 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.831983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832265 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832607 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832904 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.832987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833336 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833632 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833842 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.833999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834217 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834288 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834442 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834655 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.834951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.835022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.835094 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.835165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.835249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.835323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.835403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.835481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.835554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.835626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.835706 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836437 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836511 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.836952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837102 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837328 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837553 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837855 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837927 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.837999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.838070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.838142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.838315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.838393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.838456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.838516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.838516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.838622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.838622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.838753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.838858 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.838963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.839078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.839193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.839283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.839360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.839432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.839505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.839585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.840091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.840193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.842355 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.842446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.842521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.842594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.842666 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.842750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.842825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.842898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.842964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.842964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] role.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] role.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.843977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] role.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.848460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.848540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] role.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.848608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.848682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.848744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.848815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.848900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.848975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849120 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849192 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849497 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.849949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850345 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850842 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.850985 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.851103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.851184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.851257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.851336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.851411 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.851483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.851564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.851638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.851710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.851782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.851854 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.851925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852326 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852398 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852535 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852606 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.852977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] token.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853273 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853632 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] token.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853786 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.853931 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854155 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854155 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.854966 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.855932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856209 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.connection = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.856965 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.857113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.857191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.857263 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.857335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.857407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.857480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.857559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.857634 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.857707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.857779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.857851 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.857923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858155 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858372 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858527 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 10:12:34.858671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:12:34.858671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 10:12:34.887766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:34.888007 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:34.888238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:34.888391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:34.888537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:34.888667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:34.896730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:34.896861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:34.927296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:34.927525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:34.927703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:34.927934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.003205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.004039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.057084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.057215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.057315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.057402 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.224622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.224808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.224950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.225038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.225116 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.225215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.225294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.225364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.225438 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.225575 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.225658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.225786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.248687 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.248849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.248943 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.249080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.249185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.249305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.249390 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.249524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.249608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.249750 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.249833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.249930 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.250012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.250137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.270302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.270520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.283287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.283520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.283744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.283988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.284132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.284273 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.284357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.284484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.284568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.284694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.284778 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.284982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.285194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.285406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 10:12:35.301361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.301563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 10:12:35.301903 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.301986 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.302100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 10:12:35.302183 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 10:12:35.302372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.302457 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.302631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 10:12:35.302714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.302888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.302970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.303143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.303226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.303400 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.303659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.312953 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.313243 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.313410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.313495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.313687 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.313771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.313958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.314240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.320728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.321456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.324141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.324426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.326244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.326244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.326379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.326454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.326528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.326612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.326689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.326765 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.326839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.326914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.326996 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.327073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.327148 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.327222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.327297 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.327371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.327454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.327454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.327454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.327650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.349675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.350691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.351140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.351421 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.352174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.352458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.356594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.356876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.357158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.357667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.357951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.358233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.363415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.363700 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.364748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.365031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.369305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.369595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.369880 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.370781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.371056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.371210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.371336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.371503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.371610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.371788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.371871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.372128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.372407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.372679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.372948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.373214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.387231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.389374 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.389461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.389461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.391358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.392865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.394613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.394907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.396051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.396350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.399050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.400609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.402162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.403780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.405324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.405622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.405909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.406193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.406471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.406749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.407019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.407316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.407600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.407884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.408193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.408472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.422902 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.423190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.423458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.423719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.424717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.425004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.425274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.425539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.430569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.432138 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.432511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.434602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.435163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.435443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.436273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.436552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.446689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.446689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.446689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.446689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.446916 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.446993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.447064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.447064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.447064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.447064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.450537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.450819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.451098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.451602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.451686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.451880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.452085 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.452290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.452453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.452570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.452735 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.452948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.453240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.453549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.468751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.469853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.477149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.477281 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.477362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.477437 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.477511 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.477585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.477668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.477775 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.478164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.478805 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.479091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.480058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.485123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.486453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.486566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.487901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.489631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.490024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.490313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.490593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.490927 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.491322 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.491608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.491884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.498368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.498655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.498935 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.499695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.500013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.500304 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.507013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.507262 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 10:12:35.507349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.507545 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.507628 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.507815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.507896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.508178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.508453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.508724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.508969 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.509052 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.509253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.509337 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.509516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.509605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.509790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.509882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.510065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.510146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.510333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.510416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.510653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.510743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.510921 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.511752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.512075 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.512356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 10:12:35.545604 dv-cinder-859193-3-smb devstack@keystone.service[81578]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a2482559c0 pid: 81578 (default app) Oct 04 10:12:35.547487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a2482559c0 pid: 81577 (default app) Oct 04 10:12:35.548984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517520d-4a1f-4260-8a25-e805407bb1ea None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:35.549269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517520d-4a1f-4260-8a25-e805407bb1ea None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:35.549538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517520d-4a1f-4260-8a25-e805407bb1ea None None] PATH_INFO: `/v3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:35.553761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Tue Oct 4 10:12:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:12:43.123039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161681-4bb2-4bb2-ab59-544db1b89e2b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:43.123537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161681-4bb2-4bb2-ab59-544db1b89e2b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:43.123622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161681-4bb2-4bb2-ab59-544db1b89e2b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:43.127916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:12:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:12:43.133136 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ec305-dc53-4e16-b741-d692df003583 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:43.133540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ec305-dc53-4e16-b741-d692df003583 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:43.133674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ec305-dc53-4e16-b741-d692df003583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:43.203349 dv-cinder-859193-3-smb devstack@keystone.service[81578]: INFO dbcounter [None req-390ec305-dc53-4e16-b741-d692df003583 None None] Registered counter for database keystone Oct 04 10:12:43.222435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG oslo_db.sqlalchemy.engines [None req-390ec305-dc53-4e16-b741-d692df003583 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81578) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:12:43.228523 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writer thread running {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:12:43.405774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG passlib.handlers.bcrypt [None req-390ec305-dc53-4e16-b741-d692df003583 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81578) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 10:12:43.406158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG passlib.handlers.bcrypt [None req-390ec305-dc53-4e16-b741-d692df003583 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81578) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 10:12:43.463356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-390ec305-dc53-4e16-b741-d692df003583 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:12:43.465592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-390ec305-dc53-4e16-b741-d692df003583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:12:43.591825 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:12:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 04 10:12:44.045739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161681-4bb2-4bb2-ab59-544db1b89e2b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:44.114727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: INFO dbcounter [None req-59161681-4bb2-4bb2-ab59-544db1b89e2b None None] Registered counter for database keystone Oct 04 10:12:44.136093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG oslo_db.sqlalchemy.engines [None req-59161681-4bb2-4bb2-ab59-544db1b89e2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:12:44.142337 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writer thread running {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:12:44.261482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161681-4bb2-4bb2-ab59-544db1b89e2b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:44.265890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2af4ac-3916-479d-9ed8-1e3c8a6f630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:44.266507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2af4ac-3916-479d-9ed8-1e3c8a6f630d admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:44.266790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2af4ac-3916-479d-9ed8-1e3c8a6f630d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:44.267063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2af4ac-3916-479d-9ed8-1e3c8a6f630d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:44.275165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2af4ac-3916-479d-9ed8-1e3c8a6f630d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:44.327619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6e2af4ac-3916-479d-9ed8-1e3c8a6f630d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 10:12:44.327984 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2af4ac-3916-479d-9ed8-1e3c8a6f630d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:44.337791 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Tue Oct 4 10:12:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 10:12:44.343909 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ec305-dc53-4e16-b741-d692df003583 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:44.360840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ec305-dc53-4e16-b741-d692df003583 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:44.365194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772947a-ed8d-45aa-b919-1116c711ab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:44.366279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772947a-ed8d-45aa-b919-1116c711ab25 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:44.366560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772947a-ed8d-45aa-b919-1116c711ab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:44.366827 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772947a-ed8d-45aa-b919-1116c711ab25 admin admin] PATH_INFO: `/v3/projects/e736e1303d7f49068590b8ec9f283f71` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:44.368428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772947a-ed8d-45aa-b919-1116c711ab25 admin admin] RBAC: Authorizing `identity:get_project(project_id=e736e1303d7f49068590b8ec9f283f71)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:44.421026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2772947a-ed8d-45aa-b919-1116c711ab25 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 10:12:44.421374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772947a-ed8d-45aa-b919-1116c711ab25 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:44.425867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Tue Oct 4 10:12:44 2022] GET /identity/v3/projects/e736e1303d7f49068590b8ec9f283f71 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:12:46.519749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e049d-d60e-410e-bcc1-4655385f0e5a None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:46.520311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e049d-d60e-410e-bcc1-4655385f0e5a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:46.520311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e049d-d60e-410e-bcc1-4655385f0e5a None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:46.524432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:12:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:12:46.530652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1effe50-d60f-410e-bc49-66976421f0ca None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:46.531089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1effe50-d60f-410e-bc49-66976421f0ca None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:46.531226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1effe50-d60f-410e-bc49-66976421f0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:46.550933 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d1effe50-d60f-410e-bc49-66976421f0ca None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:12:46.552515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d1effe50-d60f-410e-bc49-66976421f0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:12:46.560240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:12:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 10:12:46.824462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e049d-d60e-410e-bcc1-4655385f0e5a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:46.836471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e049d-d60e-410e-bcc1-4655385f0e5a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:46.841105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa108ad-edc5-4d30-af9f-faab09e8f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:46.841689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa108ad-edc5-4d30-af9f-faab09e8f893 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:46.841963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa108ad-edc5-4d30-af9f-faab09e8f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:46.842234 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa108ad-edc5-4d30-af9f-faab09e8f893 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:46.849658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa108ad-edc5-4d30-af9f-faab09e8f893 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:46.851405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa108ad-edc5-4d30-af9f-faab09e8f893 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:46.861522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Tue Oct 4 10:12:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:12:46.866869 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1effe50-d60f-410e-bc49-66976421f0ca None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:46.876052 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1effe50-d60f-410e-bc49-66976421f0ca None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:46.880370 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4e72e-cd1b-42a0-818f-6463ac802b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:46.880993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4e72e-cd1b-42a0-818f-6463ac802b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:46.881272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4e72e-cd1b-42a0-818f-6463ac802b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:46.881547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4e72e-cd1b-42a0-818f-6463ac802b06 admin admin] PATH_INFO: `/v3/users/a9b9514cc6bc4f96b9c765b74b45116f` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:46.882851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4e72e-cd1b-42a0-818f-6463ac802b06 admin admin] RBAC: Authorizing `identity:get_user(user_id=a9b9514cc6bc4f96b9c765b74b45116f)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:46.884710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4e72e-cd1b-42a0-818f-6463ac802b06 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:46.886253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Tue Oct 4 10:12:46 2022] GET /identity/v3/users/a9b9514cc6bc4f96b9c765b74b45116f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:12:49.065276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb63a8-f5e2-43c6-90cf-5f07ec178abf None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:49.065848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb63a8-f5e2-43c6-90cf-5f07ec178abf None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:49.065848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb63a8-f5e2-43c6-90cf-5f07ec178abf None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:49.067122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:12:49.072186 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97972c-4b5c-4ab0-ac1e-4752f15e5848 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:49.072591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97972c-4b5c-4ab0-ac1e-4752f15e5848 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:49.072744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97972c-4b5c-4ab0-ac1e-4752f15e5848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:49.091208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5d97972c-4b5c-4ab0-ac1e-4752f15e5848 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:12:49.092414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5d97972c-4b5c-4ab0-ac1e-4752f15e5848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:12:49.125721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567d6d9-0c24-4985-9658-9c4ee1cbc2e2 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:49.125999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567d6d9-0c24-4985-9658-9c4ee1cbc2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:49.126271 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567d6d9-0c24-4985-9658-9c4ee1cbc2e2 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:49.127586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:12:49.132565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c2705-4dc8-474f-b8b0-272b74e94fab None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:49.132848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c2705-4dc8-474f-b8b0-272b74e94fab None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:49.133119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c2705-4dc8-474f-b8b0-272b74e94fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:49.174308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:12:49.175240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG passlib.handlers.bcrypt [None req-e42c2705-4dc8-474f-b8b0-272b74e94fab None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81577) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 10:12:49.175633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG passlib.handlers.bcrypt [None req-e42c2705-4dc8-474f-b8b0-272b74e94fab None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81577) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 10:12:49.228064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e42c2705-4dc8-474f-b8b0-272b74e94fab None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:12:49.229678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e42c2705-4dc8-474f-b8b0-272b74e94fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:12:49.327838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:12:49.436192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97972c-4b5c-4ab0-ac1e-4752f15e5848 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:49.461546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:49.539185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97972c-4b5c-4ab0-ac1e-4752f15e5848 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:49.572681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ac22b-6a4d-4cdc-88ff-7b16cad5a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:49.573332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ac22b-6a4d-4cdc-88ff-7b16cad5a384 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:49.573606 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ac22b-6a4d-4cdc-88ff-7b16cad5a384 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:49.573877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ac22b-6a4d-4cdc-88ff-7b16cad5a384 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:49.584917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ac22b-6a4d-4cdc-88ff-7b16cad5a384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:12:49.590633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c2705-4dc8-474f-b8b0-272b74e94fab None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-9b6ac22b-6a4d-4cdc-88ff-7b16cad5a384 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:12:49.593683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:12:49.594697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:12:49.595552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:12:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:12:49.600463 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ac22b-6a4d-4cdc-88ff-7b16cad5a384 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:49.679087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:49.691741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c2705-4dc8-474f-b8b0-272b74e94fab None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:49.693285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:49.697215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ac22b-6a4d-4cdc-88ff-7b16cad5a384 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:49.727137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df028f-6752-4ecc-a188-f868afb83f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:49.728033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df028f-6752-4ecc-a188-f868afb83f80 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:49.728308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df028f-6752-4ecc-a188-f868afb83f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:49.728577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df028f-6752-4ecc-a188-f868afb83f80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:49.732413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494eb1b-f809-4ba4-bfe3-99e04988ca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:49.733004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494eb1b-f809-4ba4-bfe3-99e04988ca04 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:49.733285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494eb1b-f809-4ba4-bfe3-99e04988ca04 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:49.733557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494eb1b-f809-4ba4-bfe3-99e04988ca04 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:49.734272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494eb1b-f809-4ba4-bfe3-99e04988ca04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:12:49.734581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494eb1b-f809-4ba4-bfe3-99e04988ca04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:49.735986 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494eb1b-f809-4ba4-bfe3-99e04988ca04 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:49.747408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:12:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:12:49.752989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494eb1b-f809-4ba4-bfe3-99e04988ca04 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:49.794920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df028f-6752-4ecc-a188-f868afb83f80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:49.796449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df028f-6752-4ecc-a188-f868afb83f80 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:49.850241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494eb1b-f809-4ba4-bfe3-99e04988ca04 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:49.882843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318f1e7-b48f-4c31-a9f7-a30459dd9fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:49.883469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318f1e7-b48f-4c31-a9f7-a30459dd9fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:49.883749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318f1e7-b48f-4c31-a9f7-a30459dd9fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:49.884050 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318f1e7-b48f-4c31-a9f7-a30459dd9fe6 None admin] PATH_INFO: `/v3/users/a9b9514cc6bc4f96b9c765b74b45116f` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:49.885231 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318f1e7-b48f-4c31-a9f7-a30459dd9fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=a9b9514cc6bc4f96b9c765b74b45116f)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:49.886733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318f1e7-b48f-4c31-a9f7-a30459dd9fe6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:49.888365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 9/16] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:12:49 2022] GET /identity/v3/users/a9b9514cc6bc4f96b9c765b74b45116f => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:12:49.893834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 8/17] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 10:12:49.893961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318f1e7-b48f-4c31-a9f7-a30459dd9fe6 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:49.898977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df028f-6752-4ecc-a188-f868afb83f80 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:49.902559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:49.915182 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:49.993868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df028f-6752-4ecc-a188-f868afb83f80 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:49.995427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318f1e7-b48f-4c31-a9f7-a30459dd9fe6 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:50.028334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db4c17-53f3-4b02-b3ac-81c6cb885baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:50.028959 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db4c17-53f3-4b02-b3ac-81c6cb885baa None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:50.029061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bd3c4-385f-4ef1-a6e4-fcefe0d9b385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:50.029234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db4c17-53f3-4b02-b3ac-81c6cb885baa None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:50.029504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db4c17-53f3-4b02-b3ac-81c6cb885baa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:50.029820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bd3c4-385f-4ef1-a6e4-fcefe0d9b385 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:50.030101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bd3c4-385f-4ef1-a6e4-fcefe0d9b385 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:50.030373 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bd3c4-385f-4ef1-a6e4-fcefe0d9b385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:50.030609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db4c17-53f3-4b02-b3ac-81c6cb885baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:50.032070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db4c17-53f3-4b02-b3ac-81c6cb885baa None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:50.033597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 10/18] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:12:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:12:50.039243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db4c17-53f3-4b02-b3ac-81c6cb885baa None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:50.049947 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bd3c4-385f-4ef1-a6e4-fcefe0d9b385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:50.051399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bd3c4-385f-4ef1-a6e4-fcefe0d9b385 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4f7bd3c4-385f-4ef1-a6e4-fcefe0d9b385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:12:50.069659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:12:50.070987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:12:50.071796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:12:50.071796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:12:50.071796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:12:50.071796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 9/19] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:12:50.076998 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bd3c4-385f-4ef1-a6e4-fcefe0d9b385 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:50.118119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:50.131744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:50.137289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db4c17-53f3-4b02-b3ac-81c6cb885baa None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:50.171494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8e850-39a1-4d08-a0aa-a63c9fc2514f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:50.172178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8e850-39a1-4d08-a0aa-a63c9fc2514f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:50.172456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8e850-39a1-4d08-a0aa-a63c9fc2514f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:50.172730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8e850-39a1-4d08-a0aa-a63c9fc2514f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:50.173445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8e850-39a1-4d08-a0aa-a63c9fc2514f None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.domain.id=default, user.id=a9b9514cc6bc4f96b9c765b74b45116f) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:12:50.173745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8e850-39a1-4d08-a0aa-a63c9fc2514f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:50.175165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8e850-39a1-4d08-a0aa-a63c9fc2514f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:50.175737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bd3c4-385f-4ef1-a6e4-fcefe0d9b385 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:50.181772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1322 bytes} [Tue Oct 4 10:12:50 2022] GET /identity/v3/role_assignments?user.id=a9b9514cc6bc4f96b9c765b74b45116f&scope.domain.id=default&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:12:50.210994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ce899-8ffa-4509-9869-b3b2a577c4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:50.211880 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ce899-8ffa-4509-9869-b3b2a577c4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:50.212199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ce899-8ffa-4509-9869-b3b2a577c4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:50.212475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ce899-8ffa-4509-9869-b3b2a577c4e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:50.213137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ce899-8ffa-4509-9869-b3b2a577c4e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:12:50.214003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ce899-8ffa-4509-9869-b3b2a577c4e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:50.215454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ce899-8ffa-4509-9869-b3b2a577c4e7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:50.234444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:12:52.546646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1e23-6f33-4ab6-99cb-c4dad4ff0bce None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:52.547658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1e23-6f33-4ab6-99cb-c4dad4ff0bce None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:52.548189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1e23-6f33-4ab6-99cb-c4dad4ff0bce None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:52.549745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:12:52.561136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cb808-e8b6-4cd8-bc90-3fd8d29e4d16 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:52.561955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cb808-e8b6-4cd8-bc90-3fd8d29e4d16 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:52.562390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cb808-e8b6-4cd8-bc90-3fd8d29e4d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:52.582759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-810cb808-e8b6-4cd8-bc90-3fd8d29e4d16 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:12:52.584216 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-810cb808-e8b6-4cd8-bc90-3fd8d29e4d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:12:52.670058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 11/23] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:12:52.857582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b599604-622b-410a-9061-902cbf21f22f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:52.857874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b599604-622b-410a-9061-902cbf21f22f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:52.858060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b599604-622b-410a-9061-902cbf21f22f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:52.859519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:12:52.864833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b14eba-155c-4c8a-ba1e-b97d7ebe6f00 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:52.865354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b14eba-155c-4c8a-ba1e-b97d7ebe6f00 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:52.865823 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b14eba-155c-4c8a-ba1e-b97d7ebe6f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:52.888190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e0b14eba-155c-4c8a-ba1e-b97d7ebe6f00 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:12:52.889713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e0b14eba-155c-4c8a-ba1e-b97d7ebe6f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:12:52.958112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:52.985681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 12/25] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:12:53.129054 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b599604-622b-410a-9061-902cbf21f22f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:53.177950 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1a8b3-acea-489d-be7b-d0b6077915df None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:53.178289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1a8b3-acea-489d-be7b-d0b6077915df None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:53.178508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1a8b3-acea-489d-be7b-d0b6077915df None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:53.179840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 13/26] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:12:53.185111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54960099-e951-4052-bb94-b53242ebd606 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:53.185388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54960099-e951-4052-bb94-b53242ebd606 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:53.185822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54960099-e951-4052-bb94-b53242ebd606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:53.220513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-54960099-e951-4052-bb94-b53242ebd606 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:12:53.221962 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-54960099-e951-4052-bb94-b53242ebd606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:12:53.317340 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b599604-622b-410a-9061-902cbf21f22f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:53.359823 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 14/27] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:12:53.360716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54960099-e951-4052-bb94-b53242ebd606 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:53.406683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda2521-4258-488e-857f-7966813beeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:53.407251 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda2521-4258-488e-857f-7966813beeaa None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:53.407530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda2521-4258-488e-857f-7966813beeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:53.407796 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda2521-4258-488e-857f-7966813beeaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:53.436875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda2521-4258-488e-857f-7966813beeaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-1fda2521-4258-488e-857f-7966813beeaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:12:53.441754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:12:53.442605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:12:53.443384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 14/28] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:12:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:12:53.452237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda2521-4258-488e-857f-7966813beeaa None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:53.465847 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:53.563830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54960099-e951-4052-bb94-b53242ebd606 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:53.575238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:53.631378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd003323-7c7f-4548-b081-3361c91af4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:53.632044 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd003323-7c7f-4548-b081-3361c91af4ff None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:53.632324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd003323-7c7f-4548-b081-3361c91af4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:53.632591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd003323-7c7f-4548-b081-3361c91af4ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:53.653963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd003323-7c7f-4548-b081-3361c91af4ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:53.655425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd003323-7c7f-4548-b081-3361c91af4ff None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-dd003323-7c7f-4548-b081-3361c91af4ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:12:53.678866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:12:53.679739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:12:53.680590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:12:53.680590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:12:53.680590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:12:53.684414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 15/29] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:12:53.687418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd003323-7c7f-4548-b081-3361c91af4ff None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:53.694225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda2521-4258-488e-857f-7966813beeaa None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:53.772273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6895916-59a5-49ad-a1db-0369a98e89e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:53.772887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6895916-59a5-49ad-a1db-0369a98e89e7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:53.773162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6895916-59a5-49ad-a1db-0369a98e89e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:53.773432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6895916-59a5-49ad-a1db-0369a98e89e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:53.774224 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6895916-59a5-49ad-a1db-0369a98e89e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:12:53.774414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6895916-59a5-49ad-a1db-0369a98e89e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:53.775795 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6895916-59a5-49ad-a1db-0369a98e89e7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:53.796093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 15/30] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:12:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:12:53.796926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6895916-59a5-49ad-a1db-0369a98e89e7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:53.857803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd003323-7c7f-4548-b081-3361c91af4ff None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:53.893133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6661-6e7d-4ff4-b982-f4bcf7175c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:53.893974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6661-6e7d-4ff4-b982-f4bcf7175c33 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:53.894412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6661-6e7d-4ff4-b982-f4bcf7175c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:53.894829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6661-6e7d-4ff4-b982-f4bcf7175c33 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:53.895600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:53.895763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b6661-6e7d-4ff4-b982-f4bcf7175c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:12:53.896227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b6661-6e7d-4ff4-b982-f4bcf7175c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:53.897721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b6661-6e7d-4ff4-b982-f4bcf7175c33 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:53.911125 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 16/31] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:12:53.921189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6661-6e7d-4ff4-b982-f4bcf7175c33 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:53.942649 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:53.944681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6895916-59a5-49ad-a1db-0369a98e89e7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:53.988966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80843b-dd3e-4130-a57e-4f1fb8de75a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:53.990214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80843b-dd3e-4130-a57e-4f1fb8de75a1 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:53.990951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80843b-dd3e-4130-a57e-4f1fb8de75a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:53.991854 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80843b-dd3e-4130-a57e-4f1fb8de75a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:53.993033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80843b-dd3e-4130-a57e-4f1fb8de75a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:53.996172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80843b-dd3e-4130-a57e-4f1fb8de75a1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:54.036482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6661-6e7d-4ff4-b982-f4bcf7175c33 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:54.071859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced3f96-dfdf-45e6-b4fc-4030365e3c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:54.072536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced3f96-dfdf-45e6-b4fc-4030365e3c16 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:54.072839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced3f96-dfdf-45e6-b4fc-4030365e3c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:54.073109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced3f96-dfdf-45e6-b4fc-4030365e3c16 None admin] PATH_INFO: `/v3/users/a9b9514cc6bc4f96b9c765b74b45116f` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:54.074555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced3f96-dfdf-45e6-b4fc-4030365e3c16 None admin] RBAC: Authorizing `identity:get_user(user_id=a9b9514cc6bc4f96b9c765b74b45116f)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:54.076002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced3f96-dfdf-45e6-b4fc-4030365e3c16 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:54.077912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 17/32] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:12:53 2022] GET /identity/v3/users/a9b9514cc6bc4f96b9c765b74b45116f => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:12:54.078722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4af35-2cae-4533-b9e9-653b83cf6f99 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:54.078998 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4af35-2cae-4533-b9e9-653b83cf6f99 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:54.079268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4af35-2cae-4533-b9e9-653b83cf6f99 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:54.082687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 18/33] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:12:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:12:54.082687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4af35-2cae-4533-b9e9-653b83cf6f99 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:54.169683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:54.186074 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4af35-2cae-4533-b9e9-653b83cf6f99 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:54.219141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfb0a8-aeea-44f7-bb9a-33b68b74ce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:54.219675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfb0a8-aeea-44f7-bb9a-33b68b74ce13 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:54.219969 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfb0a8-aeea-44f7-bb9a-33b68b74ce13 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:54.220247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfb0a8-aeea-44f7-bb9a-33b68b74ce13 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:54.220900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfb0a8-aeea-44f7-bb9a-33b68b74ce13 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:54.222701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfb0a8-aeea-44f7-bb9a-33b68b74ce13 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:54.227752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 16/34] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Oct 4 10:12:53 2022] POST /identity/v3/roles => generated 219 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:12:54.228532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80843b-dd3e-4130-a57e-4f1fb8de75a1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:54.353789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80843b-dd3e-4130-a57e-4f1fb8de75a1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:54.387724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:54.398770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f136e-7623-4e99-8c02-1fe996455625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:54.398770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f136e-7623-4e99-8c02-1fe996455625 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:54.399057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f136e-7623-4e99-8c02-1fe996455625 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:54.399332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f136e-7623-4e99-8c02-1fe996455625 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:54.400701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f136e-7623-4e99-8c02-1fe996455625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:54.402943 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f136e-7623-4e99-8c02-1fe996455625 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:54.404707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 17/35] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:12:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:12:54.409612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e6652-b9d6-4c63-b10b-0614a1b46c61 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:54.409612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e6652-b9d6-4c63-b10b-0614a1b46c61 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:54.409612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e6652-b9d6-4c63-b10b-0614a1b46c61 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:54.409612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:12:54.409612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96985aa-d8e4-4345-9e3e-75d9ce5b563a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:54.409612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96985aa-d8e4-4345-9e3e-75d9ce5b563a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:54.409968 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96985aa-d8e4-4345-9e3e-75d9ce5b563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:54.432420 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d96985aa-d8e4-4345-9e3e-75d9ce5b563a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:12:54.433941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d96985aa-d8e4-4345-9e3e-75d9ce5b563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:12:54.512366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:12:54 2022] POST /identity/v3/projects => generated 301 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:12:54.512366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfb0a8-aeea-44f7-bb9a-33b68b74ce13 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:54.512616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 19/38] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:12:54.512616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcfdc7-67a5-41d5-872d-fd1f79726dc8 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:54.512911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcfdc7-67a5-41d5-872d-fd1f79726dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:54.513070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcfdc7-67a5-41d5-872d-fd1f79726dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:54.533890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f0fcfdc7-67a5-41d5-872d-fd1f79726dc8 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:12:54.535117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f0fcfdc7-67a5-41d5-872d-fd1f79726dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:12:54.620414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 20/39] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:12:54.622419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3e49c-ab68-43de-9e49-04958426f8e7 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:54.622713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3e49c-ab68-43de-9e49-04958426f8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:54.623014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3e49c-ab68-43de-9e49-04958426f8e7 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:54.624541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 21/40] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:12:54.630386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02f0c5-47f1-4e17-ad23-96b47a1231b2 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:54.630686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02f0c5-47f1-4e17-ad23-96b47a1231b2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:54.631018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02f0c5-47f1-4e17-ad23-96b47a1231b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:54.631852 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfb0a8-aeea-44f7-bb9a-33b68b74ce13 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:54.669443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-8d02f0c5-47f1-4e17-ad23-96b47a1231b2 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:12:54.670665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8d02f0c5-47f1-4e17-ad23-96b47a1231b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:12:54.695934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50612cca-934f-49fa-80ee-2676bfc6155a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:54.696710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50612cca-934f-49fa-80ee-2676bfc6155a None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:54.696996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50612cca-934f-49fa-80ee-2676bfc6155a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:54.697271 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50612cca-934f-49fa-80ee-2676bfc6155a None admin] PATH_INFO: `/v3/domains/default/users/a9b9514cc6bc4f96b9c765b74b45116f/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:54.702373 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50612cca-934f-49fa-80ee-2676bfc6155a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a9b9514cc6bc4f96b9c765b74b45116f, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:54.705218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50612cca-934f-49fa-80ee-2676bfc6155a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:54.749057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:54.768914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 22/41] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:12:54.793302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02f0c5-47f1-4e17-ad23-96b47a1231b2 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:54.808939 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:54.815826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 20/42] 10.222.0.33 () {58 vars in 1361 bytes} [Tue Oct 4 10:12:54 2022] PUT /identity/v3/domains/default/users/a9b9514cc6bc4f96b9c765b74b45116f/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:12:54.918332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50612cca-934f-49fa-80ee-2676bfc6155a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:55.022420 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02f0c5-47f1-4e17-ad23-96b47a1231b2 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:55.038306 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50612cca-934f-49fa-80ee-2676bfc6155a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:55.058469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3bf2-4863-4f24-8f96-fc626942b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:55.059114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3bf2-4863-4f24-8f96-fc626942b1f9 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:55.059375 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3bf2-4863-4f24-8f96-fc626942b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:55.059648 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3bf2-4863-4f24-8f96-fc626942b1f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:55.060347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b3bf2-4863-4f24-8f96-fc626942b1f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:55.061714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b3bf2-4863-4f24-8f96-fc626942b1f9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:55.078124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcf732-31b2-46be-952b-223aef356212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:55.080492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcf732-31b2-46be-952b-223aef356212 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:55.080492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcf732-31b2-46be-952b-223aef356212 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:55.080492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcf732-31b2-46be-952b-223aef356212 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:55.080492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcf732-31b2-46be-952b-223aef356212 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:55.081770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcf732-31b2-46be-952b-223aef356212 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:55.160358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 23/43] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Oct 4 10:12:54 2022] POST /identity/v3/roles => generated 225 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:12:55.161193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3bf2-4863-4f24-8f96-fc626942b1f9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:55.205246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 21/44] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Oct 4 10:12:54 2022] POST /identity/v3/roles => generated 223 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:12:55.221373 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:55.291090 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3bf2-4863-4f24-8f96-fc626942b1f9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:55.333983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c2098-81ee-4339-8c7c-fe66701e39c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:55.334704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c2098-81ee-4339-8c7c-fe66701e39c3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:55.334987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c2098-81ee-4339-8c7c-fe66701e39c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:55.335259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c2098-81ee-4339-8c7c-fe66701e39c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:55.336814 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c2098-81ee-4339-8c7c-fe66701e39c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:55.339617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c2098-81ee-4339-8c7c-fe66701e39c3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:55.341858 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 24/45] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:12:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:12:55.347335 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcf732-31b2-46be-952b-223aef356212 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:55.415436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:55.461635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcf732-31b2-46be-952b-223aef356212 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:55.499215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1eb27-f069-4142-b1f1-ac071ff166fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:55.499827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1eb27-f069-4142-b1f1-ac071ff166fd None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:55.500143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1eb27-f069-4142-b1f1-ac071ff166fd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:55.500422 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1eb27-f069-4142-b1f1-ac071ff166fd None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:55.501092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1eb27-f069-4142-b1f1-ac071ff166fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:55.502548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1eb27-f069-4142-b1f1-ac071ff166fd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:55.723573 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 22/46] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:12:55 2022] POST /identity/v3/projects => generated 312 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:12:57.036790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74492ca3-a871-4802-bbc8-e04e3602f0c9 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:57.037319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74492ca3-a871-4802-bbc8-e04e3602f0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:57.037319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74492ca3-a871-4802-bbc8-e04e3602f0c9 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:57.038676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 25/47] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:12:57.044454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b35787-b10f-4636-9b59-aa63a850da46 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:57.044863 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b35787-b10f-4636-9b59-aa63a850da46 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:57.045071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b35787-b10f-4636-9b59-aa63a850da46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:57.063659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c0b35787-b10f-4636-9b59-aa63a850da46 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:12:57.065180 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c0b35787-b10f-4636-9b59-aa63a850da46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:12:57.130175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 23/48] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:12:57.396309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74492ca3-a871-4802-bbc8-e04e3602f0c9 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:57.495526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74492ca3-a871-4802-bbc8-e04e3602f0c9 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:57.509768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:57.531378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afa663-c0ec-41b1-ad7f-86197d6d7184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:57.532051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afa663-c0ec-41b1-ad7f-86197d6d7184 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:57.532335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afa663-c0ec-41b1-ad7f-86197d6d7184 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:57.532603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afa663-c0ec-41b1-ad7f-86197d6d7184 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:57.543084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afa663-c0ec-41b1-ad7f-86197d6d7184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d5afa663-c0ec-41b1-ad7f-86197d6d7184 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:12:57.548714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:12:57.553620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:12:57.554396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 26/49] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:12:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:12:57.556154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b35787-b10f-4636-9b59-aa63a850da46 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:57.597051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:57.653005 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b35787-b10f-4636-9b59-aa63a850da46 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:57.687992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2675b-a3a7-4521-b7a9-fa791fc8e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:57.688605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2675b-a3a7-4521-b7a9-fa791fc8e331 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:57.688888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2675b-a3a7-4521-b7a9-fa791fc8e331 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:57.689166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2675b-a3a7-4521-b7a9-fa791fc8e331 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:57.689834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2675b-a3a7-4521-b7a9-fa791fc8e331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:12:57.690140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2675b-a3a7-4521-b7a9-fa791fc8e331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:57.691511 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2675b-a3a7-4521-b7a9-fa791fc8e331 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:57.703161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 24/50] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:12:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:12:57.708804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afa663-c0ec-41b1-ad7f-86197d6d7184 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:57.811643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afa663-c0ec-41b1-ad7f-86197d6d7184 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:57.846607 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1613e-40d6-44ac-a339-21b1e7834efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:57.847234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1613e-40d6-44ac-a339-21b1e7834efc None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:57.847514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1613e-40d6-44ac-a339-21b1e7834efc None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:57.847788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1613e-40d6-44ac-a339-21b1e7834efc None admin] PATH_INFO: `/v3/users/a9b9514cc6bc4f96b9c765b74b45116f` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:57.848943 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1613e-40d6-44ac-a339-21b1e7834efc None admin] RBAC: Authorizing `identity:get_user(user_id=a9b9514cc6bc4f96b9c765b74b45116f)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:57.850373 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1613e-40d6-44ac-a339-21b1e7834efc None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:57.851964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 27/51] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:12:57 2022] GET /identity/v3/users/a9b9514cc6bc4f96b9c765b74b45116f => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:12:57.857582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2675b-a3a7-4521-b7a9-fa791fc8e331 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:57.872746 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13342082-14d6-46c0-8eb0-98c0a294d1be None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:57.873029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13342082-14d6-46c0-8eb0-98c0a294d1be None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:57.873299 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13342082-14d6-46c0-8eb0-98c0a294d1be None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:57.874618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 28/52] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:12:57.879488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1736093-2d22-4d40-8e91-2b4cda97c450 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:57.879761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1736093-2d22-4d40-8e91-2b4cda97c450 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:57.880054 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1736093-2d22-4d40-8e91-2b4cda97c450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:57.897967 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e1736093-2d22-4d40-8e91-2b4cda97c450 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:12:57.899149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e1736093-2d22-4d40-8e91-2b4cda97c450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:12:57.936179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:57.959231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2675b-a3a7-4521-b7a9-fa791fc8e331 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:57.960744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:57.970247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 29/53] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:12:57.993259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f499a-1120-4e83-8c85-74db44eb6ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:57.993891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f499a-1120-4e83-8c85-74db44eb6ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:57.994170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f499a-1120-4e83-8c85-74db44eb6ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:57.995002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f499a-1120-4e83-8c85-74db44eb6ad5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:57.996146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f499a-1120-4e83-8c85-74db44eb6ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:57.997587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f499a-1120-4e83-8c85-74db44eb6ad5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:57.999133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 25/54] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:12:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:12:58.004892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1736093-2d22-4d40-8e91-2b4cda97c450 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:58.101690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1736093-2d22-4d40-8e91-2b4cda97c450 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:58.135620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010666d-f81c-4dfa-8807-d7f9b9844710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:58.136240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010666d-f81c-4dfa-8807-d7f9b9844710 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:58.136524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010666d-f81c-4dfa-8807-d7f9b9844710 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:58.136794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010666d-f81c-4dfa-8807-d7f9b9844710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:58.137514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010666d-f81c-4dfa-8807-d7f9b9844710 None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.domain.id=default, user.id=a9b9514cc6bc4f96b9c765b74b45116f) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:12:58.137823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010666d-f81c-4dfa-8807-d7f9b9844710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:58.139253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010666d-f81c-4dfa-8807-d7f9b9844710 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:58.145039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 30/55] 10.222.0.33 () {56 vars in 1322 bytes} [Tue Oct 4 10:12:58 2022] GET /identity/v3/role_assignments?user.id=a9b9514cc6bc4f96b9c765b74b45116f&scope.domain.id=default&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:12:58.236564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f499a-1120-4e83-8c85-74db44eb6ad5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:58.440314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f499a-1120-4e83-8c85-74db44eb6ad5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:58.472980 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d0e85-ac93-469a-8778-df78d0f7c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:58.473634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0e85-ac93-469a-8778-df78d0f7c393 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:58.473918 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0e85-ac93-469a-8778-df78d0f7c393 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:58.474199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0e85-ac93-469a-8778-df78d0f7c393 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:58.475301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d0e85-ac93-469a-8778-df78d0f7c393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:58.476768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d0e85-ac93-469a-8778-df78d0f7c393 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:58.478338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 26/56] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:12:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:12:58.484420 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010666d-f81c-4dfa-8807-d7f9b9844710 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:12:58.522653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:12:58.592533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010666d-f81c-4dfa-8807-d7f9b9844710 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:12:58.624785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7bd5a-5872-40cc-877b-96aee3b9d73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:12:58.625384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7bd5a-5872-40cc-877b-96aee3b9d73d None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:12:58.625661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7bd5a-5872-40cc-877b-96aee3b9d73d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:12:58.625937 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7bd5a-5872-40cc-877b-96aee3b9d73d None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:12:58.626584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7bd5a-5872-40cc-877b-96aee3b9d73d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:12:58.628031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7bd5a-5872-40cc-877b-96aee3b9d73d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:12:58.732020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 31/57] 10.222.0.33 () {60 vars in 1140 bytes} [Tue Oct 4 10:12:58 2022] POST /identity/v3/projects => generated 298 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:13:00.844160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c088708-79d2-4afc-90c3-535cb505bc5e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:00.844675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c088708-79d2-4afc-90c3-535cb505bc5e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:00.844788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c088708-79d2-4afc-90c3-535cb505bc5e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:00.846051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 27/58] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:00.851234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6417c1e-4a20-457d-a2a0-d53904008363 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:00.851640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6417c1e-4a20-457d-a2a0-d53904008363 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:00.851789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6417c1e-4a20-457d-a2a0-d53904008363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:00.869534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b6417c1e-4a20-457d-a2a0-d53904008363 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:00.870717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b6417c1e-4a20-457d-a2a0-d53904008363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:00.935611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 32/59] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:01.207814 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c088708-79d2-4afc-90c3-535cb505bc5e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:01.247560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:01.312998 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c088708-79d2-4afc-90c3-535cb505bc5e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:01.345242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36c798-2047-410e-b5ec-234222099a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:01.345858 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36c798-2047-410e-b5ec-234222099a09 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:01.346135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36c798-2047-410e-b5ec-234222099a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:01.346405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36c798-2047-410e-b5ec-234222099a09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:01.347501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36c798-2047-410e-b5ec-234222099a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:01.348937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36c798-2047-410e-b5ec-234222099a09 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:01.350470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 28/60] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:13:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:01.356522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6417c1e-4a20-457d-a2a0-d53904008363 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:01.373845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:01.452870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6417c1e-4a20-457d-a2a0-d53904008363 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:01.485368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3254702-c28a-4651-9b7a-1bb6a9fb19db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:01.485907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254702-c28a-4651-9b7a-1bb6a9fb19db None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:01.486209 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254702-c28a-4651-9b7a-1bb6a9fb19db None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:01.486478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254702-c28a-4651-9b7a-1bb6a9fb19db None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:01.487117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3254702-c28a-4651-9b7a-1bb6a9fb19db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:01.488588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3254702-c28a-4651-9b7a-1bb6a9fb19db None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:01.612779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 33/61] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:13:01 2022] POST /identity/v3/users => generated 275 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:13:04.866299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7a348-e08d-4497-88dd-077827cad83e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:04.867140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7a348-e08d-4497-88dd-077827cad83e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:04.867554 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7a348-e08d-4497-88dd-077827cad83e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:04.869103 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 29/62] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:04.881814 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93411b8-b4cd-44d9-b53f-e6d86e97c854 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:04.882606 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93411b8-b4cd-44d9-b53f-e6d86e97c854 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:04.883122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93411b8-b4cd-44d9-b53f-e6d86e97c854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:04.908972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c93411b8-b4cd-44d9-b53f-e6d86e97c854 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:04.910456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c93411b8-b4cd-44d9-b53f-e6d86e97c854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:04.987333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 34/63] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:05.111819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c1b37-1430-4da9-aff1-dc134b11df9d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.112346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c1b37-1430-4da9-aff1-dc134b11df9d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.112760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c1b37-1430-4da9-aff1-dc134b11df9d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:05.114247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 30/64] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:05.120575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f335c-70b9-4056-82a1-048fbc9cbc62 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.120868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f335c-70b9-4056-82a1-048fbc9cbc62 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.121149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f335c-70b9-4056-82a1-048fbc9cbc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:05.131399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:05.148929 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-8d3f335c-70b9-4056-82a1-048fbc9cbc62 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:05.150197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8d3f335c-70b9-4056-82a1-048fbc9cbc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:05.234618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 35/65] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:05.286793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328d462-471e-4931-9484-16e9a45ebc08 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.287340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328d462-471e-4931-9484-16e9a45ebc08 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.287778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328d462-471e-4931-9484-16e9a45ebc08 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:05.289550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 31/66] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:05.295084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951a72e-2f4b-4b17-b278-ce378164689a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.295380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951a72e-2f4b-4b17-b278-ce378164689a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.295659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951a72e-2f4b-4b17-b278-ce378164689a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:05.324982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-7951a72e-2f4b-4b17-b278-ce378164689a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:05.326196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7951a72e-2f4b-4b17-b278-ce378164689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:05.340844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328d462-471e-4931-9484-16e9a45ebc08 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:05.401916 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 36/67] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:05.507812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328d462-471e-4931-9484-16e9a45ebc08 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:05.523306 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:05.536664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951a72e-2f4b-4b17-b278-ce378164689a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:05.574657 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab41139-339e-4d38-b217-3da8a8ce050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:05.575680 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab41139-339e-4d38-b217-3da8a8ce050a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.576184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab41139-339e-4d38-b217-3da8a8ce050a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.576656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab41139-339e-4d38-b217-3da8a8ce050a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:05.595801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab41139-339e-4d38-b217-3da8a8ce050a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-aab41139-339e-4d38-b217-3da8a8ce050a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:05.602487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:05.603368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:05.604218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 32/68] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:13:05.605591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d31b1-053e-43b9-96e2-a8f9cbb8ecb6 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.605591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d31b1-053e-43b9-96e2-a8f9cbb8ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.605591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d31b1-053e-43b9-96e2-a8f9cbb8ecb6 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:05.606893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 33/69] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:05.612103 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d31b1-053e-43b9-96e2-a8f9cbb8ecb6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:05.640364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:05.685873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951a72e-2f4b-4b17-b278-ce378164689a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:05.719678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1228a89-8212-435d-962a-73b712d186f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:05.720335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1228a89-8212-435d-962a-73b712d186f3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.720439 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d31b1-053e-43b9-96e2-a8f9cbb8ecb6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:05.720612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1228a89-8212-435d-962a-73b712d186f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.720879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1228a89-8212-435d-962a-73b712d186f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:05.730954 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1228a89-8212-435d-962a-73b712d186f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d1228a89-8212-435d-962a-73b712d186f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:05.735763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:05.736665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:05.737436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 37/70] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:13:05.739852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02532eb1-dcd0-4059-9b0d-c6b28d88af59 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.740319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02532eb1-dcd0-4059-9b0d-c6b28d88af59 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.740598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02532eb1-dcd0-4059-9b0d-c6b28d88af59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:05.754615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3d5cf-8566-483c-b785-800524053464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:05.755221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3d5cf-8566-483c-b785-800524053464 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.755502 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3d5cf-8566-483c-b785-800524053464 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.755786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3d5cf-8566-483c-b785-800524053464 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:05.756486 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3d5cf-8566-483c-b785-800524053464 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:05.756796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3d5cf-8566-483c-b785-800524053464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:05.757786 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-02532eb1-dcd0-4059-9b0d-c6b28d88af59 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:05.758171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3d5cf-8566-483c-b785-800524053464 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:05.758991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-02532eb1-dcd0-4059-9b0d-c6b28d88af59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:05.766688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 34/71] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:05.767920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e996a63-9652-4e4c-90ec-db656c2edeb0 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.768242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e996a63-9652-4e4c-90ec-db656c2edeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.768613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e996a63-9652-4e4c-90ec-db656c2edeb0 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:05.769963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 35/72] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:05.770577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e996a63-9652-4e4c-90ec-db656c2edeb0 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:05.797755 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:05.831215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 38/73] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:05.832112 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02532eb1-dcd0-4059-9b0d-c6b28d88af59 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:05.884949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e996a63-9652-4e4c-90ec-db656c2edeb0 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:05.891239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:05.922235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47895a00-324a-43e3-bfc1-82f05a6a913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:05.922872 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47895a00-324a-43e3-bfc1-82f05a6a913b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.923148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47895a00-324a-43e3-bfc1-82f05a6a913b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.923416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47895a00-324a-43e3-bfc1-82f05a6a913b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:05.934708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47895a00-324a-43e3-bfc1-82f05a6a913b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-47895a00-324a-43e3-bfc1-82f05a6a913b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:05.939544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:05.940515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:05.941311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 36/74] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:13:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:05.941934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47895a00-324a-43e3-bfc1-82f05a6a913b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:05.949481 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02532eb1-dcd0-4059-9b0d-c6b28d88af59 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:05.984599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754ec46-3944-431f-9d72-31b431999bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:05.985224 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754ec46-3944-431f-9d72-31b431999bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.985518 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754ec46-3944-431f-9d72-31b431999bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.985798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754ec46-3944-431f-9d72-31b431999bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:05.986465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754ec46-3944-431f-9d72-31b431999bc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:05.986773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754ec46-3944-431f-9d72-31b431999bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:05.988210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754ec46-3944-431f-9d72-31b431999bc6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:05.997221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 39/75] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:05.998371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545fdb8-5fc2-4c62-8a7b-b72a8780e1a6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:05.998659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545fdb8-5fc2-4c62-8a7b-b72a8780e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:05.998937 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545fdb8-5fc2-4c62-8a7b-b72a8780e1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:06.017495 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1545fdb8-5fc2-4c62-8a7b-b72a8780e1a6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:06.018701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1545fdb8-5fc2-4c62-8a7b-b72a8780e1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:06.042225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:06.058055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47895a00-324a-43e3-bfc1-82f05a6a913b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:06.088126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 40/76] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:06.089228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545fdb8-5fc2-4c62-8a7b-b72a8780e1a6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:06.104359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114c7a9-ad69-42f8-96b9-2b74590ca55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:06.105368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114c7a9-ad69-42f8-96b9-2b74590ca55c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:06.105792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114c7a9-ad69-42f8-96b9-2b74590ca55c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:06.106076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114c7a9-ad69-42f8-96b9-2b74590ca55c None admin] PATH_INFO: `/v3/users/a8bbff83ddbe4d6295c01a6aea214d09` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:06.121367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114c7a9-ad69-42f8-96b9-2b74590ca55c None admin] RBAC: Authorizing `identity:get_user(user_id=a8bbff83ddbe4d6295c01a6aea214d09)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:06.122818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114c7a9-ad69-42f8-96b9-2b74590ca55c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:06.124474 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 37/77] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:05 2022] GET /identity/v3/users/a8bbff83ddbe4d6295c01a6aea214d09 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:06.124474 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114c7a9-ad69-42f8-96b9-2b74590ca55c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:06.139473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:06.197412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545fdb8-5fc2-4c62-8a7b-b72a8780e1a6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:06.227063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114c7a9-ad69-42f8-96b9-2b74590ca55c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:06.232242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c594cb-0ed5-4e03-a4fc-d7a640e7c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:06.232851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c594cb-0ed5-4e03-a4fc-d7a640e7c33a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:06.233127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c594cb-0ed5-4e03-a4fc-d7a640e7c33a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:06.233395 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c594cb-0ed5-4e03-a4fc-d7a640e7c33a None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:06.234057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c594cb-0ed5-4e03-a4fc-d7a640e7c33a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:06.234356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c594cb-0ed5-4e03-a4fc-d7a640e7c33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:06.235824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c594cb-0ed5-4e03-a4fc-d7a640e7c33a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:06.244381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 41/78] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:13:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:06.244983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c594cb-0ed5-4e03-a4fc-d7a640e7c33a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:06.265747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f4112-99c4-42e0-8e95-1970dd86094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:06.266437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f4112-99c4-42e0-8e95-1970dd86094f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:06.266716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f4112-99c4-42e0-8e95-1970dd86094f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:06.266989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f4112-99c4-42e0-8e95-1970dd86094f None admin] PATH_INFO: `/v3/users/a9b9514cc6bc4f96b9c765b74b45116f` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:06.268254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f4112-99c4-42e0-8e95-1970dd86094f None admin] RBAC: Authorizing `identity:get_user(user_id=a9b9514cc6bc4f96b9c765b74b45116f)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:06.269614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f4112-99c4-42e0-8e95-1970dd86094f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:06.271345 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 38/79] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:06 2022] GET /identity/v3/users/a9b9514cc6bc4f96b9c765b74b45116f => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:06.271967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f4112-99c4-42e0-8e95-1970dd86094f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:06.289475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:06.351364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c594cb-0ed5-4e03-a4fc-d7a640e7c33a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:06.358836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:06.378345 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f4112-99c4-42e0-8e95-1970dd86094f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:06.384995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba34c97-c543-4470-a141-466ade6bed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:06.385635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba34c97-c543-4470-a141-466ade6bed94 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:06.385918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba34c97-c543-4470-a141-466ade6bed94 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:06.386310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba34c97-c543-4470-a141-466ade6bed94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:06.396384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba34c97-c543-4470-a141-466ade6bed94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-2ba34c97-c543-4470-a141-466ade6bed94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:06.401773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:06.402780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:06.403692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 42/80] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:06.404406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba34c97-c543-4470-a141-466ade6bed94 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:06.414732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861de59-ca35-4349-bd1b-89bbcdcd01f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:06.415347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861de59-ca35-4349-bd1b-89bbcdcd01f3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:06.415632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861de59-ca35-4349-bd1b-89bbcdcd01f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:06.415910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861de59-ca35-4349-bd1b-89bbcdcd01f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:06.484090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861de59-ca35-4349-bd1b-89bbcdcd01f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:06.485566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861de59-ca35-4349-bd1b-89bbcdcd01f3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:06.499213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:06.503865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba34c97-c543-4470-a141-466ade6bed94 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:06.537389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1dc5-4d0c-4438-a325-21ae075b51b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:06.538023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1dc5-4d0c-4438-a325-21ae075b51b9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:06.538302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1dc5-4d0c-4438-a325-21ae075b51b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:06.538580 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1dc5-4d0c-4438-a325-21ae075b51b9 None admin] PATH_INFO: `/v3/users/a8bbff83ddbe4d6295c01a6aea214d09` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:06.539712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1dc5-4d0c-4438-a325-21ae075b51b9 None admin] RBAC: Authorizing `identity:get_user(user_id=a8bbff83ddbe4d6295c01a6aea214d09)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:06.541726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1dc5-4d0c-4438-a325-21ae075b51b9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:06.543307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 43/81] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:06 2022] GET /identity/v3/users/a8bbff83ddbe4d6295c01a6aea214d09 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:06.544090 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1dc5-4d0c-4438-a325-21ae075b51b9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:06.577774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:06.586316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 39/82] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:06.590370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861de59-ca35-4349-bd1b-89bbcdcd01f3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:06.644176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1dc5-4d0c-4438-a325-21ae075b51b9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:06.677654 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5f3a5-e1a4-4d06-b46e-79826d646d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:06.678248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5f3a5-e1a4-4d06-b46e-79826d646d4f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:06.678524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5f3a5-e1a4-4d06-b46e-79826d646d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:06.678794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5f3a5-e1a4-4d06-b46e-79826d646d4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:06.686280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861de59-ca35-4349-bd1b-89bbcdcd01f3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:06.701560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:06.721502 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf00bd1-9562-47d4-9e1c-f2bcbba4d815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:06.722127 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf00bd1-9562-47d4-9e1c-f2bcbba4d815 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:06.722408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf00bd1-9562-47d4-9e1c-f2bcbba4d815 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:06.722683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf00bd1-9562-47d4-9e1c-f2bcbba4d815 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:06.723799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf00bd1-9562-47d4-9e1c-f2bcbba4d815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:06.725261 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf00bd1-9562-47d4-9e1c-f2bcbba4d815 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:06.726891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 40/83] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:13:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:06.727721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf00bd1-9562-47d4-9e1c-f2bcbba4d815 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:06.745102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5f3a5-e1a4-4d06-b46e-79826d646d4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:06.746500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5f3a5-e1a4-4d06-b46e-79826d646d4f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:06.779142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:06.825138 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf00bd1-9562-47d4-9e1c-f2bcbba4d815 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:06.843783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 44/84] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:06.845541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5f3a5-e1a4-4d06-b46e-79826d646d4f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:06.862986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e4619-abc8-482e-b97d-eba44b4f1fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:06.863600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e4619-abc8-482e-b97d-eba44b4f1fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:06.863884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e4619-abc8-482e-b97d-eba44b4f1fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:06.864229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e4619-abc8-482e-b97d-eba44b4f1fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:06.864990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e4619-abc8-482e-b97d-eba44b4f1fd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:06.865308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e4619-abc8-482e-b97d-eba44b4f1fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:06.866668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e4619-abc8-482e-b97d-eba44b4f1fd0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:06.875340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 41/85] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:06.876812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e4619-abc8-482e-b97d-eba44b4f1fd0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:06.923791 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:06.948115 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5f3a5-e1a4-4d06-b46e-79826d646d4f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:06.978113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e4619-abc8-482e-b97d-eba44b4f1fd0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:06.982499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174dc1e-e2a4-4633-ba1d-bbcbd28cf182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:06.983102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174dc1e-e2a4-4633-ba1d-bbcbd28cf182 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:06.983381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174dc1e-e2a4-4633-ba1d-bbcbd28cf182 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:06.983651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174dc1e-e2a4-4633-ba1d-bbcbd28cf182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:06.986225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:07.011561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787871d-66c1-4bc1-b92d-72913a560af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:07.012157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787871d-66c1-4bc1-b92d-72913a560af5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:07.012441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787871d-66c1-4bc1-b92d-72913a560af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:07.012719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787871d-66c1-4bc1-b92d-72913a560af5 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:07.013860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787871d-66c1-4bc1-b92d-72913a560af5 None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:07.015286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787871d-66c1-4bc1-b92d-72913a560af5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:07.016946 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 42/86] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:06 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:07.017687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787871d-66c1-4bc1-b92d-72913a560af5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:07.056618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174dc1e-e2a4-4633-ba1d-bbcbd28cf182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:07.058063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174dc1e-e2a4-4633-ba1d-bbcbd28cf182 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:07.113535 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787871d-66c1-4bc1-b92d-72913a560af5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:07.125586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:07.145293 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c2a07-a22a-4392-ada0-10be02f9e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:07.145887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c2a07-a22a-4392-ada0-10be02f9e393 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:07.146165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c2a07-a22a-4392-ada0-10be02f9e393 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:07.146438 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c2a07-a22a-4392-ada0-10be02f9e393 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:07.147083 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c2a07-a22a-4392-ada0-10be02f9e393 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:07.148517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c2a07-a22a-4392-ada0-10be02f9e393 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:07.152877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 45/87] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:07.153702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174dc1e-e2a4-4633-ba1d-bbcbd28cf182 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:07.188066 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:07.249890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174dc1e-e2a4-4633-ba1d-bbcbd28cf182 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:07.264986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 43/88] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:13:07 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:13:07.265821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c2a07-a22a-4392-ada0-10be02f9e393 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:07.295919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c40bc-dfc1-41df-9f5b-b71f715c9f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:07.296742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c40bc-dfc1-41df-9f5b-b71f715c9f99 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:07.297136 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c40bc-dfc1-41df-9f5b-b71f715c9f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:07.297414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c40bc-dfc1-41df-9f5b-b71f715c9f99 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:07.299412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c40bc-dfc1-41df-9f5b-b71f715c9f99 None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:07.300663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c40bc-dfc1-41df-9f5b-b71f715c9f99 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:07.302482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 46/89] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:07 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:07.308660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c40bc-dfc1-41df-9f5b-b71f715c9f99 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:07.378517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c2a07-a22a-4392-ada0-10be02f9e393 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:07.417081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3d8c-33de-46eb-8c9a-be2c79670df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:07.417793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3d8c-33de-46eb-8c9a-be2c79670df7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:07.418077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3d8c-33de-46eb-8c9a-be2c79670df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:07.418367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3d8c-33de-46eb-8c9a-be2c79670df7 None admin] PATH_INFO: `/v3/users/a8bbff83ddbe4d6295c01a6aea214d09` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:07.419580 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd3d8c-33de-46eb-8c9a-be2c79670df7 None admin] RBAC: Authorizing `identity:get_user(user_id=a8bbff83ddbe4d6295c01a6aea214d09)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:07.421085 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd3d8c-33de-46eb-8c9a-be2c79670df7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:07.422712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 44/90] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:07 2022] GET /identity/v3/users/a8bbff83ddbe4d6295c01a6aea214d09 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:07.423503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3d8c-33de-46eb-8c9a-be2c79670df7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:07.437612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c40bc-dfc1-41df-9f5b-b71f715c9f99 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:07.438871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:07.475149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:07.476365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af058f7-fe42-4293-844a-78b2b598786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:07.478083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af058f7-fe42-4293-844a-78b2b598786c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:07.478083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af058f7-fe42-4293-844a-78b2b598786c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:07.478083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af058f7-fe42-4293-844a-78b2b598786c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:07.478319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af058f7-fe42-4293-844a-78b2b598786c None admin] RBAC: Adding query filter params (role.id=c071e1d121a643a48556e6287cde21c0, scope.project.id=df0f459e95f141488f03abcb8bea472c, user.id=a8bbff83ddbe4d6295c01a6aea214d09) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:07.479354 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af058f7-fe42-4293-844a-78b2b598786c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:07.480043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af058f7-fe42-4293-844a-78b2b598786c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:07.486277 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 47/91] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:07 2022] GET /identity/v3/role_assignments?user.id=a8bbff83ddbe4d6295c01a6aea214d09&scope.project.id=df0f459e95f141488f03abcb8bea472c&role.id=c071e1d121a643a48556e6287cde21c0 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:07.487105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af058f7-fe42-4293-844a-78b2b598786c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:07.617778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3d8c-33de-46eb-8c9a-be2c79670df7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:07.623215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af058f7-fe42-4293-844a-78b2b598786c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:07.664699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c0a9a-c774-48f5-a9ae-0ed080e04069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:07.665356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c0a9a-c774-48f5-a9ae-0ed080e04069 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:07.665641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c0a9a-c774-48f5-a9ae-0ed080e04069 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:07.665918 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c0a9a-c774-48f5-a9ae-0ed080e04069 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:07.667459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c0a9a-c774-48f5-a9ae-0ed080e04069 None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:07.669469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5351f10-5a4f-4d5f-892d-62d2a9a91d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:07.669605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c0a9a-c774-48f5-a9ae-0ed080e04069 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:07.669699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5351f10-5a4f-4d5f-892d-62d2a9a91d6d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:07.669877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5351f10-5a4f-4d5f-892d-62d2a9a91d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:07.670684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5351f10-5a4f-4d5f-892d-62d2a9a91d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:07.670787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 45/92] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:07 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:07.671173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5351f10-5a4f-4d5f-892d-62d2a9a91d6d None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=df0f459e95f141488f03abcb8bea472c, user.id=a9b9514cc6bc4f96b9c765b74b45116f) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:07.671486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5351f10-5a4f-4d5f-892d-62d2a9a91d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:07.671594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c0a9a-c774-48f5-a9ae-0ed080e04069 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:07.673427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5351f10-5a4f-4d5f-892d-62d2a9a91d6d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:07.679992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 48/93] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:07 2022] GET /identity/v3/role_assignments?user.id=a9b9514cc6bc4f96b9c765b74b45116f&scope.project.id=df0f459e95f141488f03abcb8bea472c&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:07.680902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5351f10-5a4f-4d5f-892d-62d2a9a91d6d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:07.724878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:07.814316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5351f10-5a4f-4d5f-892d-62d2a9a91d6d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:07.823701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c0a9a-c774-48f5-a9ae-0ed080e04069 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:07.828292 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:07.853120 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917dc0d-5195-44cb-a7f0-8727fcb757ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:07.855242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917dc0d-5195-44cb-a7f0-8727fcb757ed None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:07.855525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917dc0d-5195-44cb-a7f0-8727fcb757ed None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:07.855794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917dc0d-5195-44cb-a7f0-8727fcb757ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:07.856616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917dc0d-5195-44cb-a7f0-8727fcb757ed None admin] RBAC: Adding query filter params (role.id=f63ab1c53b2e4aa0bf00e4798908cbfb, scope.project.id=df0f459e95f141488f03abcb8bea472c, user.id=a8bbff83ddbe4d6295c01a6aea214d09) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:07.856926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917dc0d-5195-44cb-a7f0-8727fcb757ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:07.858356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917dc0d-5195-44cb-a7f0-8727fcb757ed None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:07.864320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 49/94] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:07 2022] GET /identity/v3/role_assignments?user.id=a8bbff83ddbe4d6295c01a6aea214d09&scope.project.id=df0f459e95f141488f03abcb8bea472c&role.id=f63ab1c53b2e4aa0bf00e4798908cbfb => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:07.878540 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99446a5-de54-48de-9ad5-b54f794ffee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:07.879216 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99446a5-de54-48de-9ad5-b54f794ffee1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:07.879500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99446a5-de54-48de-9ad5-b54f794ffee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:07.879780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99446a5-de54-48de-9ad5-b54f794ffee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:07.968792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99446a5-de54-48de-9ad5-b54f794ffee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:07.970296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99446a5-de54-48de-9ad5-b54f794ffee1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:08.081416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 46/95] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:08.088691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917dc0d-5195-44cb-a7f0-8727fcb757ed None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:08.208291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:08.216189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917dc0d-5195-44cb-a7f0-8727fcb757ed None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:08.264757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addc319-36cf-4b2e-bc08-fca8d45f56eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:08.265419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addc319-36cf-4b2e-bc08-fca8d45f56eb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:08.265699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addc319-36cf-4b2e-bc08-fca8d45f56eb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:08.265971 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addc319-36cf-4b2e-bc08-fca8d45f56eb None admin] PATH_INFO: `/v3/projects/c4109c58d1304ca4953b1c2c0c11d7ac` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:08.267207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addc319-36cf-4b2e-bc08-fca8d45f56eb None admin] RBAC: Authorizing `identity:get_project(project_id=c4109c58d1304ca4953b1c2c0c11d7ac)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:08.268679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addc319-36cf-4b2e-bc08-fca8d45f56eb None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:08.270320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 50/96] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:08 2022] GET /identity/v3/projects/c4109c58d1304ca4953b1c2c0c11d7ac => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:08.277795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99446a5-de54-48de-9ad5-b54f794ffee1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:08.281537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:08.400025 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99446a5-de54-48de-9ad5-b54f794ffee1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:08.439447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c15663-b8b2-46b0-8ed9-8a0cc32bd65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:08.440115 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c15663-b8b2-46b0-8ed9-8a0cc32bd65f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:08.440400 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c15663-b8b2-46b0-8ed9-8a0cc32bd65f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:08.440678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c15663-b8b2-46b0-8ed9-8a0cc32bd65f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:08.441421 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c15663-b8b2-46b0-8ed9-8a0cc32bd65f None admin] RBAC: Adding query filter params (role.id=c071e1d121a643a48556e6287cde21c0, scope.project.id=c4109c58d1304ca4953b1c2c0c11d7ac, user.id=a8bbff83ddbe4d6295c01a6aea214d09) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:08.441737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c15663-b8b2-46b0-8ed9-8a0cc32bd65f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:08.443305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c15663-b8b2-46b0-8ed9-8a0cc32bd65f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:08.454473 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 47/97] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:08 2022] GET /identity/v3/role_assignments?user.id=a8bbff83ddbe4d6295c01a6aea214d09&scope.project.id=c4109c58d1304ca4953b1c2c0c11d7ac&role.id=c071e1d121a643a48556e6287cde21c0 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:10.196605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc452979-d1f0-46b1-a6dc-a8ca6f75dcab None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:10.198288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc452979-d1f0-46b1-a6dc-a8ca6f75dcab None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:10.198767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc452979-d1f0-46b1-a6dc-a8ca6f75dcab None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:10.200344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 51/98] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:10.205706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c033c5-21fa-4739-ab04-7c759609d540 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:10.206508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c033c5-21fa-4739-ab04-7c759609d540 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:10.207025 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c033c5-21fa-4739-ab04-7c759609d540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:10.231211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-78c033c5-21fa-4739-ab04-7c759609d540 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:10.232805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-78c033c5-21fa-4739-ab04-7c759609d540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:10.310991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:10.322055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 48/99] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:10.392530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208f29b-5381-4ec5-9762-06a9fbe01c29 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:10.392849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208f29b-5381-4ec5-9762-06a9fbe01c29 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:10.393082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208f29b-5381-4ec5-9762-06a9fbe01c29 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:10.394417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 52/100] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:10.404224 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a45e-620b-4045-a0c5-ec07d5ad759b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:10.404512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a45e-620b-4045-a0c5-ec07d5ad759b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:10.404787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a45e-620b-4045-a0c5-ec07d5ad759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:10.428906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-75f4a45e-620b-4045-a0c5-ec07d5ad759b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:10.430166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-75f4a45e-620b-4045-a0c5-ec07d5ad759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:10.517411 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 49/101] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:10.701923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea391b31-58c8-4056-a40e-31196def4026 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:10.702265 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea391b31-58c8-4056-a40e-31196def4026 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:10.702473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea391b31-58c8-4056-a40e-31196def4026 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:10.703820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 53/102] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:10.709050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb41e5-c80f-407f-b251-e2d6092a5e8a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:10.709342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb41e5-c80f-407f-b251-e2d6092a5e8a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:10.709625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb41e5-c80f-407f-b251-e2d6092a5e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:10.737362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d2cb41e5-c80f-407f-b251-e2d6092a5e8a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:10.738570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d2cb41e5-c80f-407f-b251-e2d6092a5e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:10.806214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 50/103] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:10.875930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea391b31-58c8-4056-a40e-31196def4026 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:11.003436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea391b31-58c8-4056-a40e-31196def4026 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:11.048963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0d1c8-2d25-42dd-9167-413d0f2786c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:11.049610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0d1c8-2d25-42dd-9167-413d0f2786c8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:11.049893 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0d1c8-2d25-42dd-9167-413d0f2786c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:11.050169 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0d1c8-2d25-42dd-9167-413d0f2786c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:11.051286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0d1c8-2d25-42dd-9167-413d0f2786c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:11.052751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0d1c8-2d25-42dd-9167-413d0f2786c8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:11.054338 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 54/104] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:13:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:11.060988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb41e5-c80f-407f-b251-e2d6092a5e8a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:11.122790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0d1c8-2d25-42dd-9167-413d0f2786c8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:11.145126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:11.175279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:11.230136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb41e5-c80f-407f-b251-e2d6092a5e8a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:11.278225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0d1c8-2d25-42dd-9167-413d0f2786c8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:11.292832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406c1d7-f8d5-4a77-ba72-63227e4c31ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:11.293455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c1d7-f8d5-4a77-ba72-63227e4c31ab None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:11.293737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c1d7-f8d5-4a77-ba72-63227e4c31ab None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:11.294110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c1d7-f8d5-4a77-ba72-63227e4c31ab None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:11.294773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406c1d7-f8d5-4a77-ba72-63227e4c31ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:11.296257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406c1d7-f8d5-4a77-ba72-63227e4c31ab None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:11.319909 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449c23b-399e-4dfe-98a6-e7fba70d22cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:11.320507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449c23b-399e-4dfe-98a6-e7fba70d22cf None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:11.320842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449c23b-399e-4dfe-98a6-e7fba70d22cf None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:11.321127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449c23b-399e-4dfe-98a6-e7fba70d22cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:11.332697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449c23b-399e-4dfe-98a6-e7fba70d22cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-7449c23b-399e-4dfe-98a6-e7fba70d22cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:11.338512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:11.339368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:11.340157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 55/105] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:13:11.340838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449c23b-399e-4dfe-98a6-e7fba70d22cf None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:11.392367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 51/106] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:13:11 2022] POST /identity/v3/projects => generated 302 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:13:11.394105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc48b1-9ae7-42f4-88fe-3144d2f8aea3 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:11.395046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc48b1-9ae7-42f4-88fe-3144d2f8aea3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:11.396151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc48b1-9ae7-42f4-88fe-3144d2f8aea3 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:11.397807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 52/107] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:11.398762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc48b1-9ae7-42f4-88fe-3144d2f8aea3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:11.472307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:11.495728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449c23b-399e-4dfe-98a6-e7fba70d22cf None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:11.529298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc48b1-9ae7-42f4-88fe-3144d2f8aea3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:11.541404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:11.570093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268a66e-6c84-4665-8669-aa410061220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:11.570675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268a66e-6c84-4665-8669-aa410061220e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:11.571072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268a66e-6c84-4665-8669-aa410061220e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:11.571351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268a66e-6c84-4665-8669-aa410061220e None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:11.572300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268a66e-6c84-4665-8669-aa410061220e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:11.573281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268a66e-6c84-4665-8669-aa410061220e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:11.574879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268a66e-6c84-4665-8669-aa410061220e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:11.575083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c38ce-547e-4f8d-bf51-6267e43547ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:11.575740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c38ce-547e-4f8d-bf51-6267e43547ee None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:11.576073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c38ce-547e-4f8d-bf51-6267e43547ee None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:11.576356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c38ce-547e-4f8d-bf51-6267e43547ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:11.587643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 53/108] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:11.589440 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3f681-5405-40f0-a0ea-ccf50712843c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:11.589725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3f681-5405-40f0-a0ea-ccf50712843c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:11.590000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3f681-5405-40f0-a0ea-ccf50712843c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:11.599892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c38ce-547e-4f8d-bf51-6267e43547ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-ad5c38ce-547e-4f8d-bf51-6267e43547ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:11.605129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:11.606019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 56/109] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:11.607197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c38ce-547e-4f8d-bf51-6267e43547ee None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:11.625574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-79f3f681-5405-40f0-a0ea-ccf50712843c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:11.627143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-79f3f681-5405-40f0-a0ea-ccf50712843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:11.717453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 54/110] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:11.719270 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ad21e-679d-403c-83f8-1d11ef49c2fc None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:11.719794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ad21e-679d-403c-83f8-1d11ef49c2fc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:11.720285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ad21e-679d-403c-83f8-1d11ef49c2fc None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:11.722007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 55/111] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:11.722896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ad21e-679d-403c-83f8-1d11ef49c2fc None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:11.740079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c38ce-547e-4f8d-bf51-6267e43547ee None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:11.778380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cc936-5206-4303-9944-64f822b523df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:11.779330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cc936-5206-4303-9944-64f822b523df None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:11.779618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cc936-5206-4303-9944-64f822b523df None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:11.779892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cc936-5206-4303-9944-64f822b523df None admin] PATH_INFO: `/v3/users/3ecd6c2ccd5c41afac20982b8f0b4df4` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:11.808657 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cc936-5206-4303-9944-64f822b523df None admin] RBAC: Authorizing `identity:get_user(user_id=3ecd6c2ccd5c41afac20982b8f0b4df4)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:11.810117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cc936-5206-4303-9944-64f822b523df None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:11.813277 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 57/112] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:11 2022] GET /identity/v3/users/3ecd6c2ccd5c41afac20982b8f0b4df4 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:11.816024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c07a-04fd-4c25-be92-89fa71ef597a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:11.816314 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c07a-04fd-4c25-be92-89fa71ef597a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:11.816590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c07a-04fd-4c25-be92-89fa71ef597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:11.856501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9d32c07a-04fd-4c25-be92-89fa71ef597a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:11.858956 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9d32c07a-04fd-4c25-be92-89fa71ef597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:11.861448 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:11.922180 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ad21e-679d-403c-83f8-1d11ef49c2fc None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:11.925850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:11.992081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a9886-777b-4dd1-a32b-6fc63658bde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:11.993063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a9886-777b-4dd1-a32b-6fc63658bde7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:11.993876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a9886-777b-4dd1-a32b-6fc63658bde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:11.995422 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a9886-777b-4dd1-a32b-6fc63658bde7 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:11.997453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a9886-777b-4dd1-a32b-6fc63658bde7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:11.997979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a9886-777b-4dd1-a32b-6fc63658bde7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:11.999711 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 58/113] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:12.000130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a9886-777b-4dd1-a32b-6fc63658bde7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:12.001082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32c07a-04fd-4c25-be92-89fa71ef597a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:12.022143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 56/114] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:12.031723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a9886-777b-4dd1-a32b-6fc63658bde7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:12.144040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32c07a-04fd-4c25-be92-89fa71ef597a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:12.165316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a9886-777b-4dd1-a32b-6fc63658bde7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:12.179205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fd779-f81b-459e-804f-a5607356f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:12.179931 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fd779-f81b-459e-804f-a5607356f234 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:12.180337 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fd779-f81b-459e-804f-a5607356f234 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:12.180819 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fd779-f81b-459e-804f-a5607356f234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:12.190195 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:12.212813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf5854-ee77-4859-832e-cfa9c2bc10da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:12.214381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf5854-ee77-4859-832e-cfa9c2bc10da None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:12.215116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf5854-ee77-4859-832e-cfa9c2bc10da None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:12.215842 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf5854-ee77-4859-832e-cfa9c2bc10da None admin] PATH_INFO: `/v3/users/a8bbff83ddbe4d6295c01a6aea214d09` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:12.217162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf5854-ee77-4859-832e-cfa9c2bc10da None admin] RBAC: Authorizing `identity:get_user(user_id=a8bbff83ddbe4d6295c01a6aea214d09)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:12.219789 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf5854-ee77-4859-832e-cfa9c2bc10da None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:12.221877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 57/115] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:12 2022] GET /identity/v3/users/a8bbff83ddbe4d6295c01a6aea214d09 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:12.223319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6012f4-7947-4d32-9a23-b0a0e7683cc3 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:12.223757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6012f4-7947-4d32-9a23-b0a0e7683cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:12.224189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6012f4-7947-4d32-9a23-b0a0e7683cc3 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:12.225761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 58/116] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:12.226896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6012f4-7947-4d32-9a23-b0a0e7683cc3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:12.262275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fd779-f81b-459e-804f-a5607356f234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:12.263870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fd779-f81b-459e-804f-a5607356f234 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:12.271126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:12.353536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6012f4-7947-4d32-9a23-b0a0e7683cc3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:12.378161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 59/117] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:12.378161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fd779-f81b-459e-804f-a5607356f234 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:12.393290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743be38a-b913-4b53-b22e-a85e4b08f96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:12.394039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be38a-b913-4b53-b22e-a85e4b08f96b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:12.394276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be38a-b913-4b53-b22e-a85e4b08f96b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:12.394518 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be38a-b913-4b53-b22e-a85e4b08f96b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:12.405739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743be38a-b913-4b53-b22e-a85e4b08f96b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-743be38a-b913-4b53-b22e-a85e4b08f96b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:12.411023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:12.411849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:12.412774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 59/118] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:13:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:12.413416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ca72b-56bc-476a-9106-0c1dfb4138e6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:12.414118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ca72b-56bc-476a-9106-0c1dfb4138e6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:12.414118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ca72b-56bc-476a-9106-0c1dfb4138e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:12.424496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:12.431938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2d2ca72b-56bc-476a-9106-0c1dfb4138e6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:12.433250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2d2ca72b-56bc-476a-9106-0c1dfb4138e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:12.488877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fd779-f81b-459e-804f-a5607356f234 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:12.516108 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 60/119] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:12.517276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ca72b-56bc-476a-9106-0c1dfb4138e6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:12.524121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2412b97-e513-4e97-a88d-dea5ae851a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:12.524762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2412b97-e513-4e97-a88d-dea5ae851a2f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:12.525045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2412b97-e513-4e97-a88d-dea5ae851a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:12.525890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2412b97-e513-4e97-a88d-dea5ae851a2f None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:12.527043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2412b97-e513-4e97-a88d-dea5ae851a2f None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:12.528590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2412b97-e513-4e97-a88d-dea5ae851a2f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:12.530613 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 60/120] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:12 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:12.531393 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2412b97-e513-4e97-a88d-dea5ae851a2f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:12.553297 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:12.644992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ca72b-56bc-476a-9106-0c1dfb4138e6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:12.645594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2412b97-e513-4e97-a88d-dea5ae851a2f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:12.655746 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:12.686481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0ff44-964e-40d3-904e-44971730a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:12.687182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0ff44-964e-40d3-904e-44971730a247 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:12.687477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0ff44-964e-40d3-904e-44971730a247 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:12.687742 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0ff44-964e-40d3-904e-44971730a247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:12.694282 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775dc99-e937-4dd2-8739-ae5ca20106b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:12.695384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775dc99-e937-4dd2-8739-ae5ca20106b5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:12.696410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775dc99-e937-4dd2-8739-ae5ca20106b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:12.696989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775dc99-e937-4dd2-8739-ae5ca20106b5 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:12.699130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775dc99-e937-4dd2-8739-ae5ca20106b5 None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:12.699233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0ff44-964e-40d3-904e-44971730a247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:12.700899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775dc99-e937-4dd2-8739-ae5ca20106b5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:12.703072 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 61/121] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:12 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:12.704039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775dc99-e937-4dd2-8739-ae5ca20106b5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-96c0ff44-964e-40d3-904e-44971730a247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:12.709007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:12.709882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:12.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 61/122] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:13:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:12.711295 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0ff44-964e-40d3-904e-44971730a247 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:12.801115 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:12.818777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0ff44-964e-40d3-904e-44971730a247 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:12.832329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775dc99-e937-4dd2-8739-ae5ca20106b5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:12.856434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684977a-629f-4bc5-875a-a0411270553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:12.857170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684977a-629f-4bc5-875a-a0411270553f None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:12.857463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684977a-629f-4bc5-875a-a0411270553f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:12.857741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684977a-629f-4bc5-875a-a0411270553f None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c/users/a8bbff83ddbe4d6295c01a6aea214d09/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:12.859649 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684977a-629f-4bc5-875a-a0411270553f None admin] RBAC: Authorizing `identity:create_grant(project_id=df0f459e95f141488f03abcb8bea472c, user_id=a8bbff83ddbe4d6295c01a6aea214d09, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:12.861143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684977a-629f-4bc5-875a-a0411270553f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:12.867910 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ee3e5-75ff-4de9-88b7-b39282f9fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:12.868608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ee3e5-75ff-4de9-88b7-b39282f9fde0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:12.868891 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ee3e5-75ff-4de9-88b7-b39282f9fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:12.869204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ee3e5-75ff-4de9-88b7-b39282f9fde0 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:12.869870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ee3e5-75ff-4de9-88b7-b39282f9fde0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:12.870176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ee3e5-75ff-4de9-88b7-b39282f9fde0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:12.871571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ee3e5-75ff-4de9-88b7-b39282f9fde0 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:12.879585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 62/123] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:13:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:12.880387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ee3e5-75ff-4de9-88b7-b39282f9fde0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:12.920058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:12.943093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 62/124] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:13:12 2022] PUT /identity/v3/projects/df0f459e95f141488f03abcb8bea472c/users/a8bbff83ddbe4d6295c01a6aea214d09/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:12.944302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684977a-629f-4bc5-875a-a0411270553f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:13.033710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ee3e5-75ff-4de9-88b7-b39282f9fde0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:13.087202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a545d-cbd5-4068-b09a-d7b2c95a34b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:13.088220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a545d-cbd5-4068-b09a-d7b2c95a34b1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:13.088220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a545d-cbd5-4068-b09a-d7b2c95a34b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:13.088501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a545d-cbd5-4068-b09a-d7b2c95a34b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:13.089561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a545d-cbd5-4068-b09a-d7b2c95a34b1 None admin] RBAC: Adding query filter params (role.id=084b5d87c17e4247b4ce7fae2c691632, scope.project.id=df0f459e95f141488f03abcb8bea472c, user.id=3ecd6c2ccd5c41afac20982b8f0b4df4) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:13.089672 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a545d-cbd5-4068-b09a-d7b2c95a34b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:13.091089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a545d-cbd5-4068-b09a-d7b2c95a34b1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:13.097560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 63/125] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:12 2022] GET /identity/v3/role_assignments?user.id=3ecd6c2ccd5c41afac20982b8f0b4df4&scope.project.id=df0f459e95f141488f03abcb8bea472c&role.id=084b5d87c17e4247b4ce7fae2c691632 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:13.098423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a545d-cbd5-4068-b09a-d7b2c95a34b1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:13.123326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684977a-629f-4bc5-875a-a0411270553f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:13.174566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3ce3f-37a9-4165-bfe0-ea6a5899112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:13.175139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3ce3f-37a9-4165-bfe0-ea6a5899112f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:13.175421 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3ce3f-37a9-4165-bfe0-ea6a5899112f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:13.175697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3ce3f-37a9-4165-bfe0-ea6a5899112f None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:13.176389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3ce3f-37a9-4165-bfe0-ea6a5899112f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:13.177343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3ce3f-37a9-4165-bfe0-ea6a5899112f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:13.178041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3ce3f-37a9-4165-bfe0-ea6a5899112f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:13.193818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 63/126] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:13.195070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3ce3f-37a9-4165-bfe0-ea6a5899112f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:13.201950 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:13.231534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:13.235251 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a545d-cbd5-4068-b09a-d7b2c95a34b1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:13.278668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655fe18-48ae-4945-8db2-74b167f1e6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:13.279734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655fe18-48ae-4945-8db2-74b167f1e6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:13.280281 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655fe18-48ae-4945-8db2-74b167f1e6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:13.280759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655fe18-48ae-4945-8db2-74b167f1e6e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:13.292753 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655fe18-48ae-4945-8db2-74b167f1e6e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-9655fe18-48ae-4945-8db2-74b167f1e6e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:13.298219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:13.299149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:13.299925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:13.299925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:13.299925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:13.299925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:13.299925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:13.299925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:13.299925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:13.299925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:13.299925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:13.299925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:13.299925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:13.299925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:13.307975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 64/127] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:13.309222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655fe18-48ae-4945-8db2-74b167f1e6e9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:13.328559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3ce3f-37a9-4165-bfe0-ea6a5899112f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:13.384327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf8bc9-7582-4c08-9d5e-f26225ca5b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:13.385020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf8bc9-7582-4c08-9d5e-f26225ca5b7d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:13.385300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf8bc9-7582-4c08-9d5e-f26225ca5b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:13.385573 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf8bc9-7582-4c08-9d5e-f26225ca5b7d None admin] PATH_INFO: `/v3/users/a8bbff83ddbe4d6295c01a6aea214d09` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:13.392918 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf8bc9-7582-4c08-9d5e-f26225ca5b7d None admin] RBAC: Authorizing `identity:get_user(user_id=a8bbff83ddbe4d6295c01a6aea214d09)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:13.394672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf8bc9-7582-4c08-9d5e-f26225ca5b7d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:13.398526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 64/128] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:13 2022] GET /identity/v3/users/a8bbff83ddbe4d6295c01a6aea214d09 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:13.399006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf8bc9-7582-4c08-9d5e-f26225ca5b7d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:13.475977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655fe18-48ae-4945-8db2-74b167f1e6e9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:13.516323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:13.548422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb327adc-527b-4d93-bb8e-ca68bce39839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:13.549111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb327adc-527b-4d93-bb8e-ca68bce39839 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:13.549427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb327adc-527b-4d93-bb8e-ca68bce39839 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:13.549699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb327adc-527b-4d93-bb8e-ca68bce39839 None admin] PATH_INFO: `/v3/users/a9b9514cc6bc4f96b9c765b74b45116f` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:13.551497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb327adc-527b-4d93-bb8e-ca68bce39839 None admin] RBAC: Authorizing `identity:get_user(user_id=a9b9514cc6bc4f96b9c765b74b45116f)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:13.552975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb327adc-527b-4d93-bb8e-ca68bce39839 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:13.554658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 65/129] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:13 2022] GET /identity/v3/users/a9b9514cc6bc4f96b9c765b74b45116f => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:13.555430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb327adc-527b-4d93-bb8e-ca68bce39839 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:13.561204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf8bc9-7582-4c08-9d5e-f26225ca5b7d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:13.616822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793e228-597d-4703-b3e2-3c741ce0246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:13.617013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:13.617884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e228-597d-4703-b3e2-3c741ce0246f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:13.618364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e228-597d-4703-b3e2-3c741ce0246f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:13.618836 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e228-597d-4703-b3e2-3c741ce0246f None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:13.619752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793e228-597d-4703-b3e2-3c741ce0246f None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:13.620161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793e228-597d-4703-b3e2-3c741ce0246f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:13.622246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793e228-597d-4703-b3e2-3c741ce0246f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:13.636434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 65/130] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:13.640833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793e228-597d-4703-b3e2-3c741ce0246f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:13.742490 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb327adc-527b-4d93-bb8e-ca68bce39839 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:13.797713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b858ef5-4a0b-44bc-8b6a-73c2a487fbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:13.798358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858ef5-4a0b-44bc-8b6a-73c2a487fbea None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:13.798638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858ef5-4a0b-44bc-8b6a-73c2a487fbea None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:13.798909 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858ef5-4a0b-44bc-8b6a-73c2a487fbea None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:13.800218 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b858ef5-4a0b-44bc-8b6a-73c2a487fbea None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:13.801765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b858ef5-4a0b-44bc-8b6a-73c2a487fbea None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:13.804157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 66/131] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:13 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:13.809830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b858ef5-4a0b-44bc-8b6a-73c2a487fbea None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:13.812465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793e228-597d-4703-b3e2-3c741ce0246f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:13.854029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74669f65-1507-446f-9a8d-52eb4601c19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:13.854672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669f65-1507-446f-9a8d-52eb4601c19f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:13.854952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669f65-1507-446f-9a8d-52eb4601c19f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:13.855225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669f65-1507-446f-9a8d-52eb4601c19f None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:13.856384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74669f65-1507-446f-9a8d-52eb4601c19f None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:13.858049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74669f65-1507-446f-9a8d-52eb4601c19f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:13.864475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 66/132] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:13 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:13.864475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad490d-1493-4151-bf70-2f819b3335a1 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:13.864475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad490d-1493-4151-bf70-2f819b3335a1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:13.864475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad490d-1493-4151-bf70-2f819b3335a1 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:13.864475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 67/133] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:13.864475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad490d-1493-4151-bf70-2f819b3335a1 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:13.866036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:13.939579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:13.946123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b858ef5-4a0b-44bc-8b6a-73c2a487fbea None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:13.984966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d778a5-ced8-46b6-9c2e-08f16c0f33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:13.985989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d778a5-ced8-46b6-9c2e-08f16c0f33ac None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:13.986468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d778a5-ced8-46b6-9c2e-08f16c0f33ac None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:13.986933 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d778a5-ced8-46b6-9c2e-08f16c0f33ac None admin] PATH_INFO: `/v3/users/a8bbff83ddbe4d6295c01a6aea214d09` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:13.988402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d778a5-ced8-46b6-9c2e-08f16c0f33ac None admin] RBAC: Authorizing `identity:get_user(user_id=a8bbff83ddbe4d6295c01a6aea214d09)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:13.988537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad490d-1493-4151-bf70-2f819b3335a1 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:13.990474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d778a5-ced8-46b6-9c2e-08f16c0f33ac None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:13.992824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 67/134] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:13 2022] GET /identity/v3/users/a8bbff83ddbe4d6295c01a6aea214d09 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:13.993917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d778a5-ced8-46b6-9c2e-08f16c0f33ac None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:14.028987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6fe2b-6273-4ced-bfa3-0c3ef394bd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:14.029770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6fe2b-6273-4ced-bfa3-0c3ef394bd41 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:14.030053 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6fe2b-6273-4ced-bfa3-0c3ef394bd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:14.030378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6fe2b-6273-4ced-bfa3-0c3ef394bd41 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c/users/a8bbff83ddbe4d6295c01a6aea214d09/roles/f63ab1c53b2e4aa0bf00e4798908cbfb` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:14.032622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6fe2b-6273-4ced-bfa3-0c3ef394bd41 None admin] RBAC: Authorizing `identity:create_grant(project_id=df0f459e95f141488f03abcb8bea472c, user_id=a8bbff83ddbe4d6295c01a6aea214d09, role_id=f63ab1c53b2e4aa0bf00e4798908cbfb)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:14.034467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6fe2b-6273-4ced-bfa3-0c3ef394bd41 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:14.106735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d778a5-ced8-46b6-9c2e-08f16c0f33ac None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:14.145226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02cba8-bf0b-428a-a663-74e8ab04331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:14.145970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02cba8-bf0b-428a-a663-74e8ab04331a None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:14.146257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02cba8-bf0b-428a-a663-74e8ab04331a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:14.146538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02cba8-bf0b-428a-a663-74e8ab04331a None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c/users/a9b9514cc6bc4f96b9c765b74b45116f/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:14.147113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 68/135] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:13:13 2022] PUT /identity/v3/projects/df0f459e95f141488f03abcb8bea472c/users/a8bbff83ddbe4d6295c01a6aea214d09/roles/f63ab1c53b2e4aa0bf00e4798908cbfb => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:14.148794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e8085-dafe-452c-9c9b-c6ac3be67018 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:14.149153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02cba8-bf0b-428a-a663-74e8ab04331a None admin] RBAC: Authorizing `identity:create_grant(project_id=df0f459e95f141488f03abcb8bea472c, user_id=a9b9514cc6bc4f96b9c765b74b45116f, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:14.149491 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e8085-dafe-452c-9c9b-c6ac3be67018 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:14.149963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e8085-dafe-452c-9c9b-c6ac3be67018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:14.150706 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02cba8-bf0b-428a-a663-74e8ab04331a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:14.175094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0d7e8085-dafe-452c-9c9b-c6ac3be67018 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:14.176817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0d7e8085-dafe-452c-9c9b-c6ac3be67018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:14.249501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:14.258715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 68/136] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:13:13 2022] PUT /identity/v3/projects/df0f459e95f141488f03abcb8bea472c/users/a9b9514cc6bc4f96b9c765b74b45116f/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:14.259589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02cba8-bf0b-428a-a663-74e8ab04331a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:14.270640 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 69/137] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:14.297909 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:14.404319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02cba8-bf0b-428a-a663-74e8ab04331a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:14.445334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f0a1-d200-480a-b5c1-13f2a5351461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:14.445990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f0a1-d200-480a-b5c1-13f2a5351461 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:14.446267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f0a1-d200-480a-b5c1-13f2a5351461 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:14.446543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f0a1-d200-480a-b5c1-13f2a5351461 None admin] PATH_INFO: `/v3/projects/c4109c58d1304ca4953b1c2c0c11d7ac` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:14.447759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f0a1-d200-480a-b5c1-13f2a5351461 None admin] RBAC: Authorizing `identity:get_project(project_id=c4109c58d1304ca4953b1c2c0c11d7ac)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:14.449249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f0a1-d200-480a-b5c1-13f2a5351461 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:14.451141 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 69/138] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:14 2022] GET /identity/v3/projects/c4109c58d1304ca4953b1c2c0c11d7ac => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:14.456808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e8085-dafe-452c-9c9b-c6ac3be67018 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:14.574402 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e8085-dafe-452c-9c9b-c6ac3be67018 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:14.611245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c538c65-8f8f-4f16-b3dc-a85ea801bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:14.611973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c538c65-8f8f-4f16-b3dc-a85ea801bf2a None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:14.612267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c538c65-8f8f-4f16-b3dc-a85ea801bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:14.612548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c538c65-8f8f-4f16-b3dc-a85ea801bf2a None admin] PATH_INFO: `/v3/projects/c4109c58d1304ca4953b1c2c0c11d7ac/users/a8bbff83ddbe4d6295c01a6aea214d09/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:14.614472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c538c65-8f8f-4f16-b3dc-a85ea801bf2a None admin] RBAC: Authorizing `identity:create_grant(project_id=c4109c58d1304ca4953b1c2c0c11d7ac, user_id=a8bbff83ddbe4d6295c01a6aea214d09, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:14.615992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c538c65-8f8f-4f16-b3dc-a85ea801bf2a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:14.694540 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 70/139] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:13:14 2022] PUT /identity/v3/projects/c4109c58d1304ca4953b1c2c0c11d7ac/users/a8bbff83ddbe4d6295c01a6aea214d09/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:14.749320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f0a1-d200-480a-b5c1-13f2a5351461 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:14.856068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:14.865478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f0a1-d200-480a-b5c1-13f2a5351461 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:14.912287 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7bd5-5c77-4c83-8214-15a3afea89c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:14.912959 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7bd5-5c77-4c83-8214-15a3afea89c0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:14.913239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7bd5-5c77-4c83-8214-15a3afea89c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:14.913569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7bd5-5c77-4c83-8214-15a3afea89c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:14.914816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e7bd5-5c77-4c83-8214-15a3afea89c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:14.916407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e7bd5-5c77-4c83-8214-15a3afea89c0 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:14.918348 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 70/140] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:13:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:14.924080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c538c65-8f8f-4f16-b3dc-a85ea801bf2a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:15.006325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:15.064101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c538c65-8f8f-4f16-b3dc-a85ea801bf2a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:15.107116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063945b-c13b-48ea-a7b7-1ea552eb588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:15.107972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063945b-c13b-48ea-a7b7-1ea552eb588c None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:15.108414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063945b-c13b-48ea-a7b7-1ea552eb588c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:15.108825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063945b-c13b-48ea-a7b7-1ea552eb588c None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:15.109633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063945b-c13b-48ea-a7b7-1ea552eb588c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:15.111257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063945b-c13b-48ea-a7b7-1ea552eb588c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:15.235419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 71/141] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:13:14 2022] POST /identity/v3/users => generated 283 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:13:15.748215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4001dd-6d06-40fd-8140-1f2a1952b90f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:15.748497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4001dd-6d06-40fd-8140-1f2a1952b90f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:15.748769 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4001dd-6d06-40fd-8140-1f2a1952b90f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:15.750289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 71/142] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:15.756043 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0034f34-96a0-46bb-a62e-a91bb534a305 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:15.756577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0034f34-96a0-46bb-a62e-a91bb534a305 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:15.756577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0034f34-96a0-46bb-a62e-a91bb534a305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:15.777124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e0034f34-96a0-46bb-a62e-a91bb534a305 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:15.778323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e0034f34-96a0-46bb-a62e-a91bb534a305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:15.857315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d18320-6fe6-4431-af72-3ff7d458a7a1 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:15.857594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d18320-6fe6-4431-af72-3ff7d458a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:15.857874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d18320-6fe6-4431-af72-3ff7d458a7a1 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:15.859202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 72/143] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:13:15.864341 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c0c8-9329-4032-826d-db303dc0c5d8 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:15.864742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c0c8-9329-4032-826d-db303dc0c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:15.865117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c0c8-9329-4032-826d-db303dc0c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:15.868492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 72/144] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:15.884669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d6f2c0c8-9329-4032-826d-db303dc0c5d8 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:15.885990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d6f2c0c8-9329-4032-826d-db303dc0c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:15.966783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 73/145] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:16.262017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0034f34-96a0-46bb-a62e-a91bb534a305 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:16.307482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:16.378587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0034f34-96a0-46bb-a62e-a91bb534a305 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:16.418310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45529f9-6e97-4752-9ecd-e6785834b982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:16.418952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45529f9-6e97-4752-9ecd-e6785834b982 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:16.419233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45529f9-6e97-4752-9ecd-e6785834b982 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:16.419510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45529f9-6e97-4752-9ecd-e6785834b982 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:16.430498 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45529f9-6e97-4752-9ecd-e6785834b982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f45529f9-6e97-4752-9ecd-e6785834b982 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:16.435436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:16.436308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:16.437057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 73/146] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:16.442394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c0c8-9329-4032-826d-db303dc0c5d8 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:16.484992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45529f9-6e97-4752-9ecd-e6785834b982 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:16.586144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c0c8-9329-4032-826d-db303dc0c5d8 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:16.656698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:16.660990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45529f9-6e97-4752-9ecd-e6785834b982 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:16.670945 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47291493-44dd-4c88-a828-f909be5d218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:16.671571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47291493-44dd-4c88-a828-f909be5d218d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:16.671849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47291493-44dd-4c88-a828-f909be5d218d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:16.672140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47291493-44dd-4c88-a828-f909be5d218d None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:16.672816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47291493-44dd-4c88-a828-f909be5d218d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:16.673123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47291493-44dd-4c88-a828-f909be5d218d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:16.674501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47291493-44dd-4c88-a828-f909be5d218d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:16.687516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 74/147] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:16.697831 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47291493-44dd-4c88-a828-f909be5d218d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:16.736070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f83893-5f50-4cf1-8306-1fd3c29ba81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:16.736713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f83893-5f50-4cf1-8306-1fd3c29ba81f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:16.736989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f83893-5f50-4cf1-8306-1fd3c29ba81f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:16.737257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f83893-5f50-4cf1-8306-1fd3c29ba81f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:16.754914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f83893-5f50-4cf1-8306-1fd3c29ba81f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-54f83893-5f50-4cf1-8306-1fd3c29ba81f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:16.761214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:16.762492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:16.763359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 74/148] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:16.771401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f83893-5f50-4cf1-8306-1fd3c29ba81f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:16.916669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47291493-44dd-4c88-a828-f909be5d218d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:16.943183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f83893-5f50-4cf1-8306-1fd3c29ba81f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:16.985676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc664cc-d541-472d-abcf-06ef8b64dee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:16.986327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc664cc-d541-472d-abcf-06ef8b64dee9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:16.986597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc664cc-d541-472d-abcf-06ef8b64dee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:16.986866 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc664cc-d541-472d-abcf-06ef8b64dee9 None admin] PATH_INFO: `/v3/users/3ecd6c2ccd5c41afac20982b8f0b4df4` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:16.988356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc664cc-d541-472d-abcf-06ef8b64dee9 None admin] RBAC: Authorizing `identity:get_user(user_id=3ecd6c2ccd5c41afac20982b8f0b4df4)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:16.989803 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc664cc-d541-472d-abcf-06ef8b64dee9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:16.994330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3b5be-b6a3-4b28-ad13-09b1241be4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:16.994936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3b5be-b6a3-4b28-ad13-09b1241be4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:16.995206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3b5be-b6a3-4b28-ad13-09b1241be4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:16.995522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3b5be-b6a3-4b28-ad13-09b1241be4d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:16.996219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3b5be-b6a3-4b28-ad13-09b1241be4d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:16.996516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3b5be-b6a3-4b28-ad13-09b1241be4d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:16.997866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3b5be-b6a3-4b28-ad13-09b1241be4d0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:16.999358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 75/149] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:16 2022] GET /identity/v3/users/3ecd6c2ccd5c41afac20982b8f0b4df4 => generated 289 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:17.004937 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc664cc-d541-472d-abcf-06ef8b64dee9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:17.016784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 75/150] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:17.017671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3b5be-b6a3-4b28-ad13-09b1241be4d0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:17.048887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:17.069944 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:17.172335 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3b5be-b6a3-4b28-ad13-09b1241be4d0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:17.207973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc664cc-d541-472d-abcf-06ef8b64dee9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:17.216504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a14f02-bff1-4730-8552-c6faee50770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:17.217235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a14f02-bff1-4730-8552-c6faee50770e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:17.217516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a14f02-bff1-4730-8552-c6faee50770e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:17.217788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a14f02-bff1-4730-8552-c6faee50770e None admin] PATH_INFO: `/v3/users/a8bbff83ddbe4d6295c01a6aea214d09` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:17.219305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a14f02-bff1-4730-8552-c6faee50770e None admin] RBAC: Authorizing `identity:get_user(user_id=a8bbff83ddbe4d6295c01a6aea214d09)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:17.220762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a14f02-bff1-4730-8552-c6faee50770e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:17.222343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 76/151] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:17 2022] GET /identity/v3/users/a8bbff83ddbe4d6295c01a6aea214d09 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:17.229684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a14f02-bff1-4730-8552-c6faee50770e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:17.270074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd62309-4bf6-40fb-b06a-34de306b1dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:17.270727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62309-4bf6-40fb-b06a-34de306b1dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:17.271004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62309-4bf6-40fb-b06a-34de306b1dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:17.271274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62309-4bf6-40fb-b06a-34de306b1dd6 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:17.276666 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd62309-4bf6-40fb-b06a-34de306b1dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:17.278125 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd62309-4bf6-40fb-b06a-34de306b1dd6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:17.280164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 76/152] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:17 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:17.285789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd62309-4bf6-40fb-b06a-34de306b1dd6 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:17.360292 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:17.379112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a14f02-bff1-4730-8552-c6faee50770e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:17.460912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219b5f0-3b3b-4765-883c-50411eb57ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:17.462127 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219b5f0-3b3b-4765-883c-50411eb57ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:17.462605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219b5f0-3b3b-4765-883c-50411eb57ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:17.463630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219b5f0-3b3b-4765-883c-50411eb57ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:17.483998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:17.518588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd62309-4bf6-40fb-b06a-34de306b1dd6 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:17.601586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36d79e-d7c3-4f84-8b42-a155c71f0264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:17.602270 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36d79e-d7c3-4f84-8b42-a155c71f0264 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:17.602597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36d79e-d7c3-4f84-8b42-a155c71f0264 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:17.602827 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36d79e-d7c3-4f84-8b42-a155c71f0264 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c/users/3ecd6c2ccd5c41afac20982b8f0b4df4/roles/084b5d87c17e4247b4ce7fae2c691632` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:17.604910 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36d79e-d7c3-4f84-8b42-a155c71f0264 None admin] RBAC: Authorizing `identity:create_grant(project_id=df0f459e95f141488f03abcb8bea472c, user_id=3ecd6c2ccd5c41afac20982b8f0b4df4, role_id=084b5d87c17e4247b4ce7fae2c691632)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:17.605690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219b5f0-3b3b-4765-883c-50411eb57ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:17.606379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36d79e-d7c3-4f84-8b42-a155c71f0264 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:17.607135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219b5f0-3b3b-4765-883c-50411eb57ed6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:17.727005 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 77/153] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:13:17 2022] PUT /identity/v3/projects/df0f459e95f141488f03abcb8bea472c/users/3ecd6c2ccd5c41afac20982b8f0b4df4/roles/084b5d87c17e4247b4ce7fae2c691632 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:17.728210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116a7d-dfd4-4dfb-92d4-7ff996370d0a None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:17.728530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116a7d-dfd4-4dfb-92d4-7ff996370d0a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:17.728808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116a7d-dfd4-4dfb-92d4-7ff996370d0a None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:17.730056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 78/154] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:17.735525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f58652-060f-4f5a-9a1c-354a7d5cabc3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:17.735810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f58652-060f-4f5a-9a1c-354a7d5cabc3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:17.736117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f58652-060f-4f5a-9a1c-354a7d5cabc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:17.736530 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:17.748290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 77/155] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 10:13:17.757326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219b5f0-3b3b-4765-883c-50411eb57ed6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:17.768975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d9f58652-060f-4f5a-9a1c-354a7d5cabc3 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:17.771063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d9f58652-060f-4f5a-9a1c-354a7d5cabc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:17.906845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 79/156] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:17.936328 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219b5f0-3b3b-4765-883c-50411eb57ed6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:17.971898 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d64e7a-0cd6-4ef8-8498-6f7d0e16ea55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:17.972623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d64e7a-0cd6-4ef8-8498-6f7d0e16ea55 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:17.972914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d64e7a-0cd6-4ef8-8498-6f7d0e16ea55 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:17.973186 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d64e7a-0cd6-4ef8-8498-6f7d0e16ea55 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:17.974355 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d64e7a-0cd6-4ef8-8498-6f7d0e16ea55 None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:17.975869 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d64e7a-0cd6-4ef8-8498-6f7d0e16ea55 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:17.979825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 78/157] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:17 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:17.985821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f58652-060f-4f5a-9a1c-354a7d5cabc3 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:18.106323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:18.132773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f58652-060f-4f5a-9a1c-354a7d5cabc3 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:18.169041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b260be-94ed-4ecb-9c18-614eff8c4a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:18.169658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b260be-94ed-4ecb-9c18-614eff8c4a51 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:18.169933 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b260be-94ed-4ecb-9c18-614eff8c4a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:18.170210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b260be-94ed-4ecb-9c18-614eff8c4a51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:18.170942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b260be-94ed-4ecb-9c18-614eff8c4a51 None admin] RBAC: Adding query filter params (role.id=c071e1d121a643a48556e6287cde21c0, scope.project.id=df0f459e95f141488f03abcb8bea472c, user.id=a8bbff83ddbe4d6295c01a6aea214d09) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:18.171247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b260be-94ed-4ecb-9c18-614eff8c4a51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:18.172719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b260be-94ed-4ecb-9c18-614eff8c4a51 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:18.178780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 80/158] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:17 2022] GET /identity/v3/role_assignments?user.id=a8bbff83ddbe4d6295c01a6aea214d09&scope.project.id=df0f459e95f141488f03abcb8bea472c&role.id=c071e1d121a643a48556e6287cde21c0 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:18.317873 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa10a-4b45-4ea7-ae02-50151cab6c8a None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:18.318073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa10a-4b45-4ea7-ae02-50151cab6c8a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:18.318596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa10a-4b45-4ea7-ae02-50151cab6c8a None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:18.320482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 79/159] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:18.326117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b99cf1-6ab8-4a58-93bb-32b516363a17 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:18.326701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b99cf1-6ab8-4a58-93bb-32b516363a17 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:18.327168 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b99cf1-6ab8-4a58-93bb-32b516363a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:18.353141 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f8b99cf1-6ab8-4a58-93bb-32b516363a17 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:18.355326 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f8b99cf1-6ab8-4a58-93bb-32b516363a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:18.444941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 81/160] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:18.567862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa10a-4b45-4ea7-ae02-50151cab6c8a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:18.645561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:18.658243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4668ff-e1c9-4d24-9c84-a9c30d5b4e58 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:18.660202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4668ff-e1c9-4d24-9c84-a9c30d5b4e58 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:18.660202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4668ff-e1c9-4d24-9c84-a9c30d5b4e58 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:18.660912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 82/161] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:13:18.666318 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c1966-cb65-48e9-b083-8ea938f51f18 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:18.666943 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c1966-cb65-48e9-b083-8ea938f51f18 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:18.667372 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c1966-cb65-48e9-b083-8ea938f51f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:18.703616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-388c1966-cb65-48e9-b083-8ea938f51f18 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:18.705214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-388c1966-cb65-48e9-b083-8ea938f51f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:18.740679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa10a-4b45-4ea7-ae02-50151cab6c8a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:18.794090 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 83/162] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:18.832776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546e42d-158b-4e0c-aaea-1bb812742f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:18.833441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546e42d-158b-4e0c-aaea-1bb812742f34 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:18.833717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546e42d-158b-4e0c-aaea-1bb812742f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:18.833987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546e42d-158b-4e0c-aaea-1bb812742f34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:18.852651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546e42d-158b-4e0c-aaea-1bb812742f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7546e42d-158b-4e0c-aaea-1bb812742f34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:18.858156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:18.859091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:18.860537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 80/163] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:13:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:18.865181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c1966-cb65-48e9-b083-8ea938f51f18 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:18.869264 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:19.000619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c1966-cb65-48e9-b083-8ea938f51f18 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:19.007580 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546e42d-158b-4e0c-aaea-1bb812742f34 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:19.053662 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825320d0-f91f-4958-9bf7-f607adc9e117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:19.054279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825320d0-f91f-4958-9bf7-f607adc9e117 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:19.054999 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825320d0-f91f-4958-9bf7-f607adc9e117 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:19.054999 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825320d0-f91f-4958-9bf7-f607adc9e117 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:19.055642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825320d0-f91f-4958-9bf7-f607adc9e117 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:19.058328 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825320d0-f91f-4958-9bf7-f607adc9e117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:19.058328 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825320d0-f91f-4958-9bf7-f607adc9e117 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:19.071121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 84/164] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:13:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:19.077317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825320d0-f91f-4958-9bf7-f607adc9e117 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:19.131334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546e42d-158b-4e0c-aaea-1bb812742f34 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:19.150506 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:19.174816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb13fed-d2c0-46a6-8ab0-dcece2e79fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:19.174816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb13fed-d2c0-46a6-8ab0-dcece2e79fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:19.174816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb13fed-d2c0-46a6-8ab0-dcece2e79fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:19.174816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb13fed-d2c0-46a6-8ab0-dcece2e79fc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:19.183141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb13fed-d2c0-46a6-8ab0-dcece2e79fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:19.186705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-feb13fed-d2c0-46a6-8ab0-dcece2e79fc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:19.188732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:19.189945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:19.190740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 81/165] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:13:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:19.196381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb13fed-d2c0-46a6-8ab0-dcece2e79fc7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:19.261866 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825320d0-f91f-4958-9bf7-f607adc9e117 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:19.302675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb13fed-d2c0-46a6-8ab0-dcece2e79fc7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:19.349189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d6f60-4688-4e41-b1df-2056de287a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:19.350037 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d6f60-4688-4e41-b1df-2056de287a0b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:19.350312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d6f60-4688-4e41-b1df-2056de287a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:19.350587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d6f60-4688-4e41-b1df-2056de287a0b None admin] PATH_INFO: `/v3/users/a8bbff83ddbe4d6295c01a6aea214d09` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:19.351253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b3c30-6688-4583-a7bf-b30adafea683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:19.351735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d6f60-4688-4e41-b1df-2056de287a0b None admin] RBAC: Authorizing `identity:get_user(user_id=a8bbff83ddbe4d6295c01a6aea214d09)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:19.352232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b3c30-6688-4583-a7bf-b30adafea683 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:19.352665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b3c30-6688-4583-a7bf-b30adafea683 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:19.353087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b3c30-6688-4583-a7bf-b30adafea683 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:19.353203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d6f60-4688-4e41-b1df-2056de287a0b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:19.354035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b3c30-6688-4583-a7bf-b30adafea683 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:19.354489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b3c30-6688-4583-a7bf-b30adafea683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:19.356093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b3c30-6688-4583-a7bf-b30adafea683 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:19.360382 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 85/166] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:19 2022] GET /identity/v3/users/a8bbff83ddbe4d6295c01a6aea214d09 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:19.361252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d6f60-4688-4e41-b1df-2056de287a0b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:19.368628 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 82/167] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:19.371828 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b3c30-6688-4583-a7bf-b30adafea683 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:19.436531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:19.481133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b3c30-6688-4583-a7bf-b30adafea683 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:19.538908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8921b3-5c2e-4fc4-88b2-4d212b4ecfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:19.539547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8921b3-5c2e-4fc4-88b2-4d212b4ecfed None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:19.539826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8921b3-5c2e-4fc4-88b2-4d212b4ecfed None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:19.540122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8921b3-5c2e-4fc4-88b2-4d212b4ecfed None admin] PATH_INFO: `/v3/users/a9b9514cc6bc4f96b9c765b74b45116f` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:19.541358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8921b3-5c2e-4fc4-88b2-4d212b4ecfed None admin] RBAC: Authorizing `identity:get_user(user_id=a9b9514cc6bc4f96b9c765b74b45116f)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:19.542782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8921b3-5c2e-4fc4-88b2-4d212b4ecfed None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:19.545963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 83/168] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:19 2022] GET /identity/v3/users/a9b9514cc6bc4f96b9c765b74b45116f => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:19.548227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8921b3-5c2e-4fc4-88b2-4d212b4ecfed None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:19.564709 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d6f60-4688-4e41-b1df-2056de287a0b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:19.608319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:19.620451 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2916b8-563e-4fd3-909c-3a870edb6cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:19.621102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2916b8-563e-4fd3-909c-3a870edb6cbf None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:19.621424 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2916b8-563e-4fd3-909c-3a870edb6cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:19.621706 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2916b8-563e-4fd3-909c-3a870edb6cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:19.746433 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2916b8-563e-4fd3-909c-3a870edb6cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:19.748352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2916b8-563e-4fd3-909c-3a870edb6cbf None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:19.767357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8921b3-5c2e-4fc4-88b2-4d212b4ecfed None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:19.780329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:19.830381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747e57a-2515-4c0c-9680-169c92e8cac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:19.831018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747e57a-2515-4c0c-9680-169c92e8cac6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:19.831291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747e57a-2515-4c0c-9680-169c92e8cac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:19.831558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747e57a-2515-4c0c-9680-169c92e8cac6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:19.856715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747e57a-2515-4c0c-9680-169c92e8cac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e747e57a-2515-4c0c-9680-169c92e8cac6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:19.862303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:19.863184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 84/169] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:19.864407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747e57a-2515-4c0c-9680-169c92e8cac6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:19.972622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 86/170] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:19.973480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2916b8-563e-4fd3-909c-3a870edb6cbf None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:20.031982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:20.069547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747e57a-2515-4c0c-9680-169c92e8cac6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:20.137152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dccfa-2fee-4c53-ab63-35b03f153be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:20.137759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dccfa-2fee-4c53-ab63-35b03f153be8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:20.138034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dccfa-2fee-4c53-ab63-35b03f153be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:20.139300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dccfa-2fee-4c53-ab63-35b03f153be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:20.161081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2916b8-563e-4fd3-909c-3a870edb6cbf None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:20.205823 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:20.238049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9e65c-ffc6-472d-af53-a93df4abdbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:20.238675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9e65c-ffc6-472d-af53-a93df4abdbd2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:20.238953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9e65c-ffc6-472d-af53-a93df4abdbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:20.239224 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9e65c-ffc6-472d-af53-a93df4abdbd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:20.239896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9e65c-ffc6-472d-af53-a93df4abdbd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:20.240230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9e65c-ffc6-472d-af53-a93df4abdbd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:20.241673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9e65c-ffc6-472d-af53-a93df4abdbd2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:20.244742 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dccfa-2fee-4c53-ab63-35b03f153be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:20.246360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dccfa-2fee-4c53-ab63-35b03f153be8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:20.259134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 87/171] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:20.260477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a5e15-9b7a-4600-a58b-0fb0341b3278 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:20.260821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a5e15-9b7a-4600-a58b-0fb0341b3278 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:20.261092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a5e15-9b7a-4600-a58b-0fb0341b3278 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:20.262316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 88/172] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:20.263015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a5e15-9b7a-4600-a58b-0fb0341b3278 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:20.356417 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 85/173] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:20.357710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dccfa-2fee-4c53-ab63-35b03f153be8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:20.423780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:20.442140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:20.460290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dccfa-2fee-4c53-ab63-35b03f153be8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:20.460566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a5e15-9b7a-4600-a58b-0fb0341b3278 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:20.499305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270bcba-7a50-4175-9fa7-a03d2383d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:20.500520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270bcba-7a50-4175-9fa7-a03d2383d943 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:20.501018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270bcba-7a50-4175-9fa7-a03d2383d943 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:20.501638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270bcba-7a50-4175-9fa7-a03d2383d943 None admin] PATH_INFO: `/v3/users/a8bbff83ddbe4d6295c01a6aea214d09` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:20.502995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270bcba-7a50-4175-9fa7-a03d2383d943 None admin] RBAC: Authorizing `identity:get_user(user_id=a8bbff83ddbe4d6295c01a6aea214d09)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:20.504668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270bcba-7a50-4175-9fa7-a03d2383d943 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:20.506452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 86/174] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:20 2022] GET /identity/v3/users/a8bbff83ddbe4d6295c01a6aea214d09 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:20.507922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668eb9-0ddf-44e4-8871-96dc8e72d1a2 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:20.508492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668eb9-0ddf-44e4-8871-96dc8e72d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:20.508976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668eb9-0ddf-44e4-8871-96dc8e72d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:20.528184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4e668eb9-0ddf-44e4-8871-96dc8e72d1a2 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:20.529719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4e668eb9-0ddf-44e4-8871-96dc8e72d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:20.538312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e960-397b-4f26-a041-e7d983d826e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:20.538960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e960-397b-4f26-a041-e7d983d826e6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:20.539234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e960-397b-4f26-a041-e7d983d826e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:20.539498 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e960-397b-4f26-a041-e7d983d826e6 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:20.540727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7e960-397b-4f26-a041-e7d983d826e6 None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:20.542830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7e960-397b-4f26-a041-e7d983d826e6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:20.544595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 89/175] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:20 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:20.548868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e960-397b-4f26-a041-e7d983d826e6 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:20.614464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 87/176] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:20.615258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e668eb9-0ddf-44e4-8871-96dc8e72d1a2 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:20.726860 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e960-397b-4f26-a041-e7d983d826e6 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:20.753683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:20.797974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692790a-21b5-409c-b6b5-52a0a3347c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:20.798615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692790a-21b5-409c-b6b5-52a0a3347c37 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:20.798891 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692790a-21b5-409c-b6b5-52a0a3347c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:20.799162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692790a-21b5-409c-b6b5-52a0a3347c37 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:20.803068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692790a-21b5-409c-b6b5-52a0a3347c37 None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:20.804559 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692790a-21b5-409c-b6b5-52a0a3347c37 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:20.820166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 90/177] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:20 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:20.821112 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692790a-21b5-409c-b6b5-52a0a3347c37 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:20.832555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e668eb9-0ddf-44e4-8871-96dc8e72d1a2 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:20.867973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:20.876781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf72cda-2fa9-46c3-8759-c8065a824855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:20.886545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72cda-2fa9-46c3-8759-c8065a824855 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:20.886545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72cda-2fa9-46c3-8759-c8065a824855 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:20.886545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72cda-2fa9-46c3-8759-c8065a824855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:20.945091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692790a-21b5-409c-b6b5-52a0a3347c37 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:20.971101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf72cda-2fa9-46c3-8759-c8065a824855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:20.972582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf72cda-2fa9-46c3-8759-c8065a824855 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:20.989872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba19ce-c1ee-4c5f-b94d-e8061729900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:20.990934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba19ce-c1ee-4c5f-b94d-e8061729900b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:20.991675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba19ce-c1ee-4c5f-b94d-e8061729900b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:20.992193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba19ce-c1ee-4c5f-b94d-e8061729900b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:20.993113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba19ce-c1ee-4c5f-b94d-e8061729900b None admin] RBAC: Adding query filter params (role.id=f63ab1c53b2e4aa0bf00e4798908cbfb, scope.project.id=df0f459e95f141488f03abcb8bea472c, user.id=a8bbff83ddbe4d6295c01a6aea214d09) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:20.993595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba19ce-c1ee-4c5f-b94d-e8061729900b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:20.995920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba19ce-c1ee-4c5f-b94d-e8061729900b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:21.004058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 91/178] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:20 2022] GET /identity/v3/role_assignments?user.id=a8bbff83ddbe4d6295c01a6aea214d09&scope.project.id=df0f459e95f141488f03abcb8bea472c&role.id=f63ab1c53b2e4aa0bf00e4798908cbfb => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:21.005680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975db7d-4bb3-4f9a-a8cb-19ed9963e3b3 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.006889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975db7d-4bb3-4f9a-a8cb-19ed9963e3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.007370 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975db7d-4bb3-4f9a-a8cb-19ed9963e3b3 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.008845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 92/179] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:21.010413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975db7d-4bb3-4f9a-a8cb-19ed9963e3b3 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:21.048614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:21.103330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 88/180] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:21.105715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61262b6b-b2d5-46fd-b2e3-153ba0c1789f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.106193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61262b6b-b2d5-46fd-b2e3-153ba0c1789f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.106681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61262b6b-b2d5-46fd-b2e3-153ba0c1789f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.108613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 89/181] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:21.109645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61262b6b-b2d5-46fd-b2e3-153ba0c1789f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:21.135392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:21.145720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975db7d-4bb3-4f9a-a8cb-19ed9963e3b3 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:21.188300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e197acb-1bbe-4d09-8ee0-77772c5d8224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:21.189181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e197acb-1bbe-4d09-8ee0-77772c5d8224 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.189638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e197acb-1bbe-4d09-8ee0-77772c5d8224 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.190069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e197acb-1bbe-4d09-8ee0-77772c5d8224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.190967 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e197acb-1bbe-4d09-8ee0-77772c5d8224 None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=df0f459e95f141488f03abcb8bea472c, user.id=a9b9514cc6bc4f96b9c765b74b45116f) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:21.191436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e197acb-1bbe-4d09-8ee0-77772c5d8224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:21.193042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e197acb-1bbe-4d09-8ee0-77772c5d8224 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:21.200411 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 93/182] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:21 2022] GET /identity/v3/role_assignments?user.id=a9b9514cc6bc4f96b9c765b74b45116f&scope.project.id=df0f459e95f141488f03abcb8bea472c&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:21.201804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e6683-c186-4781-8bcc-dd281fbfd94e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.202237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e6683-c186-4781-8bcc-dd281fbfd94e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.202676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e6683-c186-4781-8bcc-dd281fbfd94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.223935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d34e6683-c186-4781-8bcc-dd281fbfd94e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:21.225461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d34e6683-c186-4781-8bcc-dd281fbfd94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:21.231911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61262b6b-b2d5-46fd-b2e3-153ba0c1789f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:21.277988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1deafb-f3c1-44bc-8d78-6fb10102d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:21.278913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1deafb-f3c1-44bc-8d78-6fb10102d6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.279194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1deafb-f3c1-44bc-8d78-6fb10102d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.279468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1deafb-f3c1-44bc-8d78-6fb10102d6e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.293727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1deafb-f3c1-44bc-8d78-6fb10102d6e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ed1deafb-f3c1-44bc-8d78-6fb10102d6e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:21.298728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:21.299674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:21.300541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 90/183] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:21.301214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1deafb-f3c1-44bc-8d78-6fb10102d6e3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:21.318185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 94/184] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:21.320046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b437a7-a933-49d6-af48-c77c9b7c0295 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.320536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b437a7-a933-49d6-af48-c77c9b7c0295 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.321006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b437a7-a933-49d6-af48-c77c9b7c0295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.341646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:21.342370 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-99b437a7-a933-49d6-af48-c77c9b7c0295 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:21.344254 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-99b437a7-a933-49d6-af48-c77c9b7c0295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:21.434069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 95/185] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:21.436184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61658f-cd37-4866-ac42-dd37bef9092d None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.436184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61658f-cd37-4866-ac42-dd37bef9092d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.436479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61658f-cd37-4866-ac42-dd37bef9092d None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.438435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 96/186] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:21.439476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61658f-cd37-4866-ac42-dd37bef9092d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:21.462473 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1deafb-f3c1-44bc-8d78-6fb10102d6e3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:21.464285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:21.512353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894b43-7c66-4f1f-bdfe-8a49997845e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:21.513094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894b43-7c66-4f1f-bdfe-8a49997845e3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.513489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894b43-7c66-4f1f-bdfe-8a49997845e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.513824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894b43-7c66-4f1f-bdfe-8a49997845e3 None admin] PATH_INFO: `/v3/projects/c4109c58d1304ca4953b1c2c0c11d7ac` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.515072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894b43-7c66-4f1f-bdfe-8a49997845e3 None admin] RBAC: Authorizing `identity:get_project(project_id=c4109c58d1304ca4953b1c2c0c11d7ac)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:21.516707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894b43-7c66-4f1f-bdfe-8a49997845e3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:21.518603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 91/187] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:21 2022] GET /identity/v3/projects/c4109c58d1304ca4953b1c2c0c11d7ac => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:21.519887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b198964-43cb-46a1-84d5-88f85de69434 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.520195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b198964-43cb-46a1-84d5-88f85de69434 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.520465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b198964-43cb-46a1-84d5-88f85de69434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.541855 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0b198964-43cb-46a1-84d5-88f85de69434 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:21.543054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0b198964-43cb-46a1-84d5-88f85de69434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:21.586688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61658f-cd37-4866-ac42-dd37bef9092d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:21.636127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da929c-44d0-4c20-bc14-bc7213e3fb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:21.637039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da929c-44d0-4c20-bc14-bc7213e3fb25 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.637362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da929c-44d0-4c20-bc14-bc7213e3fb25 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.637634 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da929c-44d0-4c20-bc14-bc7213e3fb25 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.638409 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da929c-44d0-4c20-bc14-bc7213e3fb25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:21.638713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da929c-44d0-4c20-bc14-bc7213e3fb25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:21.640199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 92/188] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:21.640310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da929c-44d0-4c20-bc14-bc7213e3fb25 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:21.640894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b198964-43cb-46a1-84d5-88f85de69434 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:21.648821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 97/189] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:21.649717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da929c-44d0-4c20-bc14-bc7213e3fb25 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:21.675549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:21.764078 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b198964-43cb-46a1-84d5-88f85de69434 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:21.770932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da929c-44d0-4c20-bc14-bc7213e3fb25 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:21.780291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:21.799638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc24788-e255-40c2-8894-b4f25a2b8320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:21.800334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc24788-e255-40c2-8894-b4f25a2b8320 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.800610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc24788-e255-40c2-8894-b4f25a2b8320 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.800885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc24788-e255-40c2-8894-b4f25a2b8320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.801607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc24788-e255-40c2-8894-b4f25a2b8320 None admin] RBAC: Adding query filter params (role.id=c071e1d121a643a48556e6287cde21c0, scope.project.id=c4109c58d1304ca4953b1c2c0c11d7ac, user.id=a8bbff83ddbe4d6295c01a6aea214d09) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:21.801914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc24788-e255-40c2-8894-b4f25a2b8320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:21.803328 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc24788-e255-40c2-8894-b4f25a2b8320 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:21.805623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84b93f-6944-451c-8e79-c9d8927353d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:21.806255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84b93f-6944-451c-8e79-c9d8927353d6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.806759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84b93f-6944-451c-8e79-c9d8927353d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.807441 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84b93f-6944-451c-8e79-c9d8927353d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.809772 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 93/190] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:21 2022] GET /identity/v3/role_assignments?user.id=a8bbff83ddbe4d6295c01a6aea214d09&scope.project.id=c4109c58d1304ca4953b1c2c0c11d7ac&role.id=c071e1d121a643a48556e6287cde21c0 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:21.810569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc24788-e255-40c2-8894-b4f25a2b8320 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:21.821925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84b93f-6944-451c-8e79-c9d8927353d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-5b84b93f-6944-451c-8e79-c9d8927353d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:21.828292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:21.829259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:21.830060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:21.830060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:21.830060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:21.830060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:21.830060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:21.830060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:21.830060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:21.830060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:21.830060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:21.830060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:21.830060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:21.830060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:21.832146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 98/191] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:13:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:21.833164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84b93f-6944-451c-8e79-c9d8927353d6 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:21.940787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:21.950898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84b93f-6944-451c-8e79-c9d8927353d6 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:21.956653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc24788-e255-40c2-8894-b4f25a2b8320 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:21.992361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2c845-0e21-4e39-9e47-4ef0bff56f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:21.993352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2c845-0e21-4e39-9e47-4ef0bff56f31 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.993697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2c845-0e21-4e39-9e47-4ef0bff56f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.994494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2c845-0e21-4e39-9e47-4ef0bff56f31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.995582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa596a8-9627-4b8f-ac85-e53e9d4d7fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:21.996431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2c845-0e21-4e39-9e47-4ef0bff56f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:21.996532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa596a8-9627-4b8f-ac85-e53e9d4d7fed None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:21.996532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa596a8-9627-4b8f-ac85-e53e9d4d7fed None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:21.996776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa596a8-9627-4b8f-ac85-e53e9d4d7fed None admin] PATH_INFO: `/v3/users/161475de57354cea9ed24c42beff3c92` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:21.997076 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2c845-0e21-4e39-9e47-4ef0bff56f31 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:21.999789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 99/192] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:13:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:21.999789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2c845-0e21-4e39-9e47-4ef0bff56f31 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:22.013774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:22.015875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa596a8-9627-4b8f-ac85-e53e9d4d7fed None admin] RBAC: Authorizing `identity:get_user(user_id=161475de57354cea9ed24c42beff3c92)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:22.017341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa596a8-9627-4b8f-ac85-e53e9d4d7fed None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:22.019041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 94/193] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:21 2022] GET /identity/v3/users/161475de57354cea9ed24c42beff3c92 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:22.019871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa596a8-9627-4b8f-ac85-e53e9d4d7fed None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:22.112239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2c845-0e21-4e39-9e47-4ef0bff56f31 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:22.129517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa596a8-9627-4b8f-ac85-e53e9d4d7fed None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:22.145315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82db418-427f-474a-88f9-43f0008b76ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:22.145925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82db418-427f-474a-88f9-43f0008b76ed None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:22.146204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82db418-427f-474a-88f9-43f0008b76ed None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:22.146474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82db418-427f-474a-88f9-43f0008b76ed None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:22.147139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82db418-427f-474a-88f9-43f0008b76ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:22.147441 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82db418-427f-474a-88f9-43f0008b76ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:22.148882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82db418-427f-474a-88f9-43f0008b76ed None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:22.156695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 100/194] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:13:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:22.157453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82db418-427f-474a-88f9-43f0008b76ed None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:22.167237 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37346da3-e914-4b56-b3f8-a51418c44409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:22.168077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37346da3-e914-4b56-b3f8-a51418c44409 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:22.168356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37346da3-e914-4b56-b3f8-a51418c44409 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:22.168627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37346da3-e914-4b56-b3f8-a51418c44409 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:22.178412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37346da3-e914-4b56-b3f8-a51418c44409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-37346da3-e914-4b56-b3f8-a51418c44409 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:22.183672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:22.184603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:22.185389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 95/195] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:22.186293 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37346da3-e914-4b56-b3f8-a51418c44409 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:22.189931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:22.230305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:22.260390 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82db418-427f-474a-88f9-43f0008b76ed None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:22.284039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37346da3-e914-4b56-b3f8-a51418c44409 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:22.292878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b93801-18b1-40eb-8e0e-48ded61749ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:22.293489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93801-18b1-40eb-8e0e-48ded61749ce None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:22.293767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93801-18b1-40eb-8e0e-48ded61749ce None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:22.294040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93801-18b1-40eb-8e0e-48ded61749ce None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:22.294690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93801-18b1-40eb-8e0e-48ded61749ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:22.296158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93801-18b1-40eb-8e0e-48ded61749ce None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:22.317631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc517e84-7709-4f27-ab75-abf4b8e97913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:22.318226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc517e84-7709-4f27-ab75-abf4b8e97913 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:22.318504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc517e84-7709-4f27-ab75-abf4b8e97913 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:22.321966 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc517e84-7709-4f27-ab75-abf4b8e97913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:22.384813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc517e84-7709-4f27-ab75-abf4b8e97913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:22.386226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc517e84-7709-4f27-ab75-abf4b8e97913 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:22.388689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:22.417068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 101/196] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:13:22 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:13:22.417068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b93801-18b1-40eb-8e0e-48ded61749ce None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:22.493846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 96/197] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:22.495432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc517e84-7709-4f27-ab75-abf4b8e97913 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:22.555348 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b93801-18b1-40eb-8e0e-48ded61749ce None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:22.587817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:22.597327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058bf02-1a1d-42d1-9b93-e7d830542849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:22.597966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058bf02-1a1d-42d1-9b93-e7d830542849 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:22.598244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058bf02-1a1d-42d1-9b93-e7d830542849 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:22.598514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058bf02-1a1d-42d1-9b93-e7d830542849 None admin] PATH_INFO: `/v3/users/161475de57354cea9ed24c42beff3c92` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:22.599653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058bf02-1a1d-42d1-9b93-e7d830542849 None admin] RBAC: Authorizing `identity:get_user(user_id=161475de57354cea9ed24c42beff3c92)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:22.601601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058bf02-1a1d-42d1-9b93-e7d830542849 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:22.602773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 102/198] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:22 2022] GET /identity/v3/users/161475de57354cea9ed24c42beff3c92 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:22.604554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058bf02-1a1d-42d1-9b93-e7d830542849 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:22.616947 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc517e84-7709-4f27-ab75-abf4b8e97913 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:22.619937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:22.655826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b28ff4-54f8-43c4-986a-5ff882404240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:22.656517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28ff4-54f8-43c4-986a-5ff882404240 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:22.656797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28ff4-54f8-43c4-986a-5ff882404240 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:22.657068 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28ff4-54f8-43c4-986a-5ff882404240 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:22.657836 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b28ff4-54f8-43c4-986a-5ff882404240 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:22.658126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b28ff4-54f8-43c4-986a-5ff882404240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:22.659499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b28ff4-54f8-43c4-986a-5ff882404240 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:22.669574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 97/199] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:22.669574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b28ff4-54f8-43c4-986a-5ff882404240 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:22.719931 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058bf02-1a1d-42d1-9b93-e7d830542849 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:22.761532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd99ec0-3b85-4a7e-9868-063d601fac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:22.762000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd99ec0-3b85-4a7e-9868-063d601fac4f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:22.762285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd99ec0-3b85-4a7e-9868-063d601fac4f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:22.762557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd99ec0-3b85-4a7e-9868-063d601fac4f None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:22.763794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd99ec0-3b85-4a7e-9868-063d601fac4f None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:22.765297 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd99ec0-3b85-4a7e-9868-063d601fac4f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:22.767102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 103/200] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:22 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:22.772079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd99ec0-3b85-4a7e-9868-063d601fac4f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:22.802242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b28ff4-54f8-43c4-986a-5ff882404240 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:22.841881 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d034b7a-3d6e-4326-b8d5-21405b4666cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:22.842471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d034b7a-3d6e-4326-b8d5-21405b4666cf None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:22.842749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d034b7a-3d6e-4326-b8d5-21405b4666cf None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:22.843019 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d034b7a-3d6e-4326-b8d5-21405b4666cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:22.851359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:22.884536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:22.896098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd99ec0-3b85-4a7e-9868-063d601fac4f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:22.928824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d034b7a-3d6e-4326-b8d5-21405b4666cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:22.930676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d034b7a-3d6e-4326-b8d5-21405b4666cf None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:22.944838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98313e0a-2c25-4a1c-a340-a2d15e907a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:22.945638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98313e0a-2c25-4a1c-a340-a2d15e907a12 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:22.946023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98313e0a-2c25-4a1c-a340-a2d15e907a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:22.946430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98313e0a-2c25-4a1c-a340-a2d15e907a12 None admin] PATH_INFO: `/v3/users/3ecd6c2ccd5c41afac20982b8f0b4df4` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:22.947657 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98313e0a-2c25-4a1c-a340-a2d15e907a12 None admin] RBAC: Authorizing `identity:get_user(user_id=3ecd6c2ccd5c41afac20982b8f0b4df4)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:22.949554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98313e0a-2c25-4a1c-a340-a2d15e907a12 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:22.951250 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 104/201] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:22 2022] GET /identity/v3/users/3ecd6c2ccd5c41afac20982b8f0b4df4 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:22.956235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98313e0a-2c25-4a1c-a340-a2d15e907a12 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:23.044573 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 98/202] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:23.045651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d034b7a-3d6e-4326-b8d5-21405b4666cf None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:23.067634 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98313e0a-2c25-4a1c-a340-a2d15e907a12 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:23.105823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:23.121300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af7fbb-957e-4ba9-a442-8651a330811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:23.122095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af7fbb-957e-4ba9-a442-8651a330811f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:23.122095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af7fbb-957e-4ba9-a442-8651a330811f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:23.126077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af7fbb-957e-4ba9-a442-8651a330811f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:23.126077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af7fbb-957e-4ba9-a442-8651a330811f None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197, user.id=161475de57354cea9ed24c42beff3c92) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:23.126077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af7fbb-957e-4ba9-a442-8651a330811f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:23.126324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af7fbb-957e-4ba9-a442-8651a330811f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:23.132208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:23.134766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 105/203] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:22 2022] GET /identity/v3/role_assignments?user.id=161475de57354cea9ed24c42beff3c92&scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:23.135727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af7fbb-957e-4ba9-a442-8651a330811f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:23.172849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d034b7a-3d6e-4326-b8d5-21405b4666cf None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:23.246965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa136a4-dd16-4a49-a6d2-f2919ae40545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:23.248150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa136a4-dd16-4a49-a6d2-f2919ae40545 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:23.248886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa136a4-dd16-4a49-a6d2-f2919ae40545 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:23.249368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa136a4-dd16-4a49-a6d2-f2919ae40545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:23.316151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af7fbb-957e-4ba9-a442-8651a330811f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:23.355447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa136a4-dd16-4a49-a6d2-f2919ae40545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:23.357051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa136a4-dd16-4a49-a6d2-f2919ae40545 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:23.385256 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7d66d-61cd-4916-8bd8-260fed123b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:23.386273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7d66d-61cd-4916-8bd8-260fed123b5c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:23.386749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7d66d-61cd-4916-8bd8-260fed123b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:23.387216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7d66d-61cd-4916-8bd8-260fed123b5c None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:23.388603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7d66d-61cd-4916-8bd8-260fed123b5c None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:23.392360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7d66d-61cd-4916-8bd8-260fed123b5c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:23.394281 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 106/204] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:23 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:23.400055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7d66d-61cd-4916-8bd8-260fed123b5c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:23.427061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:23.465587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 99/205] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:23.471427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa136a4-dd16-4a49-a6d2-f2919ae40545 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:23.478431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:23.558449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7d66d-61cd-4916-8bd8-260fed123b5c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:23.626663 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa136a4-dd16-4a49-a6d2-f2919ae40545 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:23.664909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12edf-9dcb-4c36-b1c5-f99bf4804474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:23.665536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12edf-9dcb-4c36-b1c5-f99bf4804474 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:23.665842 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12edf-9dcb-4c36-b1c5-f99bf4804474 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:23.666113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12edf-9dcb-4c36-b1c5-f99bf4804474 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:23.668550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd12edf-9dcb-4c36-b1c5-f99bf4804474 None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:23.669980 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd12edf-9dcb-4c36-b1c5-f99bf4804474 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:23.672026 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 100/206] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:23 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:23.679725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd86b98-4c73-4325-a597-9ee99b214e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:23.680372 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd86b98-4c73-4325-a597-9ee99b214e58 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:23.680649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd86b98-4c73-4325-a597-9ee99b214e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:23.680912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd86b98-4c73-4325-a597-9ee99b214e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:23.682214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd86b98-4c73-4325-a597-9ee99b214e58 None admin] RBAC: Adding query filter params (role.id=f63ab1c53b2e4aa0bf00e4798908cbfb, scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197, user.id=161475de57354cea9ed24c42beff3c92) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:23.682522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd86b98-4c73-4325-a597-9ee99b214e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:23.683934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd86b98-4c73-4325-a597-9ee99b214e58 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:23.687253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12edf-9dcb-4c36-b1c5-f99bf4804474 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:23.702153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 107/207] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:23 2022] GET /identity/v3/role_assignments?user.id=161475de57354cea9ed24c42beff3c92&scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197&role.id=f63ab1c53b2e4aa0bf00e4798908cbfb => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:23.735583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:23.832921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12edf-9dcb-4c36-b1c5-f99bf4804474 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:23.887301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6aca1-cd3e-4fb7-939a-3132e5af0542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:23.887848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6aca1-cd3e-4fb7-939a-3132e5af0542 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:23.888153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6aca1-cd3e-4fb7-939a-3132e5af0542 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:23.888428 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6aca1-cd3e-4fb7-939a-3132e5af0542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:23.889175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6aca1-cd3e-4fb7-939a-3132e5af0542 None admin] RBAC: Adding query filter params (role.id=084b5d87c17e4247b4ce7fae2c691632, scope.project.id=df0f459e95f141488f03abcb8bea472c, user.id=3ecd6c2ccd5c41afac20982b8f0b4df4) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:23.889491 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6aca1-cd3e-4fb7-939a-3132e5af0542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:23.890959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6aca1-cd3e-4fb7-939a-3132e5af0542 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:23.902642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 101/208] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:23 2022] GET /identity/v3/role_assignments?user.id=3ecd6c2ccd5c41afac20982b8f0b4df4&scope.project.id=df0f459e95f141488f03abcb8bea472c&role.id=084b5d87c17e4247b4ce7fae2c691632 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:24.874392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d170-37d0-4022-803c-090fc8716d85 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:24.874909 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d170-37d0-4022-803c-090fc8716d85 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:24.874909 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d170-37d0-4022-803c-090fc8716d85 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:24.876458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 108/209] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:24.881724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db401e44-3116-4359-a618-d048bf504004 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:24.882143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db401e44-3116-4359-a618-d048bf504004 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:24.882416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db401e44-3116-4359-a618-d048bf504004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:24.901845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-db401e44-3116-4359-a618-d048bf504004 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:24.903034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-db401e44-3116-4359-a618-d048bf504004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:24.943763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf6790-f9c5-45dc-840c-3773bd82ac86 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:24.944084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf6790-f9c5-45dc-840c-3773bd82ac86 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:24.944344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf6790-f9c5-45dc-840c-3773bd82ac86 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:24.945998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 109/210] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:13:24.950984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999504-f5c6-418d-818f-a272a3fe9dd0 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:24.951267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999504-f5c6-418d-818f-a272a3fe9dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:24.951540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999504-f5c6-418d-818f-a272a3fe9dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:24.972025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1e999504-f5c6-418d-818f-a272a3fe9dd0 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:24.973203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1e999504-f5c6-418d-818f-a272a3fe9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:24.979601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 102/211] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:25.041629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 110/212] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:25.254181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db401e44-3116-4359-a618-d048bf504004 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:25.283313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:25.309853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999504-f5c6-418d-818f-a272a3fe9dd0 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:25.360344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db401e44-3116-4359-a618-d048bf504004 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:25.369267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:25.397477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639e223-f4c9-4df6-97e6-4457cf5aa527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:25.398559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639e223-f4c9-4df6-97e6-4457cf5aa527 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:25.399036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639e223-f4c9-4df6-97e6-4457cf5aa527 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:25.399543 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639e223-f4c9-4df6-97e6-4457cf5aa527 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:25.411357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639e223-f4c9-4df6-97e6-4457cf5aa527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:25.415600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999504-f5c6-418d-818f-a272a3fe9dd0 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-c639e223-f4c9-4df6-97e6-4457cf5aa527 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:25.417660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:25.418638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:25.419434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:25.419434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:25.419434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:25.419434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:25.419434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:25.419434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:25.419434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:25.419434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:25.419434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:25.419434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:25.419434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:25.419434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:25.422214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 103/213] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:25.428336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639e223-f4c9-4df6-97e6-4457cf5aa527 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:25.457047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26620c37-0a7a-4bcc-ad69-99389038fed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:25.457686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26620c37-0a7a-4bcc-ad69-99389038fed4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:25.457961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26620c37-0a7a-4bcc-ad69-99389038fed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:25.458229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26620c37-0a7a-4bcc-ad69-99389038fed4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:25.459512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26620c37-0a7a-4bcc-ad69-99389038fed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:25.461104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26620c37-0a7a-4bcc-ad69-99389038fed4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:25.467920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 111/214] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:13:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:25.468752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26620c37-0a7a-4bcc-ad69-99389038fed4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:25.529044 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:25.542765 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639e223-f4c9-4df6-97e6-4457cf5aa527 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:25.575605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26620c37-0a7a-4bcc-ad69-99389038fed4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:25.582492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f0e73-3ecf-4bc3-bbc4-1f505b56fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:25.583675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0e73-3ecf-4bc3-bbc4-1f505b56fdde None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:25.584136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0e73-3ecf-4bc3-bbc4-1f505b56fdde None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:25.584548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0e73-3ecf-4bc3-bbc4-1f505b56fdde None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:25.585684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f0e73-3ecf-4bc3-bbc4-1f505b56fdde None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:25.586468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f0e73-3ecf-4bc3-bbc4-1f505b56fdde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:25.589118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f0e73-3ecf-4bc3-bbc4-1f505b56fdde None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:25.599995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 104/215] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:25.599995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78debf5f-bcac-4b1f-b0c0-0058b1c7d78a None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:25.599995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78debf5f-bcac-4b1f-b0c0-0058b1c7d78a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:25.599995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78debf5f-bcac-4b1f-b0c0-0058b1c7d78a None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:25.605048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 105/216] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:25.605048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78debf5f-bcac-4b1f-b0c0-0058b1c7d78a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:25.606328 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:25.616657 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7c7c8-1fe1-4e80-8fcd-bd8c44ca3ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:25.617354 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7c7c8-1fe1-4e80-8fcd-bd8c44ca3ca2 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:25.617635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7c7c8-1fe1-4e80-8fcd-bd8c44ca3ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:25.617904 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7c7c8-1fe1-4e80-8fcd-bd8c44ca3ca2 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:25.618559 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7c7c8-1fe1-4e80-8fcd-bd8c44ca3ca2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:25.621255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7c7c8-1fe1-4e80-8fcd-bd8c44ca3ca2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:25.708911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78debf5f-bcac-4b1f-b0c0-0058b1c7d78a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:25.717230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 112/217] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:13:25 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:13:25.718659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac17e5-248f-42bf-ae5e-c85151bc8540 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:25.719071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac17e5-248f-42bf-ae5e-c85151bc8540 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:25.719508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac17e5-248f-42bf-ae5e-c85151bc8540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:25.739363 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b4ac17e5-248f-42bf-ae5e-c85151bc8540 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:25.741037 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b4ac17e5-248f-42bf-ae5e-c85151bc8540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:25.754310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce715f53-5194-4a43-9d91-f6a91c29664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:25.754967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce715f53-5194-4a43-9d91-f6a91c29664c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:25.755247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce715f53-5194-4a43-9d91-f6a91c29664c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:25.755545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce715f53-5194-4a43-9d91-f6a91c29664c None admin] PATH_INFO: `/v3/users/3e70af4489434414b8fb946ced22488a` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:25.772378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce715f53-5194-4a43-9d91-f6a91c29664c None admin] RBAC: Authorizing `identity:get_user(user_id=3e70af4489434414b8fb946ced22488a)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:25.773867 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce715f53-5194-4a43-9d91-f6a91c29664c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:25.775830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 106/218] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:25 2022] GET /identity/v3/users/3e70af4489434414b8fb946ced22488a => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:25.782714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce715f53-5194-4a43-9d91-f6a91c29664c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:25.796927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:25.835683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 113/219] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:25.913427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce715f53-5194-4a43-9d91-f6a91c29664c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:25.947120 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4acd-8b2f-4140-97cf-777992d81fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:25.947722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4acd-8b2f-4140-97cf-777992d81fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:25.948073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4acd-8b2f-4140-97cf-777992d81fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:25.948283 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4acd-8b2f-4140-97cf-777992d81fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:26.020223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de4acd-8b2f-4140-97cf-777992d81fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:26.021684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de4acd-8b2f-4140-97cf-777992d81fc9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:26.033937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:26.103026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac17e5-248f-42bf-ae5e-c85151bc8540 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:26.137711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 107/220] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:26.144350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4acd-8b2f-4140-97cf-777992d81fc9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:26.223627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac17e5-248f-42bf-ae5e-c85151bc8540 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:26.238618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:26.266586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6701fcd-636c-4439-89fb-6d252ad86f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:26.267367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6701fcd-636c-4439-89fb-6d252ad86f98 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:26.267719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6701fcd-636c-4439-89fb-6d252ad86f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:26.268091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6701fcd-636c-4439-89fb-6d252ad86f98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:26.269127 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4acd-8b2f-4140-97cf-777992d81fc9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:26.279540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6701fcd-636c-4439-89fb-6d252ad86f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-f6701fcd-636c-4439-89fb-6d252ad86f98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:26.284624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:26.285474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:26.286339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 114/221] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:13:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:26.287004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:26.287583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa447e5-4e69-4c40-872f-9aa84995b44c None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:26.287583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa447e5-4e69-4c40-872f-9aa84995b44c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:26.287880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa447e5-4e69-4c40-872f-9aa84995b44c None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:26.293842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 115/222] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:26.295485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa447e5-4e69-4c40-872f-9aa84995b44c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:26.309684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4f0d5-8ad4-47ff-aac5-c414694fc427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:26.310501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4f0d5-8ad4-47ff-aac5-c414694fc427 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:26.311445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4f0d5-8ad4-47ff-aac5-c414694fc427 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:26.311445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4f0d5-8ad4-47ff-aac5-c414694fc427 None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:26.312894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4f0d5-8ad4-47ff-aac5-c414694fc427 None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:26.314923 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4f0d5-8ad4-47ff-aac5-c414694fc427 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:26.316671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 108/223] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:26 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:26.318509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f10ca4-8c85-410f-badf-4ee1a44f2f0d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:26.318786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f10ca4-8c85-410f-badf-4ee1a44f2f0d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:26.319059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f10ca4-8c85-410f-badf-4ee1a44f2f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:26.342686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e2f10ca4-8c85-410f-badf-4ee1a44f2f0d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:26.344036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e2f10ca4-8c85-410f-badf-4ee1a44f2f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:26.420204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa447e5-4e69-4c40-872f-9aa84995b44c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:26.424114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 109/224] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:26.425038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f10ca4-8c85-410f-badf-4ee1a44f2f0d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:26.456552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f686a-7175-41ed-8c44-d454ba9476b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:26.457226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f686a-7175-41ed-8c44-d454ba9476b9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:26.457505 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f686a-7175-41ed-8c44-d454ba9476b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:26.457778 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f686a-7175-41ed-8c44-d454ba9476b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:26.458519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f686a-7175-41ed-8c44-d454ba9476b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:26.458826 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f686a-7175-41ed-8c44-d454ba9476b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:26.460246 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f686a-7175-41ed-8c44-d454ba9476b9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:26.469297 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 116/225] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:26.474765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f686a-7175-41ed-8c44-d454ba9476b9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:26.525945 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:26.586898 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f10ca4-8c85-410f-badf-4ee1a44f2f0d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:26.624305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:26.638210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f686a-7175-41ed-8c44-d454ba9476b9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:26.688101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725de8f9-3250-4447-8af4-f547f133d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:26.689499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de8f9-3250-4447-8af4-f547f133d7dc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:26.690324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de8f9-3250-4447-8af4-f547f133d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:26.691319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de8f9-3250-4447-8af4-f547f133d7dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:26.692174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16824c3b-f52a-4c76-b979-33127effa860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:26.693136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725de8f9-3250-4447-8af4-f547f133d7dc None admin] RBAC: Adding query filter params (role.id=c071e1d121a643a48556e6287cde21c0, scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197, user.id=3e70af4489434414b8fb946ced22488a) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:26.693960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16824c3b-f52a-4c76-b979-33127effa860 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:26.694412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16824c3b-f52a-4c76-b979-33127effa860 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:26.694892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725de8f9-3250-4447-8af4-f547f133d7dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:26.695357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16824c3b-f52a-4c76-b979-33127effa860 None admin] PATH_INFO: `/v3/users/161475de57354cea9ed24c42beff3c92` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:26.697048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725de8f9-3250-4447-8af4-f547f133d7dc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:26.699148 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16824c3b-f52a-4c76-b979-33127effa860 None admin] RBAC: Authorizing `identity:get_user(user_id=161475de57354cea9ed24c42beff3c92)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:26.700771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16824c3b-f52a-4c76-b979-33127effa860 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:26.703751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 117/226] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:26 2022] GET /identity/v3/users/161475de57354cea9ed24c42beff3c92 => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:26.710613 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16824c3b-f52a-4c76-b979-33127effa860 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:26.711315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 110/227] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:26 2022] GET /identity/v3/role_assignments?user.id=3e70af4489434414b8fb946ced22488a&scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197&role.id=c071e1d121a643a48556e6287cde21c0 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:26.738046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725de8f9-3250-4447-8af4-f547f133d7dc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:26.868746 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:26.872984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16824c3b-f52a-4c76-b979-33127effa860 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:26.921502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7bdf9-db9f-4a7e-a6ce-94785f2cfd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:26.922359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7bdf9-db9f-4a7e-a6ce-94785f2cfd3f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:26.922785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7bdf9-db9f-4a7e-a6ce-94785f2cfd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:26.923229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7bdf9-db9f-4a7e-a6ce-94785f2cfd3f None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:26.925043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7bdf9-db9f-4a7e-a6ce-94785f2cfd3f None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:26.927351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7bdf9-db9f-4a7e-a6ce-94785f2cfd3f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:26.929465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 118/228] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:26 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:26.936569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7bdf9-db9f-4a7e-a6ce-94785f2cfd3f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:26.977489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725de8f9-3250-4447-8af4-f547f133d7dc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:27.059366 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7bdf9-db9f-4a7e-a6ce-94785f2cfd3f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:27.068753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb5b6d-cc59-4fb0-83d5-313e9d7786e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:27.069328 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb5b6d-cc59-4fb0-83d5-313e9d7786e6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:27.069600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb5b6d-cc59-4fb0-83d5-313e9d7786e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:27.069967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb5b6d-cc59-4fb0-83d5-313e9d7786e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:27.099532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebf419-2a11-469b-9bb5-41ea909ba9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:27.100717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebf419-2a11-469b-9bb5-41ea909ba9ea None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:27.100839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb5b6d-cc59-4fb0-83d5-313e9d7786e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:27.101329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebf419-2a11-469b-9bb5-41ea909ba9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:27.101800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebf419-2a11-469b-9bb5-41ea909ba9ea None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197/users/161475de57354cea9ed24c42beff3c92/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:27.104579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebf419-2a11-469b-9bb5-41ea909ba9ea None admin] RBAC: Authorizing `identity:create_grant(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197, user_id=161475de57354cea9ed24c42beff3c92, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-39fb5b6d-cc59-4fb0-83d5-313e9d7786e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:27.106106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:27.106963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:27.107769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:27.107769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:27.107769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:27.107769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:27.107769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:27.107769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:27.107769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:27.107769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:27.107769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:27.107769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:27.107769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:27.107769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:27.109591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebf419-2a11-469b-9bb5-41ea909ba9ea None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:27.120043 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 111/229] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:13:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:13:27.122380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb5b6d-cc59-4fb0-83d5-313e9d7786e6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:27.156239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:27.203460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 119/230] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:13:26 2022] PUT /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197/users/161475de57354cea9ed24c42beff3c92/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:27.240456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb5b6d-cc59-4fb0-83d5-313e9d7786e6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:27.278882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad998cc5-6171-46d8-a529-bcdc649d4dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:27.279810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad998cc5-6171-46d8-a529-bcdc649d4dfe None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:27.280325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad998cc5-6171-46d8-a529-bcdc649d4dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:27.280812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad998cc5-6171-46d8-a529-bcdc649d4dfe None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:27.281740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad998cc5-6171-46d8-a529-bcdc649d4dfe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:27.282223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad998cc5-6171-46d8-a529-bcdc649d4dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:27.283769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad998cc5-6171-46d8-a529-bcdc649d4dfe None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:27.293285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 112/231] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:13:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:27.299166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebf419-2a11-469b-9bb5-41ea909ba9ea None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:27.345248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:27.451620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebf419-2a11-469b-9bb5-41ea909ba9ea None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:27.487938 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff3ca4-8295-425c-b09b-50eaacf1b2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:27.488881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff3ca4-8295-425c-b09b-50eaacf1b2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:27.489306 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff3ca4-8295-425c-b09b-50eaacf1b2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:27.489768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff3ca4-8295-425c-b09b-50eaacf1b2b5 None admin] PATH_INFO: `/v3/users/161475de57354cea9ed24c42beff3c92` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:27.491105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff3ca4-8295-425c-b09b-50eaacf1b2b5 None admin] RBAC: Authorizing `identity:get_user(user_id=161475de57354cea9ed24c42beff3c92)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:27.492711 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff3ca4-8295-425c-b09b-50eaacf1b2b5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:27.495069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 120/232] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:27 2022] GET /identity/v3/users/161475de57354cea9ed24c42beff3c92 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:27.500957 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad998cc5-6171-46d8-a529-bcdc649d4dfe None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:27.601068 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:27.610094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad998cc5-6171-46d8-a529-bcdc649d4dfe None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:27.645327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057969f0-b031-4df8-9016-d5265e25a76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:27.645967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057969f0-b031-4df8-9016-d5265e25a76f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:27.646246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057969f0-b031-4df8-9016-d5265e25a76f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:27.646522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057969f0-b031-4df8-9016-d5265e25a76f None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:27.647652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057969f0-b031-4df8-9016-d5265e25a76f None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:27.649111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057969f0-b031-4df8-9016-d5265e25a76f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:27.651311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 113/233] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:27 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:27.657563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff3ca4-8295-425c-b09b-50eaacf1b2b5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:27.755924 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:27.766016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff3ca4-8295-425c-b09b-50eaacf1b2b5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:27.814085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a47c69-ec05-4c55-a260-25a930d7fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:27.815105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47c69-ec05-4c55-a260-25a930d7fae8 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:27.815600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47c69-ec05-4c55-a260-25a930d7fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:27.816113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47c69-ec05-4c55-a260-25a930d7fae8 None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197/users/161475de57354cea9ed24c42beff3c92/roles/f63ab1c53b2e4aa0bf00e4798908cbfb` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:27.824688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a47c69-ec05-4c55-a260-25a930d7fae8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197, user_id=161475de57354cea9ed24c42beff3c92, role_id=f63ab1c53b2e4aa0bf00e4798908cbfb)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:27.826374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a47c69-ec05-4c55-a260-25a930d7fae8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:27.968750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 121/234] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:13:27 2022] PUT /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197/users/161475de57354cea9ed24c42beff3c92/roles/f63ab1c53b2e4aa0bf00e4798908cbfb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:28.405156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cd4b-e250-4a02-bbd6-af29a326bd07 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:28.405681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cd4b-e250-4a02-bbd6-af29a326bd07 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:28.405681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cd4b-e250-4a02-bbd6-af29a326bd07 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:28.407333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 114/235] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:28.413532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90069b-e00a-4db9-b9c9-a0958bb88f51 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:28.414473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90069b-e00a-4db9-b9c9-a0958bb88f51 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:28.414963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90069b-e00a-4db9-b9c9-a0958bb88f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:28.436221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ea90069b-e00a-4db9-b9c9-a0958bb88f51 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:28.437705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ea90069b-e00a-4db9-b9c9-a0958bb88f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:28.469582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a2276-88c4-42fc-bced-c143ff467e1d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:28.469878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a2276-88c4-42fc-bced-c143ff467e1d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:28.470281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a2276-88c4-42fc-bced-c143ff467e1d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:28.472451 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 115/236] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:28.479161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77649dc-6cce-4c71-afb6-8f5c5abdda54 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:28.479439 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77649dc-6cce-4c71-afb6-8f5c5abdda54 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:28.479708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77649dc-6cce-4c71-afb6-8f5c5abdda54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:28.498208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f77649dc-6cce-4c71-afb6-8f5c5abdda54 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:28.499516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f77649dc-6cce-4c71-afb6-8f5c5abdda54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:28.539528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 122/237] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:28.604638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 116/238] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:28.858550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90069b-e00a-4db9-b9c9-a0958bb88f51 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:28.976494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:28.998561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90069b-e00a-4db9-b9c9-a0958bb88f51 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:29.011130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77649dc-6cce-4c71-afb6-8f5c5abdda54 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:29.048330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8517cb0-5dee-49c3-b0c2-5c4870e35dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:29.049421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8517cb0-5dee-49c3-b0c2-5c4870e35dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:29.049421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8517cb0-5dee-49c3-b0c2-5c4870e35dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:29.049607 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8517cb0-5dee-49c3-b0c2-5c4870e35dc4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:29.073500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8517cb0-5dee-49c3-b0c2-5c4870e35dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-a8517cb0-5dee-49c3-b0c2-5c4870e35dc4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:29.078586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:29.079480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:29.080357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 123/239] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:29.085556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8517cb0-5dee-49c3-b0c2-5c4870e35dc4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:29.117076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:29.126368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77649dc-6cce-4c71-afb6-8f5c5abdda54 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:29.196290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe7c5f-cdbb-4fe2-833a-405b10cb64ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:29.197862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe7c5f-cdbb-4fe2-833a-405b10cb64ae None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:29.198602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe7c5f-cdbb-4fe2-833a-405b10cb64ae None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:29.200290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe7c5f-cdbb-4fe2-833a-405b10cb64ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:29.202368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe7c5f-cdbb-4fe2-833a-405b10cb64ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:29.204098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe7c5f-cdbb-4fe2-833a-405b10cb64ae None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:29.208503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 117/240] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:13:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:29.221296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe7c5f-cdbb-4fe2-833a-405b10cb64ae None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:29.311516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8517cb0-5dee-49c3-b0c2-5c4870e35dc4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:29.389901 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe7c5f-cdbb-4fe2-833a-405b10cb64ae None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:29.404813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8534e1-84af-4a4c-a94e-c1c335737b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:29.405447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8534e1-84af-4a4c-a94e-c1c335737b4a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:29.405722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8534e1-84af-4a4c-a94e-c1c335737b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:29.405990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8534e1-84af-4a4c-a94e-c1c335737b4a None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:29.406672 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8534e1-84af-4a4c-a94e-c1c335737b4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:29.406975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8534e1-84af-4a4c-a94e-c1c335737b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:29.408426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8534e1-84af-4a4c-a94e-c1c335737b4a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:29.427258 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 124/241] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:29.432896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8534e1-84af-4a4c-a94e-c1c335737b4a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:29.438099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e6ff5-041f-467f-9abf-d27a4cb53092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:29.438722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6ff5-041f-467f-9abf-d27a4cb53092 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:29.439005 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6ff5-041f-467f-9abf-d27a4cb53092 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:29.439273 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6ff5-041f-467f-9abf-d27a4cb53092 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:29.439932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e6ff5-041f-467f-9abf-d27a4cb53092 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:29.441377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e6ff5-041f-467f-9abf-d27a4cb53092 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:29.448239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:29.533784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 118/242] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:13:29 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:13:29.535241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97fa0f-4500-46ca-8517-83852f61da40 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:29.535527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97fa0f-4500-46ca-8517-83852f61da40 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:29.535797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97fa0f-4500-46ca-8517-83852f61da40 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:29.537661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 119/243] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:29.543495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb337b2-4284-405b-89a0-4fe46f4ddc83 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:29.543769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb337b2-4284-405b-89a0-4fe46f4ddc83 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:29.544079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb337b2-4284-405b-89a0-4fe46f4ddc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:29.555410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8534e1-84af-4a4c-a94e-c1c335737b4a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:29.599412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4bb337b2-4284-405b-89a0-4fe46f4ddc83 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:29.600682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4bb337b2-4284-405b-89a0-4fe46f4ddc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:29.621075 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:29.637748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c38b5-a7f3-461a-be5f-9127c400e895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:29.638452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c38b5-a7f3-461a-be5f-9127c400e895 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:29.638728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c38b5-a7f3-461a-be5f-9127c400e895 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:29.638994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c38b5-a7f3-461a-be5f-9127c400e895 None admin] PATH_INFO: `/v3/users/7330a761ef4c47aa911b74860a4a51e3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:29.674206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c38b5-a7f3-461a-be5f-9127c400e895 None admin] RBAC: Authorizing `identity:get_user(user_id=7330a761ef4c47aa911b74860a4a51e3)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:29.674206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c38b5-a7f3-461a-be5f-9127c400e895 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:29.675158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 125/244] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:29 2022] GET /identity/v3/users/7330a761ef4c47aa911b74860a4a51e3 => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:29.682412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c38b5-a7f3-461a-be5f-9127c400e895 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:29.718965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 120/245] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:29.778507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:29.810928 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e774861-4efa-4f5e-b77b-12080ba8b6ae None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:29.811228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e774861-4efa-4f5e-b77b-12080ba8b6ae None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:29.811495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e774861-4efa-4f5e-b77b-12080ba8b6ae None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:29.813159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 121/246] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:13:29.819286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5e0d6-a61f-4076-848c-1a6a1f5a52c0 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:29.819558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5e0d6-a61f-4076-848c-1a6a1f5a52c0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:29.819828 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5e0d6-a61f-4076-848c-1a6a1f5a52c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:29.825248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c38b5-a7f3-461a-be5f-9127c400e895 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:29.843500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-06c5e0d6-a61f-4076-848c-1a6a1f5a52c0 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:29.844718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-06c5e0d6-a61f-4076-848c-1a6a1f5a52c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:29.874117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e58f9-89b4-48c3-a6c9-f313977ca987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:29.874980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e58f9-89b4-48c3-a6c9-f313977ca987 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:29.875259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e58f9-89b4-48c3-a6c9-f313977ca987 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:29.875682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e58f9-89b4-48c3-a6c9-f313977ca987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:29.945496 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 122/247] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:29.978772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e58f9-89b4-48c3-a6c9-f313977ca987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:29.980345 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e58f9-89b4-48c3-a6c9-f313977ca987 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:30.012800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5e0d6-a61f-4076-848c-1a6a1f5a52c0 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:30.064313 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:30.115856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 126/248] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:30.122805 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e58f9-89b4-48c3-a6c9-f313977ca987 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:30.123056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:30.153492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5e0d6-a61f-4076-848c-1a6a1f5a52c0 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:30.198262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ff94c-4275-4c02-a82e-e6cb452730c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:30.198825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ff94c-4275-4c02-a82e-e6cb452730c2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:30.199102 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ff94c-4275-4c02-a82e-e6cb452730c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:30.199374 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ff94c-4275-4c02-a82e-e6cb452730c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:30.210813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ff94c-4275-4c02-a82e-e6cb452730c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1c7ff94c-4275-4c02-a82e-e6cb452730c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:30.217016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:30.217909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:30.218724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 123/249] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:13:30.225639 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ff94c-4275-4c02-a82e-e6cb452730c2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:30.235431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e58f9-89b4-48c3-a6c9-f313977ca987 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:30.276817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbaa5a-3aae-4033-9b62-574a614aa5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:30.277455 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbaa5a-3aae-4033-9b62-574a614aa5ee None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:30.277729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbaa5a-3aae-4033-9b62-574a614aa5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:30.277996 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbaa5a-3aae-4033-9b62-574a614aa5ee None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:30.279664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbaa5a-3aae-4033-9b62-574a614aa5ee None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:30.281639 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbaa5a-3aae-4033-9b62-574a614aa5ee None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:30.284534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 127/250] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:30 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:30.285496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbaa5a-3aae-4033-9b62-574a614aa5ee None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:30.321403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:30.350068 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ff94c-4275-4c02-a82e-e6cb452730c2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:30.390544 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbaa5a-3aae-4033-9b62-574a614aa5ee None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:30.396690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c42f8-0606-4c32-ab95-092444a5523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:30.397562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c42f8-0606-4c32-ab95-092444a5523f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:30.398033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c42f8-0606-4c32-ab95-092444a5523f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:30.399098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c42f8-0606-4c32-ab95-092444a5523f None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:30.400124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c42f8-0606-4c32-ab95-092444a5523f None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:30.400634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c42f8-0606-4c32-ab95-092444a5523f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:30.403097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c42f8-0606-4c32-ab95-092444a5523f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:30.405273 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:30.415463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 124/251] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:30.421100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c42f8-0606-4c32-ab95-092444a5523f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:30.429537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cbc24-41be-4caf-a579-44881074cf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:30.430324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cbc24-41be-4caf-a579-44881074cf87 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:30.430673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cbc24-41be-4caf-a579-44881074cf87 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:30.431047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cbc24-41be-4caf-a579-44881074cf87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:30.442596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cbc24-41be-4caf-a579-44881074cf87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-f31cbc24-41be-4caf-a579-44881074cf87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:30.447876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:30.448850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:30.449701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 128/252] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:13:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:30.450357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cbc24-41be-4caf-a579-44881074cf87 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:30.534447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c42f8-0606-4c32-ab95-092444a5523f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:30.549432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:30.556824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cbc24-41be-4caf-a579-44881074cf87 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:30.591639 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f77ef6-4a16-46d0-81ff-ddba1047741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:30.592393 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77ef6-4a16-46d0-81ff-ddba1047741f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:30.592667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77ef6-4a16-46d0-81ff-ddba1047741f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:30.592935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77ef6-4a16-46d0-81ff-ddba1047741f None admin] PATH_INFO: `/v3/users/3e70af4489434414b8fb946ced22488a` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:30.594069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f77ef6-4a16-46d0-81ff-ddba1047741f None admin] RBAC: Authorizing `identity:get_user(user_id=3e70af4489434414b8fb946ced22488a)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:30.595488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f77ef6-4a16-46d0-81ff-ddba1047741f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:30.597318 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 129/253] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:30 2022] GET /identity/v3/users/3e70af4489434414b8fb946ced22488a => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:30.602340 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f77ef6-4a16-46d0-81ff-ddba1047741f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:30.684882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a3477-ebce-4465-804e-bf76f5f9d287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:30.685506 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a3477-ebce-4465-804e-bf76f5f9d287 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:30.685875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a3477-ebce-4465-804e-bf76f5f9d287 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:30.686054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a3477-ebce-4465-804e-bf76f5f9d287 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:30.686791 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a3477-ebce-4465-804e-bf76f5f9d287 None admin] RBAC: Adding query filter params (role.id=084b5d87c17e4247b4ce7fae2c691632, scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197, user.id=7330a761ef4c47aa911b74860a4a51e3) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:30.687103 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a3477-ebce-4465-804e-bf76f5f9d287 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:30.688565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a3477-ebce-4465-804e-bf76f5f9d287 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:30.705960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 125/254] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:30 2022] GET /identity/v3/role_assignments?user.id=7330a761ef4c47aa911b74860a4a51e3&scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197&role.id=084b5d87c17e4247b4ce7fae2c691632 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:30.706732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a3477-ebce-4465-804e-bf76f5f9d287 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:30.722490 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f77ef6-4a16-46d0-81ff-ddba1047741f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:30.771112 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd001f8-a00c-459c-a8ef-46505af8d52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:30.771800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd001f8-a00c-459c-a8ef-46505af8d52c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:30.772104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd001f8-a00c-459c-a8ef-46505af8d52c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:30.772378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd001f8-a00c-459c-a8ef-46505af8d52c None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:30.773057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd001f8-a00c-459c-a8ef-46505af8d52c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:30.773362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd001f8-a00c-459c-a8ef-46505af8d52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:30.774761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd001f8-a00c-459c-a8ef-46505af8d52c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:30.792056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 130/255] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:30.795035 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd001f8-a00c-459c-a8ef-46505af8d52c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:30.849708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:30.881207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:30.977412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd001f8-a00c-459c-a8ef-46505af8d52c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:30.981976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a3477-ebce-4465-804e-bf76f5f9d287 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:31.043242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fda5c-ff9b-442e-a909-674602627733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:31.043886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fda5c-ff9b-442e-a909-674602627733 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:31.044190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fda5c-ff9b-442e-a909-674602627733 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:31.044464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fda5c-ff9b-442e-a909-674602627733 None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:31.045604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fda5c-ff9b-442e-a909-674602627733 None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:31.047043 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fda5c-ff9b-442e-a909-674602627733 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:31.048838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc148afb-0afc-47f6-b1db-98f6ee8301ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:31.049174 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 126/256] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:30 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:31.049498 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc148afb-0afc-47f6-b1db-98f6ee8301ea None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:31.049776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc148afb-0afc-47f6-b1db-98f6ee8301ea None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:31.050043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc148afb-0afc-47f6-b1db-98f6ee8301ea None admin] PATH_INFO: `/v3/users/161475de57354cea9ed24c42beff3c92` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:31.051064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31ee71-754c-4698-a9c1-dd967b903a92 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:31.051258 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc148afb-0afc-47f6-b1db-98f6ee8301ea None admin] RBAC: Authorizing `identity:get_user(user_id=161475de57354cea9ed24c42beff3c92)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:31.051640 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31ee71-754c-4698-a9c1-dd967b903a92 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:31.052083 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31ee71-754c-4698-a9c1-dd967b903a92 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:31.052732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc148afb-0afc-47f6-b1db-98f6ee8301ea None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:31.053715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 127/257] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:31.054309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 131/258] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:30 2022] GET /identity/v3/users/161475de57354cea9ed24c42beff3c92 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:31.054814 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31ee71-754c-4698-a9c1-dd967b903a92 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:31.061105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9abda-0dc3-48c1-b682-26f42fe879eb None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:31.061653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9abda-0dc3-48c1-b682-26f42fe879eb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:31.062146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9abda-0dc3-48c1-b682-26f42fe879eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:31.080219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0ec9abda-0dc3-48c1-b682-26f42fe879eb None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:31.081774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0ec9abda-0dc3-48c1-b682-26f42fe879eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:31.197655 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 132/259] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:31.198848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9abda-0dc3-48c1-b682-26f42fe879eb None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:31.244890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:31.265279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31ee71-754c-4698-a9c1-dd967b903a92 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:31.301818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:31.306819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d065a45-61a1-43c9-8f96-1f23cbbde870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:31.307838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d065a45-61a1-43c9-8f96-1f23cbbde870 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:31.308360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d065a45-61a1-43c9-8f96-1f23cbbde870 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:31.308830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d065a45-61a1-43c9-8f96-1f23cbbde870 None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197/users/3e70af4489434414b8fb946ced22488a/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:31.311540 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d065a45-61a1-43c9-8f96-1f23cbbde870 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197, user_id=3e70af4489434414b8fb946ced22488a, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:31.314079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d065a45-61a1-43c9-8f96-1f23cbbde870 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:31.357733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9abda-0dc3-48c1-b682-26f42fe879eb None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:31.394003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 128/260] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:13:31 2022] PUT /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197/users/3e70af4489434414b8fb946ced22488a/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:31.400119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d57a-f006-44bd-8a50-f78c31f50900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:31.400813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d57a-f006-44bd-8a50-f78c31f50900 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:31.401150 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d57a-f006-44bd-8a50-f78c31f50900 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:31.401422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d57a-f006-44bd-8a50-f78c31f50900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:31.481438 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450d57a-f006-44bd-8a50-f78c31f50900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:31.482897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450d57a-f006-44bd-8a50-f78c31f50900 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:31.515077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:31.619912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 133/261] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:31.625631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d065a45-61a1-43c9-8f96-1f23cbbde870 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:31.666052 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d57a-f006-44bd-8a50-f78c31f50900 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:31.774576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d065a45-61a1-43c9-8f96-1f23cbbde870 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:31.820777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da59a8-16b8-4999-961d-244859eef52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:31.821437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da59a8-16b8-4999-961d-244859eef52a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:31.821723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da59a8-16b8-4999-961d-244859eef52a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:31.822035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da59a8-16b8-4999-961d-244859eef52a None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:31.823281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da59a8-16b8-4999-961d-244859eef52a None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:31.828845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da59a8-16b8-4999-961d-244859eef52a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:31.830579 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 129/262] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:31 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:31.831639 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d57a-f006-44bd-8a50-f78c31f50900 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:31.837053 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da59a8-16b8-4999-961d-244859eef52a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:31.858724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:31.872034 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140107bb-586a-46ad-886e-a4a5c574c81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:31.876582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140107bb-586a-46ad-886e-a4a5c574c81e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:31.876582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140107bb-586a-46ad-886e-a4a5c574c81e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:31.876582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140107bb-586a-46ad-886e-a4a5c574c81e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:31.897039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140107bb-586a-46ad-886e-a4a5c574c81e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-140107bb-586a-46ad-886e-a4a5c574c81e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:31.902984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:31.903867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:31.904761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 134/263] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:13:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:31.920010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140107bb-586a-46ad-886e-a4a5c574c81e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:32.013289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:32.092919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140107bb-586a-46ad-886e-a4a5c574c81e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:32.145092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da59a8-16b8-4999-961d-244859eef52a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:32.148327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebfbf1-8272-4312-ab31-aaa29f4399ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:32.148955 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebfbf1-8272-4312-ab31-aaa29f4399ee None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:32.149237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebfbf1-8272-4312-ab31-aaa29f4399ee None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:32.149510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebfbf1-8272-4312-ab31-aaa29f4399ee None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:32.150273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebfbf1-8272-4312-ab31-aaa29f4399ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:32.150576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebfbf1-8272-4312-ab31-aaa29f4399ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:32.151979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebfbf1-8272-4312-ab31-aaa29f4399ee None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:32.167190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 135/264] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:13:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:32.172860 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebfbf1-8272-4312-ab31-aaa29f4399ee None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:32.221572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ff3f1-1bbd-463f-aca3-e00b2cf0802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:32.222199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ff3f1-1bbd-463f-aca3-e00b2cf0802e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:32.222484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ff3f1-1bbd-463f-aca3-e00b2cf0802e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:32.222757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ff3f1-1bbd-463f-aca3-e00b2cf0802e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:32.223495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ff3f1-1bbd-463f-aca3-e00b2cf0802e None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197, user.id=161475de57354cea9ed24c42beff3c92) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:32.223805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ff3f1-1bbd-463f-aca3-e00b2cf0802e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:32.225259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ff3f1-1bbd-463f-aca3-e00b2cf0802e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:32.242097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 130/265] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:31 2022] GET /identity/v3/role_assignments?user.id=161475de57354cea9ed24c42beff3c92&scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 608 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:32.249003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:32.347091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebfbf1-8272-4312-ab31-aaa29f4399ee None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:32.405771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41df5af-bfe4-4eb2-a33c-3b033a58642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:32.406427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41df5af-bfe4-4eb2-a33c-3b033a58642b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:32.406752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41df5af-bfe4-4eb2-a33c-3b033a58642b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:32.407029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41df5af-bfe4-4eb2-a33c-3b033a58642b None admin] PATH_INFO: `/v3/users/161475de57354cea9ed24c42beff3c92` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:32.408252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41df5af-bfe4-4eb2-a33c-3b033a58642b None admin] RBAC: Authorizing `identity:get_user(user_id=161475de57354cea9ed24c42beff3c92)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:32.409772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41df5af-bfe4-4eb2-a33c-3b033a58642b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:32.411681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 136/266] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:32 2022] GET /identity/v3/users/161475de57354cea9ed24c42beff3c92 => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:32.417826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ff3f1-1bbd-463f-aca3-e00b2cf0802e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:32.561850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ff3f1-1bbd-463f-aca3-e00b2cf0802e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:32.592166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:32.617020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ccd93-5912-473d-907f-c4c9d2856f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:32.617559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ccd93-5912-473d-907f-c4c9d2856f90 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:32.617839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ccd93-5912-473d-907f-c4c9d2856f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:32.618116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ccd93-5912-473d-907f-c4c9d2856f90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:32.710510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ccd93-5912-473d-907f-c4c9d2856f90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:32.711991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ccd93-5912-473d-907f-c4c9d2856f90 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:32.835467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 131/267] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:32.841556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41df5af-bfe4-4eb2-a33c-3b033a58642b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:32.999001 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41df5af-bfe4-4eb2-a33c-3b033a58642b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:32.999770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f657f-f106-4397-856f-1d1444b23db5 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:33.000089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f657f-f106-4397-856f-1d1444b23db5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:33.000366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f657f-f106-4397-856f-1d1444b23db5 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:33.003971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 132/268] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:33.008706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adf146-d4ce-439f-ba7b-01bd3a503c28 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:33.009019 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adf146-d4ce-439f-ba7b-01bd3a503c28 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:33.009298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adf146-d4ce-439f-ba7b-01bd3a503c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:33.025143 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:33.048990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-53adf146-d4ce-439f-ba7b-01bd3a503c28 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:33.050170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-53adf146-d4ce-439f-ba7b-01bd3a503c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:33.070743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9a67d-48e7-4e89-8d58-8a9db95aeba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:33.071413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a67d-48e7-4e89-8d58-8a9db95aeba8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:33.071688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a67d-48e7-4e89-8d58-8a9db95aeba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:33.072548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a67d-48e7-4e89-8d58-8a9db95aeba8 None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:33.073779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9a67d-48e7-4e89-8d58-8a9db95aeba8 None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:33.075294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9a67d-48e7-4e89-8d58-8a9db95aeba8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:33.077272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 137/269] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:32 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:33.084316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:33.089343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9a67d-48e7-4e89-8d58-8a9db95aeba8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:33.181993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 133/270] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:33.208909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2daf57-d08d-4657-b35c-7c2928afe3b4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:33.209217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2daf57-d08d-4657-b35c-7c2928afe3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:33.209471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2daf57-d08d-4657-b35c-7c2928afe3b4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:33.211098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 134/271] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:13:33.217834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704c0a1-db6a-4f0b-bb7d-14f4050a5a3c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:33.218120 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704c0a1-db6a-4f0b-bb7d-14f4050a5a3c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:33.218397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704c0a1-db6a-4f0b-bb7d-14f4050a5a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:33.245432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c704c0a1-db6a-4f0b-bb7d-14f4050a5a3c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:33.246632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c704c0a1-db6a-4f0b-bb7d-14f4050a5a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:33.292369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9a67d-48e7-4e89-8d58-8a9db95aeba8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:33.363638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 135/272] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:33.373526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fd88f-8296-4e16-89df-8b4c8a46b901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:33.374150 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fd88f-8296-4e16-89df-8b4c8a46b901 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:33.374430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fd88f-8296-4e16-89df-8b4c8a46b901 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:33.374705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fd88f-8296-4e16-89df-8b4c8a46b901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:33.375437 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fd88f-8296-4e16-89df-8b4c8a46b901 None admin] RBAC: Adding query filter params (role.id=f63ab1c53b2e4aa0bf00e4798908cbfb, scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197, user.id=161475de57354cea9ed24c42beff3c92) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:33.375745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fd88f-8296-4e16-89df-8b4c8a46b901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:33.377221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fd88f-8296-4e16-89df-8b4c8a46b901 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:33.388473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 138/273] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:33 2022] GET /identity/v3/role_assignments?user.id=161475de57354cea9ed24c42beff3c92&scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197&role.id=f63ab1c53b2e4aa0bf00e4798908cbfb => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:33.569587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704c0a1-db6a-4f0b-bb7d-14f4050a5a3c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:33.625801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4b29a-b39d-4f20-b26c-875369437376 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:33.626089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4b29a-b39d-4f20-b26c-875369437376 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:33.626524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4b29a-b39d-4f20-b26c-875369437376 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:33.628452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 139/274] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:33.634766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8f616-464c-4ffd-bae7-b8aa02e5a3a1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:33.635567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8f616-464c-4ffd-bae7-b8aa02e5a3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:33.636598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8f616-464c-4ffd-bae7-b8aa02e5a3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:33.658692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-25a8f616-464c-4ffd-bae7-b8aa02e5a3a1 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:33.660290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-25a8f616-464c-4ffd-bae7-b8aa02e5a3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:33.691210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:33.711646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704c0a1-db6a-4f0b-bb7d-14f4050a5a3c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:33.713661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:33.751416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 140/275] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:33.752171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8f616-464c-4ffd-bae7-b8aa02e5a3a1 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:33.756179 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231ba75-6a97-433c-95dc-91302c4fbbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:33.756830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231ba75-6a97-433c-95dc-91302c4fbbbd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:33.757280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231ba75-6a97-433c-95dc-91302c4fbbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:33.757725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231ba75-6a97-433c-95dc-91302c4fbbbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:33.772649 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231ba75-6a97-433c-95dc-91302c4fbbbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e231ba75-6a97-433c-95dc-91302c4fbbbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:33.781036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:33.782171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:33.783141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:33.783141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:33.783141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:33.783141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:33.783141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:33.783141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:33.783141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:33.783141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:33.783141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:33.783141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:33.783141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:33.783141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:33.783903 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 136/276] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:33.793306 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231ba75-6a97-433c-95dc-91302c4fbbbd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:33.875536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8f616-464c-4ffd-bae7-b8aa02e5a3a1 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:33.914717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25307e-c866-4114-a620-95b4d66fc55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:33.916303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25307e-c866-4114-a620-95b4d66fc55a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:33.916788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25307e-c866-4114-a620-95b4d66fc55a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:33.917279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25307e-c866-4114-a620-95b4d66fc55a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:33.918608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25307e-c866-4114-a620-95b4d66fc55a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:33.920388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25307e-c866-4114-a620-95b4d66fc55a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:33.921232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231ba75-6a97-433c-95dc-91302c4fbbbd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:33.922839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 141/277] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:33.929917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25307e-c866-4114-a620-95b4d66fc55a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:33.969965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6588c75-18c6-41cf-aee8-66252631c2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:33.971068 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6588c75-18c6-41cf-aee8-66252631c2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:33.971466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6588c75-18c6-41cf-aee8-66252631c2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:33.971827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6588c75-18c6-41cf-aee8-66252631c2d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:33.972771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6588c75-18c6-41cf-aee8-66252631c2d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:33.973357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6588c75-18c6-41cf-aee8-66252631c2d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:33.975034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6588c75-18c6-41cf-aee8-66252631c2d1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:33.991444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 137/278] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:33.991870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:33.996921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6588c75-18c6-41cf-aee8-66252631c2d1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:33.999842 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:34.067401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25307e-c866-4114-a620-95b4d66fc55a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:34.107354 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6404-520e-40fc-8aa5-e526c68fd35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:34.107985 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6404-520e-40fc-8aa5-e526c68fd35d None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:34.108263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6404-520e-40fc-8aa5-e526c68fd35d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:34.108533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6404-520e-40fc-8aa5-e526c68fd35d None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:34.109171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6404-520e-40fc-8aa5-e526c68fd35d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:34.110594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6404-520e-40fc-8aa5-e526c68fd35d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:34.113702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6588c75-18c6-41cf-aee8-66252631c2d1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:34.146958 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c6156-75ed-4dc6-8d36-c7b6090705ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:34.147501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c6156-75ed-4dc6-8d36-c7b6090705ca None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:34.147779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c6156-75ed-4dc6-8d36-c7b6090705ca None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:34.148100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c6156-75ed-4dc6-8d36-c7b6090705ca None admin] PATH_INFO: `/v3/users/74c75ff8f6844ce48de3f604ab4a5839` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:34.161242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c6156-75ed-4dc6-8d36-c7b6090705ca None admin] RBAC: Authorizing `identity:get_user(user_id=74c75ff8f6844ce48de3f604ab4a5839)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:34.162803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c6156-75ed-4dc6-8d36-c7b6090705ca None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:34.164417 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 138/279] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:33 2022] GET /identity/v3/users/74c75ff8f6844ce48de3f604ab4a5839 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:34.165167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c6156-75ed-4dc6-8d36-c7b6090705ca None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:34.221297 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:34.251522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 142/280] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:13:33 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:13:34.252676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6404-520e-40fc-8aa5-e526c68fd35d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:34.272586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c6156-75ed-4dc6-8d36-c7b6090705ca None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:34.328128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514db2-39b8-45c1-8e82-cd758cf979f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:34.328845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514db2-39b8-45c1-8e82-cd758cf979f4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:34.329121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514db2-39b8-45c1-8e82-cd758cf979f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:34.329396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514db2-39b8-45c1-8e82-cd758cf979f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:34.344699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c514db2-39b8-45c1-8e82-cd758cf979f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5c514db2-39b8-45c1-8e82-cd758cf979f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:34.351627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:34.352623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:34.353996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 139/281] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:34.359319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514db2-39b8-45c1-8e82-cd758cf979f4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:34.398660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:34.405107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6404-520e-40fc-8aa5-e526c68fd35d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:34.446732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6408d-1e3d-48f7-82e0-2b3e96a312c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:34.447895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6408d-1e3d-48f7-82e0-2b3e96a312c3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:34.448734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6408d-1e3d-48f7-82e0-2b3e96a312c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:34.448734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6408d-1e3d-48f7-82e0-2b3e96a312c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:34.449189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6408d-1e3d-48f7-82e0-2b3e96a312c3 None admin] RBAC: Adding query filter params (role.id=c071e1d121a643a48556e6287cde21c0, user.id=74c75ff8f6844ce48de3f604ab4a5839, scope.system=all) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:34.449490 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6408d-1e3d-48f7-82e0-2b3e96a312c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:34.450914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6408d-1e3d-48f7-82e0-2b3e96a312c3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:34.457875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 143/282] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Oct 4 10:13:34 2022] GET /identity/v3/role_assignments?user.id=74c75ff8f6844ce48de3f604ab4a5839&scope.system=all&role.id=c071e1d121a643a48556e6287cde21c0 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:34.457875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624b516-0bf1-4e07-adb3-592351b1a840 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:34.458210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624b516-0bf1-4e07-adb3-592351b1a840 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:34.458411 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624b516-0bf1-4e07-adb3-592351b1a840 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:34.459624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 144/283] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:34.465720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43916312-f2d9-484a-aad3-011a78d5644c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:34.466651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43916312-f2d9-484a-aad3-011a78d5644c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:34.466951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43916312-f2d9-484a-aad3-011a78d5644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:34.489520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-43916312-f2d9-484a-aad3-011a78d5644c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:34.490728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-43916312-f2d9-484a-aad3-011a78d5644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:34.498645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514db2-39b8-45c1-8e82-cd758cf979f4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:34.532426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:34.551516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e471f3-0462-4fd8-9ab2-71ba776edc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:34.552181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e471f3-0462-4fd8-9ab2-71ba776edc37 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:34.552463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e471f3-0462-4fd8-9ab2-71ba776edc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:34.552733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e471f3-0462-4fd8-9ab2-71ba776edc37 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:34.553406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e471f3-0462-4fd8-9ab2-71ba776edc37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:34.553712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e471f3-0462-4fd8-9ab2-71ba776edc37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:34.555418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e471f3-0462-4fd8-9ab2-71ba776edc37 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:34.567004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 140/284] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:34.575749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e471f3-0462-4fd8-9ab2-71ba776edc37 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:34.582869 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 145/285] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:34.693203 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e471f3-0462-4fd8-9ab2-71ba776edc37 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:34.730484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cdc7b-d1da-4aac-bfff-0a60e2280dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:34.731214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cdc7b-d1da-4aac-bfff-0a60e2280dbb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:34.731445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cdc7b-d1da-4aac-bfff-0a60e2280dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:34.731750 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cdc7b-d1da-4aac-bfff-0a60e2280dbb None admin] PATH_INFO: `/v3/users/7330a761ef4c47aa911b74860a4a51e3` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:34.732933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cdc7b-d1da-4aac-bfff-0a60e2280dbb None admin] RBAC: Authorizing `identity:get_user(user_id=7330a761ef4c47aa911b74860a4a51e3)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:34.734423 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cdc7b-d1da-4aac-bfff-0a60e2280dbb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:34.736341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 141/286] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:34 2022] GET /identity/v3/users/7330a761ef4c47aa911b74860a4a51e3 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:34.741485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43916312-f2d9-484a-aad3-011a78d5644c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:34.839409 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:34.848918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43916312-f2d9-484a-aad3-011a78d5644c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:34.888346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cdc7b-d1da-4aac-bfff-0a60e2280dbb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:34.919215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910e944-c3b7-4581-bd35-77a26f1a1d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:34.921283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910e944-c3b7-4581-bd35-77a26f1a1d88 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:34.921968 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910e944-c3b7-4581-bd35-77a26f1a1d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:34.923876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910e944-c3b7-4581-bd35-77a26f1a1d88 None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:34.927239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910e944-c3b7-4581-bd35-77a26f1a1d88 None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:34.930357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910e944-c3b7-4581-bd35-77a26f1a1d88 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:34.933495 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 146/287] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:34 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:34.939117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910e944-c3b7-4581-bd35-77a26f1a1d88 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:34.997210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:35.089834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cdc7b-d1da-4aac-bfff-0a60e2280dbb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:35.114688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910e944-c3b7-4581-bd35-77a26f1a1d88 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:35.153983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9d6a5-909e-4236-81c0-b665da26e95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:35.154620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9d6a5-909e-4236-81c0-b665da26e95f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:35.154894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9d6a5-909e-4236-81c0-b665da26e95f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:35.155080 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9aaa7-5af9-4adf-851a-70e0d88afd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:35.155188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9d6a5-909e-4236-81c0-b665da26e95f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:35.155742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9aaa7-5af9-4adf-851a-70e0d88afd2a None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:35.156042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9aaa7-5af9-4adf-851a-70e0d88afd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:35.156312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9aaa7-5af9-4adf-851a-70e0d88afd2a None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197/users/7330a761ef4c47aa911b74860a4a51e3/roles/084b5d87c17e4247b4ce7fae2c691632` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:35.158217 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9aaa7-5af9-4adf-851a-70e0d88afd2a None admin] RBAC: Authorizing `identity:create_grant(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197, user_id=7330a761ef4c47aa911b74860a4a51e3, role_id=084b5d87c17e4247b4ce7fae2c691632)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:35.159623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9aaa7-5af9-4adf-851a-70e0d88afd2a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:35.175926 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9d6a5-909e-4236-81c0-b665da26e95f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ebb9d6a5-909e-4236-81c0-b665da26e95f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:35.181601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:35.182499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:35.183377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:35.183377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:35.183377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:35.183377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:35.183377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:35.183377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:35.183377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:35.183377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:35.183377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:35.183377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:35.183377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:35.183377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:35.187447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 142/288] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:13:35.188808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9d6a5-909e-4236-81c0-b665da26e95f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:35.240406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 147/289] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:13:34 2022] PUT /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197/users/7330a761ef4c47aa911b74860a4a51e3/roles/084b5d87c17e4247b4ce7fae2c691632 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:35.304942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9d6a5-909e-4236-81c0-b665da26e95f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:35.316928 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:35.341289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326577e-794c-47e7-ad20-92895cddc4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:35.341912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326577e-794c-47e7-ad20-92895cddc4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:35.342189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326577e-794c-47e7-ad20-92895cddc4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:35.342458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326577e-794c-47e7-ad20-92895cddc4b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:35.343143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326577e-794c-47e7-ad20-92895cddc4b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:35.343446 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326577e-794c-47e7-ad20-92895cddc4b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:35.344952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326577e-794c-47e7-ad20-92895cddc4b0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:35.355152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 143/290] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:35.361066 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9aaa7-5af9-4adf-851a-70e0d88afd2a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:35.395497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:35.505744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9aaa7-5af9-4adf-851a-70e0d88afd2a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:35.545562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a3173-126f-472b-b432-993209b6dd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:35.546197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a3173-126f-472b-b432-993209b6dd61 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:35.546468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a3173-126f-472b-b432-993209b6dd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:35.546732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a3173-126f-472b-b432-993209b6dd61 None admin] PATH_INFO: `/v3/users/3e70af4489434414b8fb946ced22488a` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:35.547848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a3173-126f-472b-b432-993209b6dd61 None admin] RBAC: Authorizing `identity:get_user(user_id=3e70af4489434414b8fb946ced22488a)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:35.549396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a3173-126f-472b-b432-993209b6dd61 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:35.553038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 148/291] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:35 2022] GET /identity/v3/users/3e70af4489434414b8fb946ced22488a => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:35.557537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326577e-794c-47e7-ad20-92895cddc4b0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:35.659094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326577e-794c-47e7-ad20-92895cddc4b0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:35.693659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e0318-2b95-4c43-b42d-362b03f52ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:35.694272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e0318-2b95-4c43-b42d-362b03f52ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:35.694547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e0318-2b95-4c43-b42d-362b03f52ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:35.694815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e0318-2b95-4c43-b42d-362b03f52ef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:35.737583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:35.765405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e0318-2b95-4c43-b42d-362b03f52ef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:35.766902 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e0318-2b95-4c43-b42d-362b03f52ef8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:35.868333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 144/292] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:35.874046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a3173-126f-472b-b432-993209b6dd61 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:36.007281 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:36.025592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a3173-126f-472b-b432-993209b6dd61 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:36.068809 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acd468-2748-403a-af1d-67e61e4e4bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:36.069442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acd468-2748-403a-af1d-67e61e4e4bdd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:36.069715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acd468-2748-403a-af1d-67e61e4e4bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:36.069980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acd468-2748-403a-af1d-67e61e4e4bdd None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:36.071086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acd468-2748-403a-af1d-67e61e4e4bdd None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:36.073103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acd468-2748-403a-af1d-67e61e4e4bdd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:36.078757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 149/293] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:35 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:36.080951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e0318-2b95-4c43-b42d-362b03f52ef8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:36.158716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:36.179780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e0318-2b95-4c43-b42d-362b03f52ef8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:36.214497 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471d3d8-b679-49d1-b3bb-21a894485629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:36.215104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471d3d8-b679-49d1-b3bb-21a894485629 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:36.215376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471d3d8-b679-49d1-b3bb-21a894485629 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:36.215647 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471d3d8-b679-49d1-b3bb-21a894485629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:36.216394 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471d3d8-b679-49d1-b3bb-21a894485629 None admin] RBAC: Adding query filter params (role.id=c071e1d121a643a48556e6287cde21c0, scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197, user.id=3e70af4489434414b8fb946ced22488a) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:36.216699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471d3d8-b679-49d1-b3bb-21a894485629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:36.218115 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471d3d8-b679-49d1-b3bb-21a894485629 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:36.228110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 145/294] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:36 2022] GET /identity/v3/role_assignments?user.id=3e70af4489434414b8fb946ced22488a&scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197&role.id=c071e1d121a643a48556e6287cde21c0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:37.008363 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc551eba-517d-4d96-8560-30f36176df0c None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.008870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc551eba-517d-4d96-8560-30f36176df0c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.008945 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc551eba-517d-4d96-8560-30f36176df0c None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.010531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 150/295] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:37.015749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d934b-d5e4-483e-bf38-5415aad7bc48 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.016193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d934b-d5e4-483e-bf38-5415aad7bc48 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.016360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d934b-d5e4-483e-bf38-5415aad7bc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.027500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e0dc3-b44d-4336-990e-0e047194475f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.027787 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e0dc3-b44d-4336-990e-0e047194475f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.028093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e0dc3-b44d-4336-990e-0e047194475f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.029646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 151/296] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:13:37.034377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280fe37-2597-4b4a-8ee6-0f2cde545596 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.034660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280fe37-2597-4b4a-8ee6-0f2cde545596 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.034929 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280fe37-2597-4b4a-8ee6-0f2cde545596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.035671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d68d934b-d5e4-483e-bf38-5415aad7bc48 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:37.036888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d68d934b-d5e4-483e-bf38-5415aad7bc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:37.052568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f280fe37-2597-4b4a-8ee6-0f2cde545596 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:37.053743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f280fe37-2597-4b4a-8ee6-0f2cde545596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:37.110437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 146/297] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:37.139206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 152/298] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:37.343291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c388990-9f28-4a94-9b34-9e0ef9993439 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.343590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c388990-9f28-4a94-9b34-9e0ef9993439 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.343756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c388990-9f28-4a94-9b34-9e0ef9993439 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.345145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 147/299] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:37.350727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607301ed-97fc-4d8b-a06e-30a42fb8e16d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.351016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607301ed-97fc-4d8b-a06e-30a42fb8e16d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.351296 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607301ed-97fc-4d8b-a06e-30a42fb8e16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.370144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-607301ed-97fc-4d8b-a06e-30a42fb8e16d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:37.371361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-607301ed-97fc-4d8b-a06e-30a42fb8e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:37.394347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c388990-9f28-4a94-9b34-9e0ef9993439 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:37.445599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 153/300] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:37.447501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607301ed-97fc-4d8b-a06e-30a42fb8e16d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:37.471368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:37.472877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:37.507884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c388990-9f28-4a94-9b34-9e0ef9993439 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:37.544751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6225c-7970-4dbb-a588-0ae89e3c4662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:37.545435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6225c-7970-4dbb-a588-0ae89e3c4662 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.545712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6225c-7970-4dbb-a588-0ae89e3c4662 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.545979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6225c-7970-4dbb-a588-0ae89e3c4662 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.551403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607301ed-97fc-4d8b-a06e-30a42fb8e16d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:37.557339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6225c-7970-4dbb-a588-0ae89e3c4662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-bdd6225c-7970-4dbb-a588-0ae89e3c4662 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:37.567910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:37.568911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 148/301] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:13:37.569716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6225c-7970-4dbb-a588-0ae89e3c4662 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:37.602276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b11bed-3d03-45e0-80ca-d0efc8dcc492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:37.603134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11bed-3d03-45e0-80ca-d0efc8dcc492 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.603414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11bed-3d03-45e0-80ca-d0efc8dcc492 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.603833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11bed-3d03-45e0-80ca-d0efc8dcc492 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.617613 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b11bed-3d03-45e0-80ca-d0efc8dcc492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-84b11bed-3d03-45e0-80ca-d0efc8dcc492 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:37.623040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:37.623930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:37.625275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 154/302] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:37.633412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b11bed-3d03-45e0-80ca-d0efc8dcc492 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:37.700934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6225c-7970-4dbb-a588-0ae89e3c4662 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:37.738403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:37.745851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:37.752006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b72451-4090-41e6-8311-2ac6ca788fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:37.752889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b72451-4090-41e6-8311-2ac6ca788fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.753325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b72451-4090-41e6-8311-2ac6ca788fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.759468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b72451-4090-41e6-8311-2ac6ca788fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.759468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b72451-4090-41e6-8311-2ac6ca788fe2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:37.759468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b72451-4090-41e6-8311-2ac6ca788fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:37.759468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b72451-4090-41e6-8311-2ac6ca788fe2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:37.766721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 149/303] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:37.767707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b72451-4090-41e6-8311-2ac6ca788fe2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:37.777907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b11bed-3d03-45e0-80ca-d0efc8dcc492 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:37.815570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a2d06-a93a-40e8-a737-27c7ae9ec644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:37.816339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2d06-a93a-40e8-a737-27c7ae9ec644 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.817085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2d06-a93a-40e8-a737-27c7ae9ec644 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.817590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2d06-a93a-40e8-a737-27c7ae9ec644 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.818871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a2d06-a93a-40e8-a737-27c7ae9ec644 None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:37.819382 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a2d06-a93a-40e8-a737-27c7ae9ec644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:37.821349 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a2d06-a93a-40e8-a737-27c7ae9ec644 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:37.829722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 155/304] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:37.829722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a2d06-a93a-40e8-a737-27c7ae9ec644 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:37.874577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b72451-4090-41e6-8311-2ac6ca788fe2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:37.908371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52104ad-713a-4f89-a968-8f61cb75f83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:37.909167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52104ad-713a-4f89-a968-8f61cb75f83e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.909449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52104ad-713a-4f89-a968-8f61cb75f83e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.909722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52104ad-713a-4f89-a968-8f61cb75f83e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.910844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52104ad-713a-4f89-a968-8f61cb75f83e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:37.912309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52104ad-713a-4f89-a968-8f61cb75f83e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:37.914187 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 150/305] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:13:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:37.915325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c015cb8-c6f5-4ba0-ae0c-c530bc31f280 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.916187 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c015cb8-c6f5-4ba0-ae0c-c530bc31f280 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.916467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c015cb8-c6f5-4ba0-ae0c-c530bc31f280 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.917798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 151/306] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:37.918360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c015cb8-c6f5-4ba0-ae0c-c530bc31f280 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:37.932064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a2d06-a93a-40e8-a737-27c7ae9ec644 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:37.965210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c77df7-a637-4a71-a86f-14e719661b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:37.965841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c77df7-a637-4a71-a86f-14e719661b07 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:37.966119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c77df7-a637-4a71-a86f-14e719661b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:37.966390 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c77df7-a637-4a71-a86f-14e719661b07 None admin] PATH_INFO: `/v3/users/b898d4a573ee4806b82f97a3e77aee47` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:37.973888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:37.974168 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:37.979743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c77df7-a637-4a71-a86f-14e719661b07 None admin] RBAC: Authorizing `identity:get_user(user_id=b898d4a573ee4806b82f97a3e77aee47)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:37.992014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c77df7-a637-4a71-a86f-14e719661b07 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:37.992014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 156/307] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:37 2022] GET /identity/v3/users/b898d4a573ee4806b82f97a3e77aee47 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:37.992014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c77df7-a637-4a71-a86f-14e719661b07 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:38.018302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c015cb8-c6f5-4ba0-ae0c-c530bc31f280 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:38.051698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a6c05-3d40-4e91-a2c3-bd9fd9d722f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:38.052345 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a6c05-3d40-4e91-a2c3-bd9fd9d722f9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:38.052619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a6c05-3d40-4e91-a2c3-bd9fd9d722f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:38.052889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a6c05-3d40-4e91-a2c3-bd9fd9d722f9 None admin] PATH_INFO: `/v3/users/74c75ff8f6844ce48de3f604ab4a5839` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:38.053978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a6c05-3d40-4e91-a2c3-bd9fd9d722f9 None admin] RBAC: Authorizing `identity:get_user(user_id=74c75ff8f6844ce48de3f604ab4a5839)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:38.055380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a6c05-3d40-4e91-a2c3-bd9fd9d722f9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:38.062177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 152/308] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:37 2022] GET /identity/v3/users/74c75ff8f6844ce48de3f604ab4a5839 => generated 293 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:38.062177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50bd4b-5d53-430f-9f5f-37fa34827127 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:38.062177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50bd4b-5d53-430f-9f5f-37fa34827127 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:38.062177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50bd4b-5d53-430f-9f5f-37fa34827127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:38.076761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2b50bd4b-5d53-430f-9f5f-37fa34827127 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:38.077935 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2b50bd4b-5d53-430f-9f5f-37fa34827127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:38.079816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c77df7-a637-4a71-a86f-14e719661b07 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:38.112482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d072a2-c27a-452a-ae7a-2fe8a3e1f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:38.113081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d072a2-c27a-452a-ae7a-2fe8a3e1f28e None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:38.113448 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d072a2-c27a-452a-ae7a-2fe8a3e1f28e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:38.113723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d072a2-c27a-452a-ae7a-2fe8a3e1f28e None admin] PATH_INFO: `/v3/groups` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:38.114344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d072a2-c27a-452a-ae7a-2fe8a3e1f28e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:38.115750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d072a2-c27a-452a-ae7a-2fe8a3e1f28e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:38.142716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 153/309] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:38.143472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50bd4b-5d53-430f-9f5f-37fa34827127 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:38.194881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 157/310] 10.222.0.33 () {60 vars in 1134 bytes} [Tue Oct 4 10:13:37 2022] POST /identity/v3/groups => generated 229 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:13:38.196632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:38.209001 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d072a2-c27a-452a-ae7a-2fe8a3e1f28e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:38.250879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50bd4b-5d53-430f-9f5f-37fa34827127 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:38.297123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da8ac6-2800-4dc7-b11d-503d271defcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:38.297365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:38.298602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da8ac6-2800-4dc7-b11d-503d271defcc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:38.299058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da8ac6-2800-4dc7-b11d-503d271defcc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:38.299497 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da8ac6-2800-4dc7-b11d-503d271defcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:38.300467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da8ac6-2800-4dc7-b11d-503d271defcc None admin] RBAC: Adding query filter params (role.id=084b5d87c17e4247b4ce7fae2c691632, user.id=b898d4a573ee4806b82f97a3e77aee47, scope.system=all) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:38.300951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da8ac6-2800-4dc7-b11d-503d271defcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:38.302604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da8ac6-2800-4dc7-b11d-503d271defcc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:38.308992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 154/311] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Oct 4 10:13:38 2022] GET /identity/v3/role_assignments?user.id=b898d4a573ee4806b82f97a3e77aee47&scope.system=all&role.id=084b5d87c17e4247b4ce7fae2c691632 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:38.358429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d072a2-c27a-452a-ae7a-2fe8a3e1f28e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:38.399584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be28bc-84eb-4e21-a7aa-73943966bf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:38.400322 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be28bc-84eb-4e21-a7aa-73943966bf0d None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:38.400603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be28bc-84eb-4e21-a7aa-73943966bf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:38.400878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be28bc-84eb-4e21-a7aa-73943966bf0d None admin] PATH_INFO: `/v3/system/users/74c75ff8f6844ce48de3f604ab4a5839/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:38.402338 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be28bc-84eb-4e21-a7aa-73943966bf0d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=74c75ff8f6844ce48de3f604ab4a5839, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:38.403747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be28bc-84eb-4e21-a7aa-73943966bf0d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:38.418738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da8ac6-2800-4dc7-b11d-503d271defcc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:38.503863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 158/312] 10.222.0.33 () {58 vars in 1334 bytes} [Tue Oct 4 10:13:38 2022] PUT /identity/v3/system/users/74c75ff8f6844ce48de3f604ab4a5839/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:38.541668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da8ac6-2800-4dc7-b11d-503d271defcc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:38.563165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:38.583041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144e6ae-f32a-4dab-b787-20f3cb387075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:38.583699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144e6ae-f32a-4dab-b787-20f3cb387075 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:38.584003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144e6ae-f32a-4dab-b787-20f3cb387075 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:38.584283 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144e6ae-f32a-4dab-b787-20f3cb387075 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:38.597338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144e6ae-f32a-4dab-b787-20f3cb387075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d144e6ae-f32a-4dab-b787-20f3cb387075 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:38.602934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:38.604493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:38.606167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 155/313] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:13:38.610815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be28bc-84eb-4e21-a7aa-73943966bf0d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:38.731611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be28bc-84eb-4e21-a7aa-73943966bf0d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:38.755700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:38.770041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c3f34-39be-4443-8295-d3b2fbbed345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:38.770657 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c3f34-39be-4443-8295-d3b2fbbed345 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:38.770931 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c3f34-39be-4443-8295-d3b2fbbed345 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:38.771204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c3f34-39be-4443-8295-d3b2fbbed345 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:38.771923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c3f34-39be-4443-8295-d3b2fbbed345 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:38.772251 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c3f34-39be-4443-8295-d3b2fbbed345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:38.773603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c3f34-39be-4443-8295-d3b2fbbed345 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:38.783305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 159/314] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:38.789250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144e6ae-f32a-4dab-b787-20f3cb387075 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:38.894711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144e6ae-f32a-4dab-b787-20f3cb387075 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:38.930869 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc41a2-1270-4c62-9b26-2aa1c07ca856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:38.931569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc41a2-1270-4c62-9b26-2aa1c07ca856 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:38.931849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc41a2-1270-4c62-9b26-2aa1c07ca856 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:38.932158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc41a2-1270-4c62-9b26-2aa1c07ca856 None admin] PATH_INFO: `/v3/users/7330a761ef4c47aa911b74860a4a51e3` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:38.933358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc41a2-1270-4c62-9b26-2aa1c07ca856 None admin] RBAC: Authorizing `identity:get_user(user_id=7330a761ef4c47aa911b74860a4a51e3)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:38.934790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc41a2-1270-4c62-9b26-2aa1c07ca856 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:38.936784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 156/315] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:38 2022] GET /identity/v3/users/7330a761ef4c47aa911b74860a4a51e3 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:38.942287 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c3f34-39be-4443-8295-d3b2fbbed345 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:39.051397 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c3f34-39be-4443-8295-d3b2fbbed345 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:39.089202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0eaea7-f2ef-4438-83d2-d92d81e0f997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:39.089846 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eaea7-f2ef-4438-83d2-d92d81e0f997 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:39.090056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eaea7-f2ef-4438-83d2-d92d81e0f997 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:39.090327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eaea7-f2ef-4438-83d2-d92d81e0f997 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:39.141476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:39.162638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0eaea7-f2ef-4438-83d2-d92d81e0f997 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:39.164161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0eaea7-f2ef-4438-83d2-d92d81e0f997 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:39.268248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 160/316] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:39.273595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc41a2-1270-4c62-9b26-2aa1c07ca856 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:39.324222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:39.376538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc41a2-1270-4c62-9b26-2aa1c07ca856 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:39.410661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edd00e-b048-4876-a6ad-c62722eb4fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:39.411306 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edd00e-b048-4876-a6ad-c62722eb4fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:39.411580 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edd00e-b048-4876-a6ad-c62722eb4fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:39.411846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edd00e-b048-4876-a6ad-c62722eb4fa1 None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:39.413163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edd00e-b048-4876-a6ad-c62722eb4fa1 None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:39.414628 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edd00e-b048-4876-a6ad-c62722eb4fa1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:39.417221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 157/317] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:39 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:39.422973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0eaea7-f2ef-4438-83d2-d92d81e0f997 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:39.504479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:39.523127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0eaea7-f2ef-4438-83d2-d92d81e0f997 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:39.558017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f037e17-0512-409b-956c-bca3761df36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:39.558623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f037e17-0512-409b-956c-bca3761df36c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:39.558950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f037e17-0512-409b-956c-bca3761df36c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:39.559283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f037e17-0512-409b-956c-bca3761df36c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:39.560042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f037e17-0512-409b-956c-bca3761df36c None admin] RBAC: Adding query filter params (role.id=084b5d87c17e4247b4ce7fae2c691632, scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197, user.id=7330a761ef4c47aa911b74860a4a51e3) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:39.560347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f037e17-0512-409b-956c-bca3761df36c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:39.561823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f037e17-0512-409b-956c-bca3761df36c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:39.568598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 161/318] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:13:39 2022] GET /identity/v3/role_assignments?user.id=7330a761ef4c47aa911b74860a4a51e3&scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197&role.id=084b5d87c17e4247b4ce7fae2c691632 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:40.482607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b99e75-ddbf-49ca-b80f-a51527674a05 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:40.483188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b99e75-ddbf-49ca-b80f-a51527674a05 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:40.483188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b99e75-ddbf-49ca-b80f-a51527674a05 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:40.484906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 158/319] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:40.490546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c9589-41b4-492e-9c6b-72a16b6b7fa9 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:40.491043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c9589-41b4-492e-9c6b-72a16b6b7fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:40.491133 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c9589-41b4-492e-9c6b-72a16b6b7fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:40.510952 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b49c9589-41b4-492e-9c6b-72a16b6b7fa9 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:40.512331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b49c9589-41b4-492e-9c6b-72a16b6b7fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:40.584846 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 162/320] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:40.613239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75264d-7995-4a69-ab0f-241913fc6722 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:40.613534 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75264d-7995-4a69-ab0f-241913fc6722 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:40.613775 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75264d-7995-4a69-ab0f-241913fc6722 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:40.615126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 159/321] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:40.620557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbfbc6-6654-4514-a7a2-a04b8f2d7258 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:40.620845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbfbc6-6654-4514-a7a2-a04b8f2d7258 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:40.621121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbfbc6-6654-4514-a7a2-a04b8f2d7258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:40.639516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a0bbfbc6-6654-4514-a7a2-a04b8f2d7258 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:40.640735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a0bbfbc6-6654-4514-a7a2-a04b8f2d7258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:40.694242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f5c9-facd-42f1-abf1-9488683f7a0e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:40.694552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f5c9-facd-42f1-abf1-9488683f7a0e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:40.694787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f5c9-facd-42f1-abf1-9488683f7a0e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:40.696132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 160/322] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:13:40.701502 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566237e5-703f-4890-902c-3b1560232957 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:40.701783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566237e5-703f-4890-902c-3b1560232957 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:40.702051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566237e5-703f-4890-902c-3b1560232957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:40.708124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 163/323] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:40.720368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-566237e5-703f-4890-902c-3b1560232957 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:40.721547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-566237e5-703f-4890-902c-3b1560232957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:40.787249 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 161/324] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:40.870961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbfbc6-6654-4514-a7a2-a04b8f2d7258 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:40.880091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:40.972982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbfbc6-6654-4514-a7a2-a04b8f2d7258 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:40.973459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566237e5-703f-4890-902c-3b1560232957 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:41.013670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0419de5-4f15-452b-ad3a-03f1c1957aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:41.014305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0419de5-4f15-452b-ad3a-03f1c1957aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:41.014584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0419de5-4f15-452b-ad3a-03f1c1957aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:41.015271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0419de5-4f15-452b-ad3a-03f1c1957aa9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:41.016415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0419de5-4f15-452b-ad3a-03f1c1957aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:41.018558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0419de5-4f15-452b-ad3a-03f1c1957aa9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:41.020326 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 164/325] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:13:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:41.020908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:41.026264 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0419de5-4f15-452b-ad3a-03f1c1957aa9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:41.077305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566237e5-703f-4890-902c-3b1560232957 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:41.101832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:41.110965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46c6e5-61cd-4409-83e7-dbab65fea959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:41.111589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46c6e5-61cd-4409-83e7-dbab65fea959 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:41.116887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46c6e5-61cd-4409-83e7-dbab65fea959 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:41.116887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46c6e5-61cd-4409-83e7-dbab65fea959 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:41.121862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46c6e5-61cd-4409-83e7-dbab65fea959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:41.125385 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0419de5-4f15-452b-ad3a-03f1c1957aa9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-df46c6e5-61cd-4409-83e7-dbab65fea959 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:41.126674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:41.127516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:41.128329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 162/326] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:13:41.129002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46c6e5-61cd-4409-83e7-dbab65fea959 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:41.164368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca338e4d-453a-4ca2-a07f-fdf144ff7959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:41.164978 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca338e4d-453a-4ca2-a07f-fdf144ff7959 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:41.165258 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca338e4d-453a-4ca2-a07f-fdf144ff7959 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:41.165555 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca338e4d-453a-4ca2-a07f-fdf144ff7959 None admin] PATH_INFO: `/v3/groups` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:41.166225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca338e4d-453a-4ca2-a07f-fdf144ff7959 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:41.167651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca338e4d-453a-4ca2-a07f-fdf144ff7959 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:41.225360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46c6e5-61cd-4409-83e7-dbab65fea959 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:41.227563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:41.253187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 165/327] 10.222.0.33 () {60 vars in 1134 bytes} [Tue Oct 4 10:13:41 2022] POST /identity/v3/groups => generated 226 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:13:41.253187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca338e4d-453a-4ca2-a07f-fdf144ff7959 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:41.268794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b7458-4fb8-45ec-a002-0e61a24e7f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:41.270045 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b7458-4fb8-45ec-a002-0e61a24e7f3b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:41.270470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b7458-4fb8-45ec-a002-0e61a24e7f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:41.270914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b7458-4fb8-45ec-a002-0e61a24e7f3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:41.287466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b7458-4fb8-45ec-a002-0e61a24e7f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f76b7458-4fb8-45ec-a002-0e61a24e7f3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:41.293368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:41.294524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:41.295495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:41.295495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:41.295495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:41.295495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:41.295495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:41.295495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:41.295495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:41.295495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:41.295495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:41.295495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:41.295495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:41.295495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:41.297351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 163/328] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:41.303300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b7458-4fb8-45ec-a002-0e61a24e7f3b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:41.371443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca338e4d-453a-4ca2-a07f-fdf144ff7959 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:41.413047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3534cc-537a-42c1-8824-4b7e3d3eb4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:41.413667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3534cc-537a-42c1-8824-4b7e3d3eb4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:41.413944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3534cc-537a-42c1-8824-4b7e3d3eb4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:41.414215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3534cc-537a-42c1-8824-4b7e3d3eb4d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:41.414893 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3534cc-537a-42c1-8824-4b7e3d3eb4d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:41.415193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3534cc-537a-42c1-8824-4b7e3d3eb4d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:41.415586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b7458-4fb8-45ec-a002-0e61a24e7f3b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:41.416662 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3534cc-537a-42c1-8824-4b7e3d3eb4d2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:41.418261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:41.426943 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 166/329] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:41.432814 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3534cc-537a-42c1-8824-4b7e3d3eb4d2 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:41.456727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2138ca2-7411-46e3-9cbb-7d9d9177e8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:41.457342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2138ca2-7411-46e3-9cbb-7d9d9177e8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:41.457622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2138ca2-7411-46e3-9cbb-7d9d9177e8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:41.457896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2138ca2-7411-46e3-9cbb-7d9d9177e8e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:41.458567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2138ca2-7411-46e3-9cbb-7d9d9177e8e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:41.458871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2138ca2-7411-46e3-9cbb-7d9d9177e8e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:41.460784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2138ca2-7411-46e3-9cbb-7d9d9177e8e5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:41.471334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 164/330] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:41.476741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2138ca2-7411-46e3-9cbb-7d9d9177e8e5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:41.509625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:41.550830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3534cc-537a-42c1-8824-4b7e3d3eb4d2 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:41.595986 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b1016-c655-4482-9896-3724788d931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:41.595986 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1016-c655-4482-9896-3724788d931a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:41.596298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1016-c655-4482-9896-3724788d931a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:41.596503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1016-c655-4482-9896-3724788d931a None admin] PATH_INFO: `/v3/users/b898d4a573ee4806b82f97a3e77aee47` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:41.598107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b1016-c655-4482-9896-3724788d931a None admin] RBAC: Authorizing `identity:get_user(user_id=b898d4a573ee4806b82f97a3e77aee47)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:41.599867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b1016-c655-4482-9896-3724788d931a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:41.601842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 167/331] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:41 2022] GET /identity/v3/users/b898d4a573ee4806b82f97a3e77aee47 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:41.604662 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2138ca2-7411-46e3-9cbb-7d9d9177e8e5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:41.609705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b1016-c655-4482-9896-3724788d931a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:41.648943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfd44e-c77c-42a8-be94-a916207f00ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:41.649519 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfd44e-c77c-42a8-be94-a916207f00ff None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:41.649794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfd44e-c77c-42a8-be94-a916207f00ff None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:41.650595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfd44e-c77c-42a8-be94-a916207f00ff None admin] PATH_INFO: `/v3/users/74c75ff8f6844ce48de3f604ab4a5839` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:41.652749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfd44e-c77c-42a8-be94-a916207f00ff None admin] RBAC: Authorizing `identity:get_user(user_id=74c75ff8f6844ce48de3f604ab4a5839)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:41.654432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfd44e-c77c-42a8-be94-a916207f00ff None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:41.656507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 165/332] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:41 2022] GET /identity/v3/users/74c75ff8f6844ce48de3f604ab4a5839 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:41.662137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfd44e-c77c-42a8-be94-a916207f00ff None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:41.688631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:41.735979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b1016-c655-4482-9896-3724788d931a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:41.777328 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e363b-4c1a-4eb4-a46b-80b743cadd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:41.777982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e363b-4c1a-4eb4-a46b-80b743cadd86 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:41.778272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e363b-4c1a-4eb4-a46b-80b743cadd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:41.778532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e363b-4c1a-4eb4-a46b-80b743cadd86 None admin] PATH_INFO: `/v3/system/users/b898d4a573ee4806b82f97a3e77aee47/roles/084b5d87c17e4247b4ce7fae2c691632` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:41.780392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e363b-4c1a-4eb4-a46b-80b743cadd86 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b898d4a573ee4806b82f97a3e77aee47, role_id=084b5d87c17e4247b4ce7fae2c691632)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:41.781767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e363b-4c1a-4eb4-a46b-80b743cadd86 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:41.791962 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:41.803408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfd44e-c77c-42a8-be94-a916207f00ff None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:41.837176 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762aea0-6841-413a-b6b3-181f4bcc3fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:41.838382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762aea0-6841-413a-b6b3-181f4bcc3fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:41.838770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762aea0-6841-413a-b6b3-181f4bcc3fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:41.838991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762aea0-6841-413a-b6b3-181f4bcc3fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:41.839714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762aea0-6841-413a-b6b3-181f4bcc3fc4 None admin] RBAC: Adding query filter params (role.id=c071e1d121a643a48556e6287cde21c0, user.id=74c75ff8f6844ce48de3f604ab4a5839, scope.system=all) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:41.840046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762aea0-6841-413a-b6b3-181f4bcc3fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:41.841463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762aea0-6841-413a-b6b3-181f4bcc3fc4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:41.854513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 168/333] 10.222.0.33 () {58 vars in 1334 bytes} [Tue Oct 4 10:13:41 2022] PUT /identity/v3/system/users/b898d4a573ee4806b82f97a3e77aee47/roles/084b5d87c17e4247b4ce7fae2c691632 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:41.857443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 166/334] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Oct 4 10:13:41 2022] GET /identity/v3/role_assignments?user.id=74c75ff8f6844ce48de3f604ab4a5839&scope.system=all&role.id=c071e1d121a643a48556e6287cde21c0 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:44.073283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d28a8-3dab-4847-8bca-153eb36a0579 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:44.074300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d28a8-3dab-4847-8bca-153eb36a0579 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:44.074784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d28a8-3dab-4847-8bca-153eb36a0579 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:44.076385 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 169/335] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:44.084588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b9290-69b7-4ec3-aa7f-58df38c27b48 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:44.085468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b9290-69b7-4ec3-aa7f-58df38c27b48 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:44.085949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b9290-69b7-4ec3-aa7f-58df38c27b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:44.109317 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4a3b9290-69b7-4ec3-aa7f-58df38c27b48 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:44.110840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4a3b9290-69b7-4ec3-aa7f-58df38c27b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:44.168049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afd5ad-a8d5-4e46-bcc8-a37233d73759 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:44.168049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afd5ad-a8d5-4e46-bcc8-a37233d73759 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:44.168049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afd5ad-a8d5-4e46-bcc8-a37233d73759 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:44.168049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 170/336] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:44.172474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a9a17-bc4e-4354-8336-7a2f5e222be8 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:44.172751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a9a17-bc4e-4354-8336-7a2f5e222be8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:44.173020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a9a17-bc4e-4354-8336-7a2f5e222be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:44.197211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 167/337] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:44.215070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-8c0a9a17-bc4e-4354-8336-7a2f5e222be8 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:44.216298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8c0a9a17-bc4e-4354-8336-7a2f5e222be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:44.313068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 171/338] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:44.485670 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c014fa-d29e-438a-9c2e-cf5f0aa067fe None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:44.485972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c014fa-d29e-438a-9c2e-cf5f0aa067fe None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:44.486176 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c014fa-d29e-438a-9c2e-cf5f0aa067fe None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:44.487782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 168/339] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:44.495219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5421-3f15-4a5e-8760-5a8e4dabf2d1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:44.495489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5421-3f15-4a5e-8760-5a8e4dabf2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:44.495760 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5421-3f15-4a5e-8760-5a8e4dabf2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:44.525503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5ccc5421-3f15-4a5e-8760-5a8e4dabf2d1 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:44.526703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5ccc5421-3f15-4a5e-8760-5a8e4dabf2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:44.535773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c014fa-d29e-438a-9c2e-cf5f0aa067fe None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:44.596378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:44.617940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 172/340] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:44.691210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:44.720638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c014fa-d29e-438a-9c2e-cf5f0aa067fe None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:44.756978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513683a1-b7b1-4f07-bee7-7e3dba765108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:44.757528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513683a1-b7b1-4f07-bee7-7e3dba765108 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:44.757804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513683a1-b7b1-4f07-bee7-7e3dba765108 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:44.758088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513683a1-b7b1-4f07-bee7-7e3dba765108 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:44.773561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513683a1-b7b1-4f07-bee7-7e3dba765108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:44.777374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5421-3f15-4a5e-8760-5a8e4dabf2d1 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-513683a1-b7b1-4f07-bee7-7e3dba765108 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:44.778949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:44.779882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:44.780777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 169/341] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:13:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:44.785866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513683a1-b7b1-4f07-bee7-7e3dba765108 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:44.980622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5421-3f15-4a5e-8760-5a8e4dabf2d1 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:44.984338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513683a1-b7b1-4f07-bee7-7e3dba765108 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:45.046404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf6a82-5a53-4724-a8f3-ae0d15ad5cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:45.046938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6a82-5a53-4724-a8f3-ae0d15ad5cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:45.047214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6a82-5a53-4724-a8f3-ae0d15ad5cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:45.047485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6a82-5a53-4724-a8f3-ae0d15ad5cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:45.049045 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf6a82-5a53-4724-a8f3-ae0d15ad5cb1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:45.049340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf6a82-5a53-4724-a8f3-ae0d15ad5cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:45.050704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf6a82-5a53-4724-a8f3-ae0d15ad5cb1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:45.061188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c399f0-3079-4428-92ad-4c957473933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:45.063990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c399f0-3079-4428-92ad-4c957473933d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:45.063990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c399f0-3079-4428-92ad-4c957473933d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:45.063990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c399f0-3079-4428-92ad-4c957473933d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:45.064250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 170/342] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:13:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:45.064808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf6a82-5a53-4724-a8f3-ae0d15ad5cb1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:45.070100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:45.083081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c399f0-3079-4428-92ad-4c957473933d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d3c399f0-3079-4428-92ad-4c957473933d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:45.088325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:45.089201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:45.090002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:45.090002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:45.090002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:45.090002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:45.090002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:45.090002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:45.090002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:45.090002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:45.090002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:45.090002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:45.090002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:45.090002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:45.093954 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 173/343] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:13:45.094824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c399f0-3079-4428-92ad-4c957473933d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:45.156074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:45.189144 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf6a82-5a53-4724-a8f3-ae0d15ad5cb1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:45.217650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c399f0-3079-4428-92ad-4c957473933d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:45.230356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b5401-9216-4873-bce7-729912d0ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:45.231264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b5401-9216-4873-bce7-729912d0ff86 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:45.231547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b5401-9216-4873-bce7-729912d0ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:45.231821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b5401-9216-4873-bce7-729912d0ff86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:45.244171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b5401-9216-4873-bce7-729912d0ff86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-073b5401-9216-4873-bce7-729912d0ff86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:45.249568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:45.250490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 171/344] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:45.251817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b5401-9216-4873-bce7-729912d0ff86 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:45.263599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba931b-1830-4a75-805e-8bbeb5cd0b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:45.264284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba931b-1830-4a75-805e-8bbeb5cd0b3d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:45.264561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba931b-1830-4a75-805e-8bbeb5cd0b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:45.264885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba931b-1830-4a75-805e-8bbeb5cd0b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:45.331141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:45.357450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba931b-1830-4a75-805e-8bbeb5cd0b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:45.359670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba931b-1830-4a75-805e-8bbeb5cd0b3d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:45.392438 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b5401-9216-4873-bce7-729912d0ff86 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:45.415997 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:45.438210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b577cf-7d73-48fa-843e-29ffafeea477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:45.439060 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b577cf-7d73-48fa-843e-29ffafeea477 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:45.439501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b577cf-7d73-48fa-843e-29ffafeea477 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:45.439921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b577cf-7d73-48fa-843e-29ffafeea477 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:45.440972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b577cf-7d73-48fa-843e-29ffafeea477 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:45.441427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b577cf-7d73-48fa-843e-29ffafeea477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:45.442949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b577cf-7d73-48fa-843e-29ffafeea477 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:45.452745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 172/345] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:45.454706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85662e-e566-49f6-a4e5-b043a98eda34 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:45.455162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85662e-e566-49f6-a4e5-b043a98eda34 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:45.455865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85662e-e566-49f6-a4e5-b043a98eda34 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:45.457648 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 173/346] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:45.459661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85662e-e566-49f6-a4e5-b043a98eda34 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:45.476514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 174/347] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:45.477480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba931b-1830-4a75-805e-8bbeb5cd0b3d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:45.585833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba931b-1830-4a75-805e-8bbeb5cd0b3d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:45.590411 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85662e-e566-49f6-a4e5-b043a98eda34 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:45.627300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:45.638831 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaeaae-fb37-4da2-91dd-3a9112c9d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:45.640911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660433e-7f09-413f-bcbd-b736e582362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:45.641037 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaeaae-fb37-4da2-91dd-3a9112c9d52a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:45.641116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660433e-7f09-413f-bcbd-b736e582362e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:45.641192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaeaae-fb37-4da2-91dd-3a9112c9d52a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:45.641262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660433e-7f09-413f-bcbd-b736e582362e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:45.641342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaeaae-fb37-4da2-91dd-3a9112c9d52a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:45.641417 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660433e-7f09-413f-bcbd-b736e582362e None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:45.642406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660433e-7f09-413f-bcbd-b736e582362e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:45.642781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660433e-7f09-413f-bcbd-b736e582362e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:45.644467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660433e-7f09-413f-bcbd-b736e582362e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:45.656586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 174/348] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:45.658241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63a6dd-5ec1-4587-9a04-f4b439c32341 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:45.658587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63a6dd-5ec1-4587-9a04-f4b439c32341 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:45.659359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63a6dd-5ec1-4587-9a04-f4b439c32341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:45.664896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:45.684144 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4e63a6dd-5ec1-4587-9a04-f4b439c32341 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:45.685505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4e63a6dd-5ec1-4587-9a04-f4b439c32341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:45.731584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaeaae-fb37-4da2-91dd-3a9112c9d52a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:45.733233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaeaae-fb37-4da2-91dd-3a9112c9d52a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:45.771676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 175/349] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:45.772912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63a6dd-5ec1-4587-9a04-f4b439c32341 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:45.840142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 175/350] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:45.841076 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaeaae-fb37-4da2-91dd-3a9112c9d52a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:45.900046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63a6dd-5ec1-4587-9a04-f4b439c32341 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:45.920912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:45.922985 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:45.942311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3a2ae-001f-4238-b28b-8ed36f2d874a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:45.943643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3a2ae-001f-4238-b28b-8ed36f2d874a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:45.943643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3a2ae-001f-4238-b28b-8ed36f2d874a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:45.943643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3a2ae-001f-4238-b28b-8ed36f2d874a None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:45.944795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3a2ae-001f-4238-b28b-8ed36f2d874a None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:45.946284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3a2ae-001f-4238-b28b-8ed36f2d874a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:45.948095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 176/351] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:45 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:45.949447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddcab6-9283-41a1-adac-0b2c3520d2f8 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:45.949608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddcab6-9283-41a1-adac-0b2c3520d2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:45.949973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddcab6-9283-41a1-adac-0b2c3520d2f8 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:45.951484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 177/352] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:45.952298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddcab6-9283-41a1-adac-0b2c3520d2f8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:45.966930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaeaae-fb37-4da2-91dd-3a9112c9d52a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:46.006484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd86b02-a512-4332-a041-68513eab0d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:46.007513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd86b02-a512-4332-a041-68513eab0d25 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:46.008092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd86b02-a512-4332-a041-68513eab0d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:46.008589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd86b02-a512-4332-a041-68513eab0d25 None admin] PATH_INFO: `/v3/users/b898d4a573ee4806b82f97a3e77aee47` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:46.010049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd86b02-a512-4332-a041-68513eab0d25 None admin] RBAC: Authorizing `identity:get_user(user_id=b898d4a573ee4806b82f97a3e77aee47)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:46.011760 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd86b02-a512-4332-a041-68513eab0d25 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:46.013667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 176/353] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:13:45 2022] GET /identity/v3/users/b898d4a573ee4806b82f97a3e77aee47 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:46.015176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79321e7-c5eb-42ef-add7-45aafa8d7021 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:46.015699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79321e7-c5eb-42ef-add7-45aafa8d7021 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:46.016190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79321e7-c5eb-42ef-add7-45aafa8d7021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:46.036076 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c79321e7-c5eb-42ef-add7-45aafa8d7021 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:46.038629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c79321e7-c5eb-42ef-add7-45aafa8d7021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:46.066808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddcab6-9283-41a1-adac-0b2c3520d2f8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:46.107360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a712c4d-5d0b-4b20-b180-206a65736710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:46.107927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a712c4d-5d0b-4b20-b180-206a65736710 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:46.108604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a712c4d-5d0b-4b20-b180-206a65736710 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:46.108889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a712c4d-5d0b-4b20-b180-206a65736710 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:46.112305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a712c4d-5d0b-4b20-b180-206a65736710 None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:46.112990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a712c4d-5d0b-4b20-b180-206a65736710 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:46.115554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 177/354] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:46.116019 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 178/355] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:45 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:46.116119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79321e7-c5eb-42ef-add7-45aafa8d7021 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:46.116204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a712c4d-5d0b-4b20-b180-206a65736710 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:46.195059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:46.220350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:46.255975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a712c4d-5d0b-4b20-b180-206a65736710 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:46.311471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79321e7-c5eb-42ef-add7-45aafa8d7021 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:46.316716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cb627-1a47-4e9c-9e01-9341cbc2adb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:46.319982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cb627-1a47-4e9c-9e01-9341cbc2adb9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:46.319982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cb627-1a47-4e9c-9e01-9341cbc2adb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:46.319982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cb627-1a47-4e9c-9e01-9341cbc2adb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:46.319982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cb627-1a47-4e9c-9e01-9341cbc2adb9 None admin] RBAC: Adding query filter params (role.id=084b5d87c17e4247b4ce7fae2c691632, user.id=b898d4a573ee4806b82f97a3e77aee47, scope.system=all) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:46.319982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cb627-1a47-4e9c-9e01-9341cbc2adb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:46.325471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cb627-1a47-4e9c-9e01-9341cbc2adb9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:46.346724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 179/356] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Oct 4 10:13:46 2022] GET /identity/v3/role_assignments?user.id=b898d4a573ee4806b82f97a3e77aee47&scope.system=all&role.id=084b5d87c17e4247b4ce7fae2c691632 => generated 510 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:46.348139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cb627-1a47-4e9c-9e01-9341cbc2adb9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:46.396026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fff94d-868b-494b-be22-81c4cdbbc8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:46.396692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fff94d-868b-494b-be22-81c4cdbbc8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:46.396971 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fff94d-868b-494b-be22-81c4cdbbc8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:46.397239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fff94d-868b-494b-be22-81c4cdbbc8b6 None admin] PATH_INFO: `/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:46.414205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fff94d-868b-494b-be22-81c4cdbbc8b6 None admin] RBAC: Authorizing `identity:get_group(group_id=891eb23ebd9c4de2b3ab569c9afb55d8)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:46.416270 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fff94d-868b-494b-be22-81c4cdbbc8b6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:46.422396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 178/357] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:46 2022] GET /identity/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8 => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:46.423273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fff94d-868b-494b-be22-81c4cdbbc8b6 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:46.543296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cb627-1a47-4e9c-9e01-9341cbc2adb9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:46.560496 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:46.605135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1677417-b2ff-470e-aba5-ae9550bd6a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:46.605967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1677417-b2ff-470e-aba5-ae9550bd6a53 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:46.606251 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1677417-b2ff-470e-aba5-ae9550bd6a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:46.606520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1677417-b2ff-470e-aba5-ae9550bd6a53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:46.614144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fff94d-868b-494b-be22-81c4cdbbc8b6 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:46.621630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1677417-b2ff-470e-aba5-ae9550bd6a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-c1677417-b2ff-470e-aba5-ae9550bd6a53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:46.627989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:46.628912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:46.629781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:46.629781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:46.629781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:46.629781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:46.629781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:46.629781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:46.629781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:46.629781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:46.629781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:46.629781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:46.629781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:46.629781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:46.630379 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 180/358] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:46.633790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1677417-b2ff-470e-aba5-ae9550bd6a53 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:46.636444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:46.683447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebdc55-59bc-45d0-8c3d-e43bff0704d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:46.684350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebdc55-59bc-45d0-8c3d-e43bff0704d1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:46.684981 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebdc55-59bc-45d0-8c3d-e43bff0704d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:46.685538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebdc55-59bc-45d0-8c3d-e43bff0704d1 None admin] PATH_INFO: `/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:46.686971 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebdc55-59bc-45d0-8c3d-e43bff0704d1 None admin] RBAC: Authorizing `identity:get_group(group_id=891eb23ebd9c4de2b3ab569c9afb55d8)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:46.689146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebdc55-59bc-45d0-8c3d-e43bff0704d1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:46.690732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 179/359] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:46 2022] GET /identity/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:46.692487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebdc55-59bc-45d0-8c3d-e43bff0704d1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:46.768610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1677417-b2ff-470e-aba5-ae9550bd6a53 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:46.809329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645e19e-6458-4047-be50-b4630eed104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:46.810289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645e19e-6458-4047-be50-b4630eed104c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:46.810862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645e19e-6458-4047-be50-b4630eed104c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:46.811141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645e19e-6458-4047-be50-b4630eed104c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:46.811882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645e19e-6458-4047-be50-b4630eed104c None admin] RBAC: Adding query filter params (group.id=891eb23ebd9c4de2b3ab569c9afb55d8, role.id=f63ab1c53b2e4aa0bf00e4798908cbfb, scope.project.id=df0f459e95f141488f03abcb8bea472c) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:46.812262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645e19e-6458-4047-be50-b4630eed104c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:46.813704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645e19e-6458-4047-be50-b4630eed104c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:46.814620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebdc55-59bc-45d0-8c3d-e43bff0704d1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:46.819610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 181/360] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 10:13:46 2022] GET /identity/v3/role_assignments?group.id=891eb23ebd9c4de2b3ab569c9afb55d8&scope.project.id=df0f459e95f141488f03abcb8bea472c&role.id=f63ab1c53b2e4aa0bf00e4798908cbfb => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:46.820929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88cc6b-73d6-4763-9910-63e1cb47c55d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:46.821211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88cc6b-73d6-4763-9910-63e1cb47c55d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:46.821482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88cc6b-73d6-4763-9910-63e1cb47c55d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:46.822888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 182/361] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:46.827669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88cc6b-73d6-4763-9910-63e1cb47c55d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:46.873948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b58de-48c7-499f-97fa-cf10e1df7b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:46.874593 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b58de-48c7-499f-97fa-cf10e1df7b17 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:46.874892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b58de-48c7-499f-97fa-cf10e1df7b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:46.875132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b58de-48c7-499f-97fa-cf10e1df7b17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:46.883371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:46.888319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b58de-48c7-499f-97fa-cf10e1df7b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-6d4b58de-48c7-499f-97fa-cf10e1df7b17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:46.894294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:46.899070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 180/362] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:13:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:46.900573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b58de-48c7-499f-97fa-cf10e1df7b17 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:46.956145 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:47.013237 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88cc6b-73d6-4763-9910-63e1cb47c55d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:47.044690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b58de-48c7-499f-97fa-cf10e1df7b17 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:47.052452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715d95c-281f-4db4-af32-8a21c7c44117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:47.053054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715d95c-281f-4db4-af32-8a21c7c44117 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:47.053333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715d95c-281f-4db4-af32-8a21c7c44117 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:47.053594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715d95c-281f-4db4-af32-8a21c7c44117 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:47.054258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715d95c-281f-4db4-af32-8a21c7c44117 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:47.054603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715d95c-281f-4db4-af32-8a21c7c44117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:47.055968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715d95c-281f-4db4-af32-8a21c7c44117 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:47.068371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 183/363] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:47.069216 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6266a92-279f-4bfb-ac4e-d33094b07dd5 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:47.069495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6266a92-279f-4bfb-ac4e-d33094b07dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:47.069763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6266a92-279f-4bfb-ac4e-d33094b07dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:47.087669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b6266a92-279f-4bfb-ac4e-d33094b07dd5 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:47.089124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b6266a92-279f-4bfb-ac4e-d33094b07dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:47.094144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee4d0f-fa16-416e-b33c-1f112cd59fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:47.095085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee4d0f-fa16-416e-b33c-1f112cd59fff None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:47.095577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee4d0f-fa16-416e-b33c-1f112cd59fff None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:47.096086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee4d0f-fa16-416e-b33c-1f112cd59fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:47.097446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee4d0f-fa16-416e-b33c-1f112cd59fff None admin] RBAC: Adding query filter params (group.id=891eb23ebd9c4de2b3ab569c9afb55d8, role.id=c071e1d121a643a48556e6287cde21c0, scope.project.id=df0f459e95f141488f03abcb8bea472c) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:47.097961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee4d0f-fa16-416e-b33c-1f112cd59fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:47.100036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee4d0f-fa16-416e-b33c-1f112cd59fff None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:47.108732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 181/364] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 10:13:46 2022] GET /identity/v3/role_assignments?group.id=891eb23ebd9c4de2b3ab569c9afb55d8&scope.project.id=df0f459e95f141488f03abcb8bea472c&role.id=c071e1d121a643a48556e6287cde21c0 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:47.110298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee4d0f-fa16-416e-b33c-1f112cd59fff None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:47.189650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 184/365] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:47.190600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6266a92-279f-4bfb-ac4e-d33094b07dd5 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:47.225385 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:47.257849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee4d0f-fa16-416e-b33c-1f112cd59fff None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:47.260395 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:47.307474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d228c7-7ccf-40f9-ad53-998e6cbd6b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:47.308745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d228c7-7ccf-40f9-ad53-998e6cbd6b9d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:47.309357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d228c7-7ccf-40f9-ad53-998e6cbd6b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:47.309825 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d228c7-7ccf-40f9-ad53-998e6cbd6b9d None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:47.310950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d228c7-7ccf-40f9-ad53-998e6cbd6b9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:47.311261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d228c7-7ccf-40f9-ad53-998e6cbd6b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:47.315174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d228c7-7ccf-40f9-ad53-998e6cbd6b9d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:47.320120 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6266a92-279f-4bfb-ac4e-d33094b07dd5 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:47.328158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 182/366] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:13:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:47.332534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d228c7-7ccf-40f9-ad53-998e6cbd6b9d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:47.361098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b57f7-9bf8-4cf2-93fe-250b95408527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:47.362749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b57f7-9bf8-4cf2-93fe-250b95408527 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:47.363354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b57f7-9bf8-4cf2-93fe-250b95408527 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:47.363992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b57f7-9bf8-4cf2-93fe-250b95408527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:47.444299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b57f7-9bf8-4cf2-93fe-250b95408527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:47.446096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b57f7-9bf8-4cf2-93fe-250b95408527 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:47.472724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d228c7-7ccf-40f9-ad53-998e6cbd6b9d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:47.479513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:47.522457 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9228e23-393b-4edc-a242-13327f468242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:47.523103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9228e23-393b-4edc-a242-13327f468242 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:47.523382 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9228e23-393b-4edc-a242-13327f468242 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:47.523658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9228e23-393b-4edc-a242-13327f468242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:47.577921 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:47.589309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 185/367] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:47.597612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b57f7-9bf8-4cf2-93fe-250b95408527 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:47.632042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9228e23-393b-4edc-a242-13327f468242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:47.633624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9228e23-393b-4edc-a242-13327f468242 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:47.716035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b57f7-9bf8-4cf2-93fe-250b95408527 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:47.748116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:47.752407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 183/368] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:47.753564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9228e23-393b-4edc-a242-13327f468242 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:47.758842 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e2784-8ced-4018-a50d-23d27dace57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:47.759616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e2784-8ced-4018-a50d-23d27dace57f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:47.759978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e2784-8ced-4018-a50d-23d27dace57f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:47.760342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e2784-8ced-4018-a50d-23d27dace57f None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:47.761562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e2784-8ced-4018-a50d-23d27dace57f None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:47.763052 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e2784-8ced-4018-a50d-23d27dace57f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:47.765266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 186/369] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:47 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:47.768761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e2784-8ced-4018-a50d-23d27dace57f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:47.848370 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:47.871596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9228e23-393b-4edc-a242-13327f468242 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:47.883547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e2784-8ced-4018-a50d-23d27dace57f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:47.911140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1cd61-62b3-42e0-9da9-b206e7d40d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:47.912166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1cd61-62b3-42e0-9da9-b206e7d40d7f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:47.912744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1cd61-62b3-42e0-9da9-b206e7d40d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:47.913243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1cd61-62b3-42e0-9da9-b206e7d40d7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:47.926280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df3b2d-1f49-48ac-9eee-2aaa06d5d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:47.926916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df3b2d-1f49-48ac-9eee-2aaa06d5d30c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:47.927193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df3b2d-1f49-48ac-9eee-2aaa06d5d30c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:47.927462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df3b2d-1f49-48ac-9eee-2aaa06d5d30c None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:47.928813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df3b2d-1f49-48ac-9eee-2aaa06d5d30c None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:47.929021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1cd61-62b3-42e0-9da9-b206e7d40d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:47.930715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df3b2d-1f49-48ac-9eee-2aaa06d5d30c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:47.935076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 187/370] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:47 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:47.935076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df3b2d-1f49-48ac-9eee-2aaa06d5d30c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-9ae1cd61-62b3-42e0-9da9-b206e7d40d7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:47.940360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:47.941261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:47.942105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:47.942105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:47.942105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:47.942105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:47.942105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:47.942105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:47.942105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:47.942105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:47.942105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:47.942105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:47.942105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:47.942105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:47.944551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 184/371] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:13:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:47.945668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1cd61-62b3-42e0-9da9-b206e7d40d7f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:48.010413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:48.064630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df3b2d-1f49-48ac-9eee-2aaa06d5d30c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:48.076469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1cd61-62b3-42e0-9da9-b206e7d40d7f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:48.108392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:48.108848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b5aa1-7f1b-4176-959c-65befe085fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:48.109739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b5aa1-7f1b-4176-959c-65befe085fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:48.110216 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b5aa1-7f1b-4176-959c-65befe085fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:48.110723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b5aa1-7f1b-4176-959c-65befe085fd1 None admin] PATH_INFO: `/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:48.112262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b5aa1-7f1b-4176-959c-65befe085fd1 None admin] RBAC: Authorizing `identity:get_group(group_id=891eb23ebd9c4de2b3ab569c9afb55d8)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:48.114026 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b5aa1-7f1b-4176-959c-65befe085fd1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:48.115983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 188/372] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:47 2022] GET /identity/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:48.119728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b5aa1-7f1b-4176-959c-65befe085fd1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:48.126359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41572d-c71e-413c-9d5b-2bcc76be7740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:48.127258 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41572d-c71e-413c-9d5b-2bcc76be7740 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:48.127532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41572d-c71e-413c-9d5b-2bcc76be7740 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:48.127801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41572d-c71e-413c-9d5b-2bcc76be7740 None admin] PATH_INFO: `/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:48.133681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41572d-c71e-413c-9d5b-2bcc76be7740 None admin] RBAC: Authorizing `identity:get_group(group_id=891eb23ebd9c4de2b3ab569c9afb55d8)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:48.136961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41572d-c71e-413c-9d5b-2bcc76be7740 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:48.139528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 185/373] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:47 2022] GET /identity/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:48.141267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41572d-c71e-413c-9d5b-2bcc76be7740 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:48.265202 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b5aa1-7f1b-4176-959c-65befe085fd1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:48.289494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41572d-c71e-413c-9d5b-2bcc76be7740 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:48.308604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:48.317477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b959f9-06cd-42d1-ae95-356bc6dceba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:48.320376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b959f9-06cd-42d1-ae95-356bc6dceba5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:48.320715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b959f9-06cd-42d1-ae95-356bc6dceba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:48.321046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b959f9-06cd-42d1-ae95-356bc6dceba5 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:48.325838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b959f9-06cd-42d1-ae95-356bc6dceba5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:48.325838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b959f9-06cd-42d1-ae95-356bc6dceba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:48.325838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b959f9-06cd-42d1-ae95-356bc6dceba5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:48.336859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 189/374] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:48.338045 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b959f9-06cd-42d1-ae95-356bc6dceba5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:48.338764 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801e1c-0c60-46f9-84d7-f7454dde2539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:48.339537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801e1c-0c60-46f9-84d7-f7454dde2539 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:48.339990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801e1c-0c60-46f9-84d7-f7454dde2539 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:48.340396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801e1c-0c60-46f9-84d7-f7454dde2539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:48.341455 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a801e1c-0c60-46f9-84d7-f7454dde2539 None admin] RBAC: Adding query filter params (group.id=891eb23ebd9c4de2b3ab569c9afb55d8, role.id=c071e1d121a643a48556e6287cde21c0, scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:48.342170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a801e1c-0c60-46f9-84d7-f7454dde2539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:48.346051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a801e1c-0c60-46f9-84d7-f7454dde2539 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:48.356335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 186/375] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 10:13:48 2022] GET /identity/v3/role_assignments?group.id=891eb23ebd9c4de2b3ab569c9afb55d8&scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197&role.id=c071e1d121a643a48556e6287cde21c0 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:48.356910 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801e1c-0c60-46f9-84d7-f7454dde2539 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:48.426866 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:48.480103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801e1c-0c60-46f9-84d7-f7454dde2539 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:48.522206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0a385-82f3-44d2-bff7-ef23fb37b32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:48.522755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0a385-82f3-44d2-bff7-ef23fb37b32e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:48.523031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0a385-82f3-44d2-bff7-ef23fb37b32e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:48.523302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0a385-82f3-44d2-bff7-ef23fb37b32e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:48.585941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b959f9-06cd-42d1-ae95-356bc6dceba5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:48.603999 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0a385-82f3-44d2-bff7-ef23fb37b32e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:48.605453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0a385-82f3-44d2-bff7-ef23fb37b32e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:48.678216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:48.717384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 187/376] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:48.724424 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0a385-82f3-44d2-bff7-ef23fb37b32e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:48.729347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874714a9-b7f1-4889-85cb-3704e89a73cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:48.729968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874714a9-b7f1-4889-85cb-3704e89a73cf None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:48.730245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874714a9-b7f1-4889-85cb-3704e89a73cf None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:48.730517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874714a9-b7f1-4889-85cb-3704e89a73cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:48.731249 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874714a9-b7f1-4889-85cb-3704e89a73cf None admin] RBAC: Adding query filter params (group.id=891eb23ebd9c4de2b3ab569c9afb55d8, role.id=f63ab1c53b2e4aa0bf00e4798908cbfb, scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:48.731554 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874714a9-b7f1-4889-85cb-3704e89a73cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:48.732997 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874714a9-b7f1-4889-85cb-3704e89a73cf None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:48.746049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 190/377] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 10:13:48 2022] GET /identity/v3/role_assignments?group.id=891eb23ebd9c4de2b3ab569c9afb55d8&scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197&role.id=f63ab1c53b2e4aa0bf00e4798908cbfb => generated 260 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:48.867417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0a385-82f3-44d2-bff7-ef23fb37b32e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:48.934045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5da15b-326c-4982-bc9a-dc3974143049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:48.934721 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5da15b-326c-4982-bc9a-dc3974143049 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:48.934994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5da15b-326c-4982-bc9a-dc3974143049 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:48.935261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5da15b-326c-4982-bc9a-dc3974143049 None admin] PATH_INFO: `/v3/projects/e736e1303d7f49068590b8ec9f283f71` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:48.940830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5da15b-326c-4982-bc9a-dc3974143049 None admin] RBAC: Authorizing `identity:get_project(project_id=e736e1303d7f49068590b8ec9f283f71)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:48.942319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5da15b-326c-4982-bc9a-dc3974143049 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:48.944441 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 188/378] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:48 2022] GET /identity/v3/projects/e736e1303d7f49068590b8ec9f283f71 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:48.950151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874714a9-b7f1-4889-85cb-3704e89a73cf None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:49.031599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:49.078181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874714a9-b7f1-4889-85cb-3704e89a73cf None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:49.124677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9950bf-5be8-4b13-827a-b71ff936988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:49.125602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9950bf-5be8-4b13-827a-b71ff936988d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:49.125881 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9950bf-5be8-4b13-827a-b71ff936988d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:49.126154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9950bf-5be8-4b13-827a-b71ff936988d None admin] PATH_INFO: `/v3/groups/92e4eecf96d94ee9aae5331048cb2250` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:49.136895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9950bf-5be8-4b13-827a-b71ff936988d None admin] RBAC: Authorizing `identity:get_group(group_id=92e4eecf96d94ee9aae5331048cb2250)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:49.138326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9950bf-5be8-4b13-827a-b71ff936988d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:49.140041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 191/379] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:48 2022] GET /identity/v3/groups/92e4eecf96d94ee9aae5331048cb2250 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:49.145810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5da15b-326c-4982-bc9a-dc3974143049 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:49.175638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:49.285234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5da15b-326c-4982-bc9a-dc3974143049 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:49.332840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb9e5c-8364-42d5-ac1d-2a8540218ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:49.333488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb9e5c-8364-42d5-ac1d-2a8540218ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:49.333728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb9e5c-8364-42d5-ac1d-2a8540218ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:49.334002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb9e5c-8364-42d5-ac1d-2a8540218ef9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:49.334726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb9e5c-8364-42d5-ac1d-2a8540218ef9 None admin] RBAC: Adding query filter params (group.id=92e4eecf96d94ee9aae5331048cb2250, role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=e736e1303d7f49068590b8ec9f283f71) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:49.335031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb9e5c-8364-42d5-ac1d-2a8540218ef9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:49.336480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb9e5c-8364-42d5-ac1d-2a8540218ef9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:49.348202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 189/380] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 10:13:49 2022] GET /identity/v3/role_assignments?group.id=92e4eecf96d94ee9aae5331048cb2250&scope.project.id=e736e1303d7f49068590b8ec9f283f71&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:49.725317 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa45e5-35a1-4071-b3d6-3f9645be0de3 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:49.726405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa45e5-35a1-4071-b3d6-3f9645be0de3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:49.726905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa45e5-35a1-4071-b3d6-3f9645be0de3 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:49.728819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 192/381] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:49.734624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aae86-ef3b-46a2-84ef-354bb3b0df2e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:49.734901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aae86-ef3b-46a2-84ef-354bb3b0df2e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:49.735184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aae86-ef3b-46a2-84ef-354bb3b0df2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:49.759526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-972aae86-ef3b-46a2-84ef-354bb3b0df2e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:49.760770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-972aae86-ef3b-46a2-84ef-354bb3b0df2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:49.824648 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c82471-783b-4492-a526-ee917e201d35 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:49.825282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c82471-783b-4492-a526-ee917e201d35 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:49.825765 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c82471-783b-4492-a526-ee917e201d35 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:49.827426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 193/382] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:13:49.836937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a52131-0194-4250-854b-e3c575c7f165 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:49.838295 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a52131-0194-4250-854b-e3c575c7f165 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:49.838789 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a52131-0194-4250-854b-e3c575c7f165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:49.851719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 190/383] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:49.870239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-56a52131-0194-4250-854b-e3c575c7f165 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:49.871960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-56a52131-0194-4250-854b-e3c575c7f165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:49.969383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 194/384] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:50.258227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aae86-ef3b-46a2-84ef-354bb3b0df2e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:50.280412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:50.332821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a52131-0194-4250-854b-e3c575c7f165 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:50.376593 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aae86-ef3b-46a2-84ef-354bb3b0df2e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:50.430892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1a84c-f034-48ba-9d7e-0048c14ba89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:50.432776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1a84c-f034-48ba-9d7e-0048c14ba89e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:50.433053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1a84c-f034-48ba-9d7e-0048c14ba89e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:50.433316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1a84c-f034-48ba-9d7e-0048c14ba89e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:50.449437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:50.457911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1a84c-f034-48ba-9d7e-0048c14ba89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-87e1a84c-f034-48ba-9d7e-0048c14ba89e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:50.466900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:50.468253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:50.469266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:50.469266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:50.469266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:50.469266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:50.469266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:50.469266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:50.469266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:50.469266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:50.469266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:50.469266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:50.469266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:50.469266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:50.471694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 191/385] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:50.477516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1a84c-f034-48ba-9d7e-0048c14ba89e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:50.558889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a52131-0194-4250-854b-e3c575c7f165 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:50.583614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:50.627126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1a84c-f034-48ba-9d7e-0048c14ba89e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:50.629830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee162ca-05c7-43d3-8d03-305e39c9822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:50.630671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee162ca-05c7-43d3-8d03-305e39c9822f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:50.631109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee162ca-05c7-43d3-8d03-305e39c9822f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:50.631537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee162ca-05c7-43d3-8d03-305e39c9822f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:50.656711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee162ca-05c7-43d3-8d03-305e39c9822f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2ee162ca-05c7-43d3-8d03-305e39c9822f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:50.662167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:50.663324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:50.664364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:50.664364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:50.664364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:50.664364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:50.664364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:50.664364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:50.664364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:50.664364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:50.664364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:50.664364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:50.664364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:50.664364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:50.675126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 195/386] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:13:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:13:50.680909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee162ca-05c7-43d3-8d03-305e39c9822f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:50.710025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b165f-b0cd-46cd-aae0-728491101560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:50.710875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b165f-b0cd-46cd-aae0-728491101560 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:50.711330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b165f-b0cd-46cd-aae0-728491101560 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:50.715379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b165f-b0cd-46cd-aae0-728491101560 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:50.716162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b165f-b0cd-46cd-aae0-728491101560 None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:50.716472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b165f-b0cd-46cd-aae0-728491101560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:50.717838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b165f-b0cd-46cd-aae0-728491101560 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:50.726647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 192/387] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:50.733605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b165f-b0cd-46cd-aae0-728491101560 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:50.863344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee162ca-05c7-43d3-8d03-305e39c9822f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:50.892689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:50.933440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b165f-b0cd-46cd-aae0-728491101560 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:50.936065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf6da4-90a3-47e2-a2c6-92f89e6a1a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:50.936688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf6da4-90a3-47e2-a2c6-92f89e6a1a72 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:50.936963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf6da4-90a3-47e2-a2c6-92f89e6a1a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:50.937235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf6da4-90a3-47e2-a2c6-92f89e6a1a72 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:50.937915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf6da4-90a3-47e2-a2c6-92f89e6a1a72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:50.938217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf6da4-90a3-47e2-a2c6-92f89e6a1a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:50.939594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf6da4-90a3-47e2-a2c6-92f89e6a1a72 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:50.959211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 196/388] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:13:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:50.965062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf6da4-90a3-47e2-a2c6-92f89e6a1a72 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:51.020300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90810bd5-a228-4040-901b-6bd3a9832486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:51.020951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90810bd5-a228-4040-901b-6bd3a9832486 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:51.021229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90810bd5-a228-4040-901b-6bd3a9832486 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:51.021499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90810bd5-a228-4040-901b-6bd3a9832486 None admin] PATH_INFO: `/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:51.023320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90810bd5-a228-4040-901b-6bd3a9832486 None admin] RBAC: Authorizing `identity:get_group(group_id=891eb23ebd9c4de2b3ab569c9afb55d8)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:51.024870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90810bd5-a228-4040-901b-6bd3a9832486 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:51.034015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 193/389] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:50 2022] GET /identity/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8 => generated 226 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:51.053343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90810bd5-a228-4040-901b-6bd3a9832486 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:51.068289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:51.148725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf6da4-90a3-47e2-a2c6-92f89e6a1a72 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:51.193830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c2459-441d-4f21-9504-ce3ba4c78769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:51.194890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c2459-441d-4f21-9504-ce3ba4c78769 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:51.195280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c2459-441d-4f21-9504-ce3ba4c78769 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:51.195554 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c2459-441d-4f21-9504-ce3ba4c78769 None admin] PATH_INFO: `/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:51.197302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c2459-441d-4f21-9504-ce3ba4c78769 None admin] RBAC: Authorizing `identity:get_group(group_id=891eb23ebd9c4de2b3ab569c9afb55d8)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:51.199259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c2459-441d-4f21-9504-ce3ba4c78769 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:51.200204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90810bd5-a228-4040-901b-6bd3a9832486 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:51.201149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 197/390] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:50 2022] GET /identity/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:51.202426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4746d2-cafc-4e56-8e22-4fc30e6c67c8 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:51.202703 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4746d2-cafc-4e56-8e22-4fc30e6c67c8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:51.202974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4746d2-cafc-4e56-8e22-4fc30e6c67c8 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:51.204495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 198/391] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:51.208517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4746d2-cafc-4e56-8e22-4fc30e6c67c8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:51.245699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13da20-c37f-4608-bd6a-911c2a36744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:51.246768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13da20-c37f-4608-bd6a-911c2a36744d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:51.247338 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13da20-c37f-4608-bd6a-911c2a36744d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:51.247918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13da20-c37f-4608-bd6a-911c2a36744d None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:51.249442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13da20-c37f-4608-bd6a-911c2a36744d None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:51.251095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13da20-c37f-4608-bd6a-911c2a36744d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:51.253481 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 194/392] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:51 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:51.254950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589eb39-0292-453b-95e9-062f340ef68c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:51.255448 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589eb39-0292-453b-95e9-062f340ef68c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:51.255929 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589eb39-0292-453b-95e9-062f340ef68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:51.261726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:51.277638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-2589eb39-0292-453b-95e9-062f340ef68c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:51.279305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2589eb39-0292-453b-95e9-062f340ef68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:51.335184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4746d2-cafc-4e56-8e22-4fc30e6c67c8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:51.361992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 195/393] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:51.363339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589eb39-0292-453b-95e9-062f340ef68c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:51.373029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:51.381172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a785e-afe0-4c53-9302-dd69544bd7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:51.382260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a785e-afe0-4c53-9302-dd69544bd7de None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:51.382541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a785e-afe0-4c53-9302-dd69544bd7de None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:51.382813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a785e-afe0-4c53-9302-dd69544bd7de None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:51.384472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a785e-afe0-4c53-9302-dd69544bd7de None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:51.386203 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a785e-afe0-4c53-9302-dd69544bd7de None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:51.388875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 199/394] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:51 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:51.397410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a785e-afe0-4c53-9302-dd69544bd7de None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:51.519892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589eb39-0292-453b-95e9-062f340ef68c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:51.543965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a785e-afe0-4c53-9302-dd69544bd7de None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:51.554911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:51.558388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a3b7b-cf26-4243-b5eb-4c622e7d4063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:51.559344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a3b7b-cf26-4243-b5eb-4c622e7d4063 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:51.559757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a3b7b-cf26-4243-b5eb-4c622e7d4063 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:51.560212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a3b7b-cf26-4243-b5eb-4c622e7d4063 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c/groups/891eb23ebd9c4de2b3ab569c9afb55d8/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:51.562253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a3b7b-cf26-4243-b5eb-4c622e7d4063 None admin] RBAC: Authorizing `identity:create_grant(project_id=df0f459e95f141488f03abcb8bea472c, group_id=891eb23ebd9c4de2b3ab569c9afb55d8, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:51.564008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a3b7b-cf26-4243-b5eb-4c622e7d4063 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:51.580135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c0f2f-a930-4f70-b779-e71f1809912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:51.580815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c0f2f-a930-4f70-b779-e71f1809912b None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:51.581093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c0f2f-a930-4f70-b779-e71f1809912b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:51.581366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c0f2f-a930-4f70-b779-e71f1809912b None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c/groups/891eb23ebd9c4de2b3ab569c9afb55d8/roles/f63ab1c53b2e4aa0bf00e4798908cbfb` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:51.584290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c0f2f-a930-4f70-b779-e71f1809912b None admin] RBAC: Authorizing `identity:create_grant(project_id=df0f459e95f141488f03abcb8bea472c, group_id=891eb23ebd9c4de2b3ab569c9afb55d8, role_id=f63ab1c53b2e4aa0bf00e4798908cbfb)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:51.586149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c0f2f-a930-4f70-b779-e71f1809912b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:51.641102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 196/395] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Oct 4 10:13:51 2022] PUT /identity/v3/projects/df0f459e95f141488f03abcb8bea472c/groups/891eb23ebd9c4de2b3ab569c9afb55d8/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:51.641102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01b5c7-6e5c-415e-8d7f-a6c9aec70a64 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:51.641102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01b5c7-6e5c-415e-8d7f-a6c9aec70a64 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:51.641102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01b5c7-6e5c-415e-8d7f-a6c9aec70a64 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:51.641102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 197/396] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:51.641813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01b5c7-6e5c-415e-8d7f-a6c9aec70a64 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:51.655410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 200/397] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Oct 4 10:13:51 2022] PUT /identity/v3/projects/df0f459e95f141488f03abcb8bea472c/groups/891eb23ebd9c4de2b3ab569c9afb55d8/roles/f63ab1c53b2e4aa0bf00e4798908cbfb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:51.657214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce70fac-2c49-4a20-9a64-32e51715c0be None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:51.657698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce70fac-2c49-4a20-9a64-32e51715c0be None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:51.658215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce70fac-2c49-4a20-9a64-32e51715c0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:51.688637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1ce70fac-2c49-4a20-9a64-32e51715c0be None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:51.689903 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1ce70fac-2c49-4a20-9a64-32e51715c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:51.775073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:51.818000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01b5c7-6e5c-415e-8d7f-a6c9aec70a64 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:51.861549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 201/398] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:51.862166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc8a1-3cea-42fa-a9ce-73c447a3c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:51.863215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc8a1-3cea-42fa-a9ce-73c447a3c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:51.863699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc8a1-3cea-42fa-a9ce-73c447a3c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:51.864198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc8a1-3cea-42fa-a9ce-73c447a3c3a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:51.876946 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbc8a1-3cea-42fa-a9ce-73c447a3c3a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-6efbc8a1-3cea-42fa-a9ce-73c447a3c3a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:51.881889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:51.882834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:51.883669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 198/399] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:51.889233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce70fac-2c49-4a20-9a64-32e51715c0be None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:52.001820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:52.005502 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce70fac-2c49-4a20-9a64-32e51715c0be None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:52.057819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8308827-1943-48d7-8e84-bf2511727ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:52.058361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308827-1943-48d7-8e84-bf2511727ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:52.058651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308827-1943-48d7-8e84-bf2511727ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:52.058922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308827-1943-48d7-8e84-bf2511727ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:52.059840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8308827-1943-48d7-8e84-bf2511727ec1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:52.060357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8308827-1943-48d7-8e84-bf2511727ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:52.062235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8308827-1943-48d7-8e84-bf2511727ec1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:52.075661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 202/400] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:52.081130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc8a1-3cea-42fa-a9ce-73c447a3c3a8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:52.141349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2a70d-c10d-441d-999f-2ab23502ac0d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:52.141633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2a70d-c10d-441d-999f-2ab23502ac0d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:52.141902 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2a70d-c10d-441d-999f-2ab23502ac0d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:52.143336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 203/401] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:52.148611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062d7f7-10c4-4c09-a553-1660c0f8bc72 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:52.148952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062d7f7-10c4-4c09-a553-1660c0f8bc72 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:52.149228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062d7f7-10c4-4c09-a553-1660c0f8bc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:52.180340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0062d7f7-10c4-4c09-a553-1660c0f8bc72 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:52.182058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0062d7f7-10c4-4c09-a553-1660c0f8bc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:52.204631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc8a1-3cea-42fa-a9ce-73c447a3c3a8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:52.232172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:52.240907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e3a4b-e8f3-4994-a778-8a35865d9aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:52.241625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e3a4b-e8f3-4994-a778-8a35865d9aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:52.241974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e3a4b-e8f3-4994-a778-8a35865d9aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:52.242316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e3a4b-e8f3-4994-a778-8a35865d9aa0 None admin] PATH_INFO: `/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:52.244065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e3a4b-e8f3-4994-a778-8a35865d9aa0 None admin] RBAC: Authorizing `identity:get_group(group_id=891eb23ebd9c4de2b3ab569c9afb55d8)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:52.245625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e3a4b-e8f3-4994-a778-8a35865d9aa0 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:52.247831 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 199/402] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:52 2022] GET /identity/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:52.248823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e3a4b-e8f3-4994-a778-8a35865d9aa0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:52.284271 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 204/403] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:52.285003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062d7f7-10c4-4c09-a553-1660c0f8bc72 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:52.417186 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e3a4b-e8f3-4994-a778-8a35865d9aa0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:52.453764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:52.469301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062d7f7-10c4-4c09-a553-1660c0f8bc72 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:52.483885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab4200-64f5-48c7-9d74-9bdc26cc46e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:52.484547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab4200-64f5-48c7-9d74-9bdc26cc46e8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:52.484822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab4200-64f5-48c7-9d74-9bdc26cc46e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:52.485096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab4200-64f5-48c7-9d74-9bdc26cc46e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:52.498031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab4200-64f5-48c7-9d74-9bdc26cc46e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-e2ab4200-64f5-48c7-9d74-9bdc26cc46e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:52.506688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:52.507615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:52.508468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 200/404] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:52.512987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab4200-64f5-48c7-9d74-9bdc26cc46e8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:52.551031 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611df11b-d61a-43fc-972d-0840197ba03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:52.552054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611df11b-d61a-43fc-972d-0840197ba03c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:52.552553 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611df11b-d61a-43fc-972d-0840197ba03c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:52.553030 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611df11b-d61a-43fc-972d-0840197ba03c None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:52.556992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611df11b-d61a-43fc-972d-0840197ba03c None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:52.559023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611df11b-d61a-43fc-972d-0840197ba03c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:52.562499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 205/405] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:52 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:52.567886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611df11b-d61a-43fc-972d-0840197ba03c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:52.593832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:52.662452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab4200-64f5-48c7-9d74-9bdc26cc46e8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:52.699788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611df11b-d61a-43fc-972d-0840197ba03c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:52.702273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaab013-4c26-4b0c-bc6a-fee960797683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:52.703139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaab013-4c26-4b0c-bc6a-fee960797683 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:52.703606 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaab013-4c26-4b0c-bc6a-fee960797683 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:52.704121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaab013-4c26-4b0c-bc6a-fee960797683 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:52.704984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaab013-4c26-4b0c-bc6a-fee960797683 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:52.705477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaab013-4c26-4b0c-bc6a-fee960797683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:52.707041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaab013-4c26-4b0c-bc6a-fee960797683 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:52.717374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 201/406] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:13:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:52.718407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaab013-4c26-4b0c-bc6a-fee960797683 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:52.742576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a4866-9a41-4882-8612-9b5c1548c7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:52.743228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a4866-9a41-4882-8612-9b5c1548c7b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:52.743528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a4866-9a41-4882-8612-9b5c1548c7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:52.743810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a4866-9a41-4882-8612-9b5c1548c7b3 None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197/groups/891eb23ebd9c4de2b3ab569c9afb55d8/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:52.746004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a4866-9a41-4882-8612-9b5c1548c7b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197, group_id=891eb23ebd9c4de2b3ab569c9afb55d8, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:52.748185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a4866-9a41-4882-8612-9b5c1548c7b3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:52.825426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaab013-4c26-4b0c-bc6a-fee960797683 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:52.830575 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 206/407] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Oct 4 10:13:52 2022] PUT /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197/groups/891eb23ebd9c4de2b3ab569c9afb55d8/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:52.831209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a4866-9a41-4882-8612-9b5c1548c7b3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:52.848274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:52.862898 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:52.887382 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c524f4-4ef3-4d59-98fc-cb6af241266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:52.888381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c524f4-4ef3-4d59-98fc-cb6af241266f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:52.888790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c524f4-4ef3-4d59-98fc-cb6af241266f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:52.889199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c524f4-4ef3-4d59-98fc-cb6af241266f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:52.909890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c524f4-4ef3-4d59-98fc-cb6af241266f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-e3c524f4-4ef3-4d59-98fc-cb6af241266f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:52.925713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:52.926612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:52.927502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 202/408] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:13:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:52.934614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c524f4-4ef3-4d59-98fc-cb6af241266f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:52.969805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a4866-9a41-4882-8612-9b5c1548c7b3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:53.028329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71c206-4ef3-4a32-8ac1-1334321e043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:53.028979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71c206-4ef3-4a32-8ac1-1334321e043f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:53.029253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71c206-4ef3-4a32-8ac1-1334321e043f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:53.029525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71c206-4ef3-4a32-8ac1-1334321e043f None admin] PATH_INFO: `/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:53.032544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71c206-4ef3-4a32-8ac1-1334321e043f None admin] RBAC: Authorizing `identity:get_group(group_id=891eb23ebd9c4de2b3ab569c9afb55d8)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:53.033969 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71c206-4ef3-4a32-8ac1-1334321e043f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:53.036358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 207/409] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:52 2022] GET /identity/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:53.044328 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71c206-4ef3-4a32-8ac1-1334321e043f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:53.121539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c524f4-4ef3-4d59-98fc-cb6af241266f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:53.158276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d4065-4ad5-4c94-b3c0-33b6d4e41b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:53.158865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d4065-4ad5-4c94-b3c0-33b6d4e41b7c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:53.159073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d4065-4ad5-4c94-b3c0-33b6d4e41b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:53.159344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d4065-4ad5-4c94-b3c0-33b6d4e41b7c None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:53.160029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d4065-4ad5-4c94-b3c0-33b6d4e41b7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:53.160331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d4065-4ad5-4c94-b3c0-33b6d4e41b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:53.161811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d4065-4ad5-4c94-b3c0-33b6d4e41b7c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:53.171198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 203/410] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:53.177959 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d4065-4ad5-4c94-b3c0-33b6d4e41b7c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:53.223508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:53.247883 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:53.272818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71c206-4ef3-4a32-8ac1-1334321e043f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:53.288197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d4065-4ad5-4c94-b3c0-33b6d4e41b7c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:53.326269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fc79d-0ba1-4a2a-87f0-56e1f99c252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:53.327268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fc79d-0ba1-4a2a-87f0-56e1f99c252a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:53.327747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fc79d-0ba1-4a2a-87f0-56e1f99c252a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:53.328345 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fc79d-0ba1-4a2a-87f0-56e1f99c252a None admin] PATH_INFO: `/v3/groups/92e4eecf96d94ee9aae5331048cb2250` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:53.329752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fc79d-0ba1-4a2a-87f0-56e1f99c252a None admin] RBAC: Authorizing `identity:get_group(group_id=92e4eecf96d94ee9aae5331048cb2250)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:53.331375 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fc79d-0ba1-4a2a-87f0-56e1f99c252a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:53.333630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 204/411] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:53 2022] GET /identity/v3/groups/92e4eecf96d94ee9aae5331048cb2250 => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:53.340454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fc79d-0ba1-4a2a-87f0-56e1f99c252a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:53.345680 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd8824-06b2-4402-a6e4-4ec6e033139e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:53.346256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8824-06b2-4402-a6e4-4ec6e033139e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:53.346528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8824-06b2-4402-a6e4-4ec6e033139e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:53.346865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8824-06b2-4402-a6e4-4ec6e033139e None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:53.348611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd8824-06b2-4402-a6e4-4ec6e033139e None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:53.350065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd8824-06b2-4402-a6e4-4ec6e033139e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:53.356446 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 208/412] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:53 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:53.363148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd8824-06b2-4402-a6e4-4ec6e033139e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:53.499075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fc79d-0ba1-4a2a-87f0-56e1f99c252a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:53.511116 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:53.540743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd8824-06b2-4402-a6e4-4ec6e033139e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:53.566837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff6c7e-7345-4a0b-9c23-49a530bb6140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:53.567497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff6c7e-7345-4a0b-9c23-49a530bb6140 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:53.567767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff6c7e-7345-4a0b-9c23-49a530bb6140 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:53.568065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff6c7e-7345-4a0b-9c23-49a530bb6140 None admin] PATH_INFO: `/v3/projects/e736e1303d7f49068590b8ec9f283f71` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:53.569782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff6c7e-7345-4a0b-9c23-49a530bb6140 None admin] RBAC: Authorizing `identity:get_project(project_id=e736e1303d7f49068590b8ec9f283f71)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:53.571414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff6c7e-7345-4a0b-9c23-49a530bb6140 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:53.574337 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 205/413] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:53 2022] GET /identity/v3/projects/e736e1303d7f49068590b8ec9f283f71 => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:53.580771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff6c7e-7345-4a0b-9c23-49a530bb6140 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:53.610179 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149bd9d-b08b-4503-8809-d111b39900b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:53.610835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149bd9d-b08b-4503-8809-d111b39900b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:53.611107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149bd9d-b08b-4503-8809-d111b39900b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:53.611374 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149bd9d-b08b-4503-8809-d111b39900b3 None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197/groups/891eb23ebd9c4de2b3ab569c9afb55d8/roles/f63ab1c53b2e4aa0bf00e4798908cbfb` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:53.615581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149bd9d-b08b-4503-8809-d111b39900b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197, group_id=891eb23ebd9c4de2b3ab569c9afb55d8, role_id=f63ab1c53b2e4aa0bf00e4798908cbfb)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:53.620414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149bd9d-b08b-4503-8809-d111b39900b3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:53.698376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 209/414] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Oct 4 10:13:53 2022] PUT /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197/groups/891eb23ebd9c4de2b3ab569c9afb55d8/roles/f63ab1c53b2e4aa0bf00e4798908cbfb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:13:53.723369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff6c7e-7345-4a0b-9c23-49a530bb6140 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:53.772296 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d9fff-4d98-4e7b-8865-d3eb46e2a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:53.772885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9fff-4d98-4e7b-8865-d3eb46e2a194 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:53.773158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9fff-4d98-4e7b-8865-d3eb46e2a194 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:53.773431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9fff-4d98-4e7b-8865-d3eb46e2a194 None admin] PATH_INFO: `/v3/projects/e736e1303d7f49068590b8ec9f283f71/groups/92e4eecf96d94ee9aae5331048cb2250/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:53.776807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d9fff-4d98-4e7b-8865-d3eb46e2a194 None admin] RBAC: Authorizing `identity:create_grant(project_id=e736e1303d7f49068590b8ec9f283f71, group_id=92e4eecf96d94ee9aae5331048cb2250, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:53.778343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d9fff-4d98-4e7b-8865-d3eb46e2a194 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:53.890673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 206/415] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Oct 4 10:13:53 2022] PUT /identity/v3/projects/e736e1303d7f49068590b8ec9f283f71/groups/92e4eecf96d94ee9aae5331048cb2250/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:13:54.208552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d3a55-bec4-48e4-af7f-eed71d9ef60b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:54.209069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d3a55-bec4-48e4-af7f-eed71d9ef60b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:54.209069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d3a55-bec4-48e4-af7f-eed71d9ef60b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:54.210403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 210/416] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:54.216285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eb24b-bf95-4227-846e-d41874a62624 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:54.216566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eb24b-bf95-4227-846e-d41874a62624 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:54.216835 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eb24b-bf95-4227-846e-d41874a62624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:54.235523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440779-ee6c-4faf-b480-a103097e5cd0 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:54.235838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440779-ee6c-4faf-b480-a103097e5cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:54.236155 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440779-ee6c-4faf-b480-a103097e5cd0 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:54.237860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 211/417] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:54.238294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e85eb24b-bf95-4227-846e-d41874a62624 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:54.239529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e85eb24b-bf95-4227-846e-d41874a62624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:54.247161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f4ed-24d7-4204-bcd2-286e4c2f5d47 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:54.247161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f4ed-24d7-4204-bcd2-286e4c2f5d47 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:54.247161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f4ed-24d7-4204-bcd2-286e4c2f5d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:54.263127 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f087f4ed-24d7-4204-bcd2-286e4c2f5d47 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:54.264658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f087f4ed-24d7-4204-bcd2-286e4c2f5d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:54.285606 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:54.288759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:54.371191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 207/418] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:54.375430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 212/419] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:54.661334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eb24b-bf95-4227-846e-d41874a62624 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:54.792668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eb24b-bf95-4227-846e-d41874a62624 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:54.793307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087f4ed-24d7-4204-bcd2-286e4c2f5d47 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:54.846969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601e2df-0f7e-45c7-8f28-26b2059cd1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:54.847611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601e2df-0f7e-45c7-8f28-26b2059cd1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:54.847887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601e2df-0f7e-45c7-8f28-26b2059cd1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:54.848183 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601e2df-0f7e-45c7-8f28-26b2059cd1e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:54.871574 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601e2df-0f7e-45c7-8f28-26b2059cd1e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-b601e2df-0f7e-45c7-8f28-26b2059cd1e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:54.883798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:54.885307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:54.886106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:54.886106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:54.886106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:54.886106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:54.886106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:54.886106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:54.886106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:54.886106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:54.886106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:54.886106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:54.886106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:54.886106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:54.897165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 208/420] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:54.898602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601e2df-0f7e-45c7-8f28-26b2059cd1e0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:54.948144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:54.995319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087f4ed-24d7-4204-bcd2-286e4c2f5d47 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:55.069199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5d8e4-491e-4ab4-9b4b-a73c5b1b4bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:55.070177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5d8e4-491e-4ab4-9b4b-a73c5b1b4bcf None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:55.070676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5d8e4-491e-4ab4-9b4b-a73c5b1b4bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:55.071135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5d8e4-491e-4ab4-9b4b-a73c5b1b4bcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:55.075979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601e2df-0f7e-45c7-8f28-26b2059cd1e0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:55.095658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5d8e4-491e-4ab4-9b4b-a73c5b1b4bcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-c9b5d8e4-491e-4ab4-9b4b-a73c5b1b4bcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:55.104320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:55.105213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:55.106007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:55.106007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:55.106007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:55.106007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:55.106007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:55.106007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:55.106007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:55.106007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:55.106007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:55.106007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:55.106007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:55.106007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:55.106605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 213/421] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:13:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:55.112933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5d8e4-491e-4ab4-9b4b-a73c5b1b4bcf None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:55.126131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:55.137458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49109b-a4f0-4791-8b1e-1e9ee02d8d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:55.138106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49109b-a4f0-4791-8b1e-1e9ee02d8d11 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:55.138387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49109b-a4f0-4791-8b1e-1e9ee02d8d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:55.138879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49109b-a4f0-4791-8b1e-1e9ee02d8d11 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:55.139590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49109b-a4f0-4791-8b1e-1e9ee02d8d11 None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:55.139901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49109b-a4f0-4791-8b1e-1e9ee02d8d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:55.141389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49109b-a4f0-4791-8b1e-1e9ee02d8d11 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:55.164065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 209/422] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:55.168929 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49109b-a4f0-4791-8b1e-1e9ee02d8d11 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:55.285668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5d8e4-491e-4ab4-9b4b-a73c5b1b4bcf None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:55.293359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:55.312486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49109b-a4f0-4791-8b1e-1e9ee02d8d11 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:55.323272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df1f54-43f6-4ad0-9a39-041202eb3280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:55.324146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df1f54-43f6-4ad0-9a39-041202eb3280 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:55.324616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df1f54-43f6-4ad0-9a39-041202eb3280 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:55.325061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df1f54-43f6-4ad0-9a39-041202eb3280 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:55.325891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df1f54-43f6-4ad0-9a39-041202eb3280 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:55.326383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df1f54-43f6-4ad0-9a39-041202eb3280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:55.328613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df1f54-43f6-4ad0-9a39-041202eb3280 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:55.338623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 214/423] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:13:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:55.340374 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f30133-191a-4773-bc39-873bbb48d748 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:55.340854 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f30133-191a-4773-bc39-873bbb48d748 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:55.341328 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f30133-191a-4773-bc39-873bbb48d748 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:55.343386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 215/424] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:55.344297 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f30133-191a-4773-bc39-873bbb48d748 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:55.358633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db672953-8e62-4807-9672-65518f92ad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:55.359361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db672953-8e62-4807-9672-65518f92ad26 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:55.359702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db672953-8e62-4807-9672-65518f92ad26 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:55.360065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db672953-8e62-4807-9672-65518f92ad26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:55.420563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:55.453406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db672953-8e62-4807-9672-65518f92ad26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:55.455141 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db672953-8e62-4807-9672-65518f92ad26 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:55.463840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f30133-191a-4773-bc39-873bbb48d748 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:55.509675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e7164-d8a7-450b-a7fc-b046eac904a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:55.515055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e7164-d8a7-450b-a7fc-b046eac904a4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:55.515055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e7164-d8a7-450b-a7fc-b046eac904a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:55.515055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e7164-d8a7-450b-a7fc-b046eac904a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:55.548173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:55.564599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 210/425] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 10:13:55.570899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d98ff-4295-4528-abb2-0d2bc4a060fa None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:55.571415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d98ff-4295-4528-abb2-0d2bc4a060fa None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:55.572478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d98ff-4295-4528-abb2-0d2bc4a060fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:55.592550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-866d98ff-4295-4528-abb2-0d2bc4a060fa None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:55.594445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-866d98ff-4295-4528-abb2-0d2bc4a060fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:55.598738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e7164-d8a7-450b-a7fc-b046eac904a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:55.600225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e7164-d8a7-450b-a7fc-b046eac904a4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:55.672136 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 211/426] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:55.673360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d98ff-4295-4528-abb2-0d2bc4a060fa None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:55.682948 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:55.722631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 216/427] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:55.728311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e7164-d8a7-450b-a7fc-b046eac904a4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:55.845302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e7164-d8a7-450b-a7fc-b046eac904a4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:55.886071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5feef-23fe-4050-bcfe-e465b4c4e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:55.886703 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5feef-23fe-4050-bcfe-e465b4c4e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:55.886978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5feef-23fe-4050-bcfe-e465b4c4e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:55.887248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5feef-23fe-4050-bcfe-e465b4c4e2d2 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:55.888634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5feef-23fe-4050-bcfe-e465b4c4e2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:55.890301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5feef-23fe-4050-bcfe-e465b4c4e2d2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:55.892653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 217/428] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:55 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:55.898326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5feef-23fe-4050-bcfe-e465b4c4e2d2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:55.899619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d98ff-4295-4528-abb2-0d2bc4a060fa None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:55.942217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:55.944853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:56.005211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20912e8-ccb9-4c11-b168-556a08d44341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:56.005862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20912e8-ccb9-4c11-b168-556a08d44341 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:56.006137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20912e8-ccb9-4c11-b168-556a08d44341 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:56.006406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20912e8-ccb9-4c11-b168-556a08d44341 None admin] PATH_INFO: `/v3/projects/df0f459e95f141488f03abcb8bea472c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:56.012684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20912e8-ccb9-4c11-b168-556a08d44341 None admin] RBAC: Authorizing `identity:get_project(project_id=df0f459e95f141488f03abcb8bea472c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:56.014127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20912e8-ccb9-4c11-b168-556a08d44341 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:56.015781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 212/429] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:55 2022] GET /identity/v3/projects/df0f459e95f141488f03abcb8bea472c => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:56.017548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5feef-23fe-4050-bcfe-e465b4c4e2d2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:56.021343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20912e8-ccb9-4c11-b168-556a08d44341 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:56.071057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a41636-efc2-456f-ae06-7a9eb0720380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:56.071769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a41636-efc2-456f-ae06-7a9eb0720380 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:56.072070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a41636-efc2-456f-ae06-7a9eb0720380 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:56.072344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a41636-efc2-456f-ae06-7a9eb0720380 None admin] PATH_INFO: `/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:56.073718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a41636-efc2-456f-ae06-7a9eb0720380 None admin] RBAC: Authorizing `identity:get_group(group_id=891eb23ebd9c4de2b3ab569c9afb55d8)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:56.075146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a41636-efc2-456f-ae06-7a9eb0720380 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:56.077170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 218/430] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:55 2022] GET /identity/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:56.082937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a41636-efc2-456f-ae06-7a9eb0720380 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:56.136435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20912e8-ccb9-4c11-b168-556a08d44341 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:56.171114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7147f9-ed76-4cd1-9ed3-9c5ddd660857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:56.171742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7147f9-ed76-4cd1-9ed3-9c5ddd660857 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:56.172040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7147f9-ed76-4cd1-9ed3-9c5ddd660857 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:56.172307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7147f9-ed76-4cd1-9ed3-9c5ddd660857 None admin] PATH_INFO: `/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:56.173409 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7147f9-ed76-4cd1-9ed3-9c5ddd660857 None admin] RBAC: Authorizing `identity:get_group(group_id=891eb23ebd9c4de2b3ab569c9afb55d8)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:56.174833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7147f9-ed76-4cd1-9ed3-9c5ddd660857 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:56.176773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 213/431] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:56 2022] GET /identity/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:56.177478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7147f9-ed76-4cd1-9ed3-9c5ddd660857 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:56.190635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a41636-efc2-456f-ae06-7a9eb0720380 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:56.193188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:56.229821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db5510-5ffb-4e76-8a00-7811685a0732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:56.230435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db5510-5ffb-4e76-8a00-7811685a0732 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:56.230710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db5510-5ffb-4e76-8a00-7811685a0732 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:56.231037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db5510-5ffb-4e76-8a00-7811685a0732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:56.231777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db5510-5ffb-4e76-8a00-7811685a0732 None admin] RBAC: Adding query filter params (group.id=891eb23ebd9c4de2b3ab569c9afb55d8, role.id=f63ab1c53b2e4aa0bf00e4798908cbfb, scope.project.id=df0f459e95f141488f03abcb8bea472c) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:56.232266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:56.233072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db5510-5ffb-4e76-8a00-7811685a0732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:56.235972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db5510-5ffb-4e76-8a00-7811685a0732 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:56.252088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 219/432] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 10:13:56 2022] GET /identity/v3/role_assignments?group.id=891eb23ebd9c4de2b3ab569c9afb55d8&scope.project.id=df0f459e95f141488f03abcb8bea472c&role.id=f63ab1c53b2e4aa0bf00e4798908cbfb => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:56.253145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db5510-5ffb-4e76-8a00-7811685a0732 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:56.284545 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7147f9-ed76-4cd1-9ed3-9c5ddd660857 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:56.320802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8c66-d0c2-4a23-aeff-258a1914a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:56.321437 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8c66-d0c2-4a23-aeff-258a1914a66a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:56.322240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8c66-d0c2-4a23-aeff-258a1914a66a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:56.322511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8c66-d0c2-4a23-aeff-258a1914a66a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:56.334358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba8c66-d0c2-4a23-aeff-258a1914a66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-3eba8c66-d0c2-4a23-aeff-258a1914a66a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:56.339714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:56.340698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:56.341484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:56.341484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:56.341484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:56.341484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:56.341484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:56.341484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:56.341484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:56.341484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:56.341484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:56.341484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:56.341484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 10:13:56.341484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:56.345929 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 214/433] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:56.356004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8c66-d0c2-4a23-aeff-258a1914a66a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:56.419393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db5510-5ffb-4e76-8a00-7811685a0732 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:56.459997 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27fc03-7826-42fa-8364-04eeb65f4229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:56.461006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fc03-7826-42fa-8364-04eeb65f4229 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:56.461512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fc03-7826-42fa-8364-04eeb65f4229 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:56.462191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fc03-7826-42fa-8364-04eeb65f4229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:56.464103 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27fc03-7826-42fa-8364-04eeb65f4229 None admin] RBAC: Adding query filter params (group.id=891eb23ebd9c4de2b3ab569c9afb55d8, role.id=c071e1d121a643a48556e6287cde21c0, scope.project.id=df0f459e95f141488f03abcb8bea472c) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:56.464628 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27fc03-7826-42fa-8364-04eeb65f4229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:56.466343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27fc03-7826-42fa-8364-04eeb65f4229 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:56.473795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 220/434] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 10:13:56 2022] GET /identity/v3/role_assignments?group.id=891eb23ebd9c4de2b3ab569c9afb55d8&scope.project.id=df0f459e95f141488f03abcb8bea472c&role.id=c071e1d121a643a48556e6287cde21c0 => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:56.473998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8c66-d0c2-4a23-aeff-258a1914a66a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:56.475766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09332de-9176-4bfa-9464-e1e1682026fd None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:56.476515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09332de-9176-4bfa-9464-e1e1682026fd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:56.476997 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09332de-9176-4bfa-9464-e1e1682026fd None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:56.483254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 221/435] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:56.485553 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b6bcd-a0a6-42de-81cb-bcae5f40de7a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:56.486046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b6bcd-a0a6-42de-81cb-bcae5f40de7a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:56.486619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b6bcd-a0a6-42de-81cb-bcae5f40de7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:56.490101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:56.508064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-de9b6bcd-a0a6-42de-81cb-bcae5f40de7a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:56.510616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-de9b6bcd-a0a6-42de-81cb-bcae5f40de7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:56.520812 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37011e-fc0c-419d-9c01-9351824cc38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:56.521556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37011e-fc0c-419d-9c01-9351824cc38f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:56.521786 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37011e-fc0c-419d-9c01-9351824cc38f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:56.522526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37011e-fc0c-419d-9c01-9351824cc38f None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:56.525714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37011e-fc0c-419d-9c01-9351824cc38f None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:56.526031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37011e-fc0c-419d-9c01-9351824cc38f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:56.527484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37011e-fc0c-419d-9c01-9351824cc38f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:56.538264 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 215/436] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:13:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:56.540245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781bba7-7e76-4333-bfdf-938132e00d2e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:56.541238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781bba7-7e76-4333-bfdf-938132e00d2e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:56.541638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781bba7-7e76-4333-bfdf-938132e00d2e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:56.543823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 216/437] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:13:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:13:56.544835 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781bba7-7e76-4333-bfdf-938132e00d2e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:56.545730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:56.608291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 222/438] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:13:56.609678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e00e5-ecdd-4d81-965a-9ef44c5fba95 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:56.610198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e00e5-ecdd-4d81-965a-9ef44c5fba95 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:56.610198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e00e5-ecdd-4d81-965a-9ef44c5fba95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:56.629306 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d66e00e5-ecdd-4d81-965a-9ef44c5fba95 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:13:56.630516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d66e00e5-ecdd-4d81-965a-9ef44c5fba95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:13:56.688882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781bba7-7e76-4333-bfdf-938132e00d2e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:56.718275 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 223/439] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:13:56.728838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25c1b2-5b75-49ae-8ee2-b55d77f1679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:56.729439 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25c1b2-5b75-49ae-8ee2-b55d77f1679e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:56.729713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25c1b2-5b75-49ae-8ee2-b55d77f1679e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:56.729981 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25c1b2-5b75-49ae-8ee2-b55d77f1679e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:56.778493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:56.803855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25c1b2-5b75-49ae-8ee2-b55d77f1679e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:56.805418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25c1b2-5b75-49ae-8ee2-b55d77f1679e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:56.889416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e00e5-ecdd-4d81-965a-9ef44c5fba95 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:56.911874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 217/440] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:56.919974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25c1b2-5b75-49ae-8ee2-b55d77f1679e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:57.006334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:57.021255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:57.033146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e00e5-ecdd-4d81-965a-9ef44c5fba95 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:57.036449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25c1b2-5b75-49ae-8ee2-b55d77f1679e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:57.070923 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4c55c-e684-49ec-a461-3f4f99507c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:57.072813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4c55c-e684-49ec-a461-3f4f99507c4a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:57.073299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4c55c-e684-49ec-a461-3f4f99507c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:57.073761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4c55c-e684-49ec-a461-3f4f99507c4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:57.077100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f71c-604f-4ad0-b7f0-ba9dbea8546f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:57.077745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f71c-604f-4ad0-b7f0-ba9dbea8546f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:57.078014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f71c-604f-4ad0-b7f0-ba9dbea8546f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:57.078285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f71c-604f-4ad0-b7f0-ba9dbea8546f None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:57.079406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f71c-604f-4ad0-b7f0-ba9dbea8546f None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:57.080868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f71c-604f-4ad0-b7f0-ba9dbea8546f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:57.082705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 218/441] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:56 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:57.083249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f71c-604f-4ad0-b7f0-ba9dbea8546f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:57.085041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4c55c-e684-49ec-a461-3f4f99507c4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9eb4c55c-e684-49ec-a461-3f4f99507c4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:57.093807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:57.094812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 224/442] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:13:57.095785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4c55c-e684-49ec-a461-3f4f99507c4a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:57.205802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f71c-604f-4ad0-b7f0-ba9dbea8546f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:57.212015 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4c55c-e684-49ec-a461-3f4f99507c4a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:57.239531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec37ff-0881-4917-94e4-e057ecb89f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:57.240301 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec37ff-0881-4917-94e4-e057ecb89f67 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:57.240579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec37ff-0881-4917-94e4-e057ecb89f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:57.240848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec37ff-0881-4917-94e4-e057ecb89f67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:57.245608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e92c6-04a0-4970-bcf5-464c93786343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:57.246225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e92c6-04a0-4970-bcf5-464c93786343 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:57.246500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e92c6-04a0-4970-bcf5-464c93786343 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:57.246769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e92c6-04a0-4970-bcf5-464c93786343 None admin] PATH_INFO: `/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:57.247869 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e92c6-04a0-4970-bcf5-464c93786343 None admin] RBAC: Authorizing `identity:get_group(group_id=891eb23ebd9c4de2b3ab569c9afb55d8)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:57.249317 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e92c6-04a0-4970-bcf5-464c93786343 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:57.255791 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 225/443] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:57 2022] GET /identity/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:57.255927 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec37ff-0881-4917-94e4-e057ecb89f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:13:57.256043 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e92c6-04a0-4970-bcf5-464c93786343 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-c7ec37ff-0881-4917-94e4-e057ecb89f67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:13:57.256417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:13:57.257445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:13:57.258482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:13:57.258482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:13:57.258482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:13:57.258482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:13:57.258482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:13:57.258482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:13:57.258482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:13:57.258482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:13:57.258482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:13:57.258482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:13:57.258482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:13:57.258482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:13:57.262811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 219/444] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:13:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:13:57.263467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec37ff-0881-4917-94e4-e057ecb89f67 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:57.266655 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:57.273519 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:57.348617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e92c6-04a0-4970-bcf5-464c93786343 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:57.360642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec37ff-0881-4917-94e4-e057ecb89f67 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:57.381303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc20ec-f404-4a9a-b58a-50573097f7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:57.381981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc20ec-f404-4a9a-b58a-50573097f7dd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:57.382265 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc20ec-f404-4a9a-b58a-50573097f7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:57.382542 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc20ec-f404-4a9a-b58a-50573097f7dd None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:57.383205 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc20ec-f404-4a9a-b58a-50573097f7dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:57.383509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc20ec-f404-4a9a-b58a-50573097f7dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:57.385441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc20ec-f404-4a9a-b58a-50573097f7dd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:57.393513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 226/445] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:13:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:57.398225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf503ff-bab1-416b-ad68-d153ebe8a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:57.398354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc20ec-f404-4a9a-b58a-50573097f7dd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:57.398450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf503ff-bab1-416b-ad68-d153ebe8a30d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:57.398450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf503ff-bab1-416b-ad68-d153ebe8a30d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:57.398450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf503ff-bab1-416b-ad68-d153ebe8a30d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:57.398450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf503ff-bab1-416b-ad68-d153ebe8a30d None admin] RBAC: Adding query filter params (group.id=891eb23ebd9c4de2b3ab569c9afb55d8, role.id=c071e1d121a643a48556e6287cde21c0, scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:57.398450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf503ff-bab1-416b-ad68-d153ebe8a30d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:57.398810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf503ff-bab1-416b-ad68-d153ebe8a30d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:57.408662 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 220/446] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 10:13:57 2022] GET /identity/v3/role_assignments?group.id=891eb23ebd9c4de2b3ab569c9afb55d8&scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197&role.id=c071e1d121a643a48556e6287cde21c0 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:57.409456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf503ff-bab1-416b-ad68-d153ebe8a30d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:57.493143 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:57.496398 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:57.515995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc20ec-f404-4a9a-b58a-50573097f7dd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:57.536541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf503ff-bab1-416b-ad68-d153ebe8a30d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:57.554349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260408ff-5c03-4674-a7e2-3af950a1a2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:57.555766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260408ff-5c03-4674-a7e2-3af950a1a2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:57.556599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260408ff-5c03-4674-a7e2-3af950a1a2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:57.556875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260408ff-5c03-4674-a7e2-3af950a1a2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:57.557552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260408ff-5c03-4674-a7e2-3af950a1a2b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:57.557856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260408ff-5c03-4674-a7e2-3af950a1a2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:57.559292 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260408ff-5c03-4674-a7e2-3af950a1a2b9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:57.568419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 227/447] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:13:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:57.574415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260408ff-5c03-4674-a7e2-3af950a1a2b9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:57.581121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c097447-09fc-4483-b618-6a5bc67fdd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:57.581749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c097447-09fc-4483-b618-6a5bc67fdd41 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:57.582025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c097447-09fc-4483-b618-6a5bc67fdd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:57.582296 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c097447-09fc-4483-b618-6a5bc67fdd41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:57.665863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c097447-09fc-4483-b618-6a5bc67fdd41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:57.667390 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c097447-09fc-4483-b618-6a5bc67fdd41 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:57.687992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260408ff-5c03-4674-a7e2-3af950a1a2b9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:57.726823 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bf0d0-adf4-45fc-a62d-3f23a4ed942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:57.727432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bf0d0-adf4-45fc-a62d-3f23a4ed942c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:57.727705 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bf0d0-adf4-45fc-a62d-3f23a4ed942c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:57.729118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bf0d0-adf4-45fc-a62d-3f23a4ed942c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:57.745717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:57.750386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:57.788339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 221/448] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:13:57.794581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c097447-09fc-4483-b618-6a5bc67fdd41 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:57.813176 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bf0d0-adf4-45fc-a62d-3f23a4ed942c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:57.814846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bf0d0-adf4-45fc-a62d-3f23a4ed942c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:57.894024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c097447-09fc-4483-b618-6a5bc67fdd41 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:57.910081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 228/449] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 10:13:57.915831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bf0d0-adf4-45fc-a62d-3f23a4ed942c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:57.933315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e161bfb-e4d5-417d-afbd-7af2fcb54310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:57.933952 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e161bfb-e4d5-417d-afbd-7af2fcb54310 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:57.934227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e161bfb-e4d5-417d-afbd-7af2fcb54310 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:57.934520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e161bfb-e4d5-417d-afbd-7af2fcb54310 None admin] PATH_INFO: `/v3/projects/e736e1303d7f49068590b8ec9f283f71` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:57.935631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e161bfb-e4d5-417d-afbd-7af2fcb54310 None admin] RBAC: Authorizing `identity:get_project(project_id=e736e1303d7f49068590b8ec9f283f71)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:57.937095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e161bfb-e4d5-417d-afbd-7af2fcb54310 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:57.938699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 222/450] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:57 2022] GET /identity/v3/projects/e736e1303d7f49068590b8ec9f283f71 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:13:57.943974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e161bfb-e4d5-417d-afbd-7af2fcb54310 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:57.961958 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:57.976679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:58.021228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bf0d0-adf4-45fc-a62d-3f23a4ed942c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:58.044428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e161bfb-e4d5-417d-afbd-7af2fcb54310 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:58.062339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ccdad-1d61-4d79-a727-97e2e9ec2c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:58.062960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ccdad-1d61-4d79-a727-97e2e9ec2c23 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:58.063237 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ccdad-1d61-4d79-a727-97e2e9ec2c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:58.063510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ccdad-1d61-4d79-a727-97e2e9ec2c23 None admin] PATH_INFO: `/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:58.064653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ccdad-1d61-4d79-a727-97e2e9ec2c23 None admin] RBAC: Authorizing `identity:get_project(project_id=ba766a8a01ba4bb9bcdbac9cdfbe3197)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:58.066077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ccdad-1d61-4d79-a727-97e2e9ec2c23 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:58.067686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 229/451] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:13:57 2022] GET /identity/v3/projects/ba766a8a01ba4bb9bcdbac9cdfbe3197 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:58.073284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ccdad-1d61-4d79-a727-97e2e9ec2c23 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:58.081053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c23dea-751d-44a8-b94f-7186b3a36fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:58.081678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c23dea-751d-44a8-b94f-7186b3a36fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:58.081947 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c23dea-751d-44a8-b94f-7186b3a36fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:58.082210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c23dea-751d-44a8-b94f-7186b3a36fc8 None admin] PATH_INFO: `/v3/groups/92e4eecf96d94ee9aae5331048cb2250` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:58.083305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c23dea-751d-44a8-b94f-7186b3a36fc8 None admin] RBAC: Authorizing `identity:get_group(group_id=92e4eecf96d94ee9aae5331048cb2250)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:58.084748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c23dea-751d-44a8-b94f-7186b3a36fc8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:58.087977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 223/452] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:57 2022] GET /identity/v3/groups/92e4eecf96d94ee9aae5331048cb2250 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:58.092516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c23dea-751d-44a8-b94f-7186b3a36fc8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:58.174722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ccdad-1d61-4d79-a727-97e2e9ec2c23 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:58.187261 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:58.192468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c23dea-751d-44a8-b94f-7186b3a36fc8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:58.193995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:13:58.207025 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe9e82-9e40-4e54-8af2-63c0721b2ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:58.207644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe9e82-9e40-4e54-8af2-63c0721b2ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:58.207920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe9e82-9e40-4e54-8af2-63c0721b2ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:58.208220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe9e82-9e40-4e54-8af2-63c0721b2ba7 None admin] PATH_INFO: `/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:58.209319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe9e82-9e40-4e54-8af2-63c0721b2ba7 None admin] RBAC: Authorizing `identity:get_group(group_id=891eb23ebd9c4de2b3ab569c9afb55d8)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:58.210740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe9e82-9e40-4e54-8af2-63c0721b2ba7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:58.212848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 230/453] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 10:13:58 2022] GET /identity/v3/groups/891eb23ebd9c4de2b3ab569c9afb55d8 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:58.218922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe9e82-9e40-4e54-8af2-63c0721b2ba7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:13:58.226619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a309b30-b272-4fcd-8b3e-d9a1acebe266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:58.227219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a309b30-b272-4fcd-8b3e-d9a1acebe266 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:58.227493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a309b30-b272-4fcd-8b3e-d9a1acebe266 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:58.227775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a309b30-b272-4fcd-8b3e-d9a1acebe266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:58.229065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a309b30-b272-4fcd-8b3e-d9a1acebe266 None admin] RBAC: Adding query filter params (group.id=92e4eecf96d94ee9aae5331048cb2250, role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=e736e1303d7f49068590b8ec9f283f71) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:58.229365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a309b30-b272-4fcd-8b3e-d9a1acebe266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:58.230855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a309b30-b272-4fcd-8b3e-d9a1acebe266 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:58.236759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 224/454] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 10:13:58 2022] GET /identity/v3/role_assignments?group.id=92e4eecf96d94ee9aae5331048cb2250&scope.project.id=e736e1303d7f49068590b8ec9f283f71&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:13:58.320406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe9e82-9e40-4e54-8af2-63c0721b2ba7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:13:58.355775 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe222d1d-0503-4c26-beac-9209c96eb523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:13:58.356429 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe222d1d-0503-4c26-beac-9209c96eb523 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:13:58.356708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe222d1d-0503-4c26-beac-9209c96eb523 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:13:58.356977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe222d1d-0503-4c26-beac-9209c96eb523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:13:58.357724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe222d1d-0503-4c26-beac-9209c96eb523 None admin] RBAC: Adding query filter params (group.id=891eb23ebd9c4de2b3ab569c9afb55d8, role.id=f63ab1c53b2e4aa0bf00e4798908cbfb, scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:13:58.358034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe222d1d-0503-4c26-beac-9209c96eb523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:13:58.359485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe222d1d-0503-4c26-beac-9209c96eb523 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:13:58.365910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 231/455] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 10:13:58 2022] GET /identity/v3/role_assignments?group.id=891eb23ebd9c4de2b3ab569c9afb55d8&scope.project.id=ba766a8a01ba4bb9bcdbac9cdfbe3197&role.id=f63ab1c53b2e4aa0bf00e4798908cbfb => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:01.069598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e2fd9-095e-4404-a6cc-754816b75d02 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:01.070618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e2fd9-095e-4404-a6cc-754816b75d02 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:01.071131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e2fd9-095e-4404-a6cc-754816b75d02 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:01.072742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 225/456] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:01.078288 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef9c1-c876-4147-b788-68f1e4fb4ec0 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:01.079100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef9c1-c876-4147-b788-68f1e4fb4ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:01.079596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef9c1-c876-4147-b788-68f1e4fb4ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:01.104698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-024ef9c1-c876-4147-b788-68f1e4fb4ec0 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:01.106313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-024ef9c1-c876-4147-b788-68f1e4fb4ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:01.161885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:01.202318 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 232/457] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:14:01.409688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8fe1d-4698-42a4-a002-1015501c41db None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:01.410369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8fe1d-4698-42a4-a002-1015501c41db None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:01.410856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8fe1d-4698-42a4-a002-1015501c41db None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:01.412781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 226/458] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:01.419597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4115bb-ea4f-41f5-b484-8de83ebeb245 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:01.420279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4115bb-ea4f-41f5-b484-8de83ebeb245 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:01.420757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4115bb-ea4f-41f5-b484-8de83ebeb245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:01.442732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3b4115bb-ea4f-41f5-b484-8de83ebeb245 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:01.448323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3b4115bb-ea4f-41f5-b484-8de83ebeb245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:01.535487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 233/459] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:14:01.544204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10775b6a-7f79-41e6-a9bb-d29d7a35bbe8 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:01.544841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10775b6a-7f79-41e6-a9bb-d29d7a35bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:01.545301 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10775b6a-7f79-41e6-a9bb-d29d7a35bbe8 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:01.546882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 227/460] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:01.552972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7b306-3974-4af9-82d1-111f565903eb None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:01.553588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7b306-3974-4af9-82d1-111f565903eb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:01.554080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7b306-3974-4af9-82d1-111f565903eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:01.577188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-08a7b306-3974-4af9-82d1-111f565903eb None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:01.578726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-08a7b306-3974-4af9-82d1-111f565903eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:01.665677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0a935-6c58-4f3f-aec5-6a8bb3f33a7d None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:01.666289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0a935-6c58-4f3f-aec5-6a8bb3f33a7d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:01.666774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0a935-6c58-4f3f-aec5-6a8bb3f33a7d None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:01.668312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 228/461] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:14:01.673296 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b911c1-cedd-4c9f-9c37-281c87209743 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:01.673813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b911c1-cedd-4c9f-9c37-281c87209743 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:01.674296 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b911c1-cedd-4c9f-9c37-281c87209743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:01.675817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 234/462] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:01.693781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7b306-3974-4af9-82d1-111f565903eb None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:01.708541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b3b911c1-cedd-4c9f-9c37-281c87209743 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:01.711712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b3b911c1-cedd-4c9f-9c37-281c87209743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:01.752312 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:01.834830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 229/463] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:14:01.862016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7b306-3974-4af9-82d1-111f565903eb None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:01.906008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fbf78-c420-46df-9ebc-797f5aa49205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:01.906917 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fbf78-c420-46df-9ebc-797f5aa49205 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:01.907406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fbf78-c420-46df-9ebc-797f5aa49205 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:01.907898 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fbf78-c420-46df-9ebc-797f5aa49205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:01.923183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fbf78-c420-46df-9ebc-797f5aa49205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:01.924899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fbf78-c420-46df-9ebc-797f5aa49205 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:01.934299 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b911c1-cedd-4c9f-9c37-281c87209743 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b23fbf78-c420-46df-9ebc-797f5aa49205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:01.946982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:01.947913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:01.948817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:01.948817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:01.948817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:01.948817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 235/464] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:01.948817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fbf78-c420-46df-9ebc-797f5aa49205 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:02.057538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:02.059174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:02.065452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b911c1-cedd-4c9f-9c37-281c87209743 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:02.077436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fbf78-c420-46df-9ebc-797f5aa49205 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:02.111627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15770e0a-c6f7-4bdb-8754-8c90cdda8521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:02.112495 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15770e0a-c6f7-4bdb-8754-8c90cdda8521 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:02.112855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15770e0a-c6f7-4bdb-8754-8c90cdda8521 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:02.113204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15770e0a-c6f7-4bdb-8754-8c90cdda8521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:02.117353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919faf47-f535-4033-881f-f2a689d512a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:02.118522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919faf47-f535-4033-881f-f2a689d512a9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:02.119056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919faf47-f535-4033-881f-f2a689d512a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:02.119516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919faf47-f535-4033-881f-f2a689d512a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:02.120805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919faf47-f535-4033-881f-f2a689d512a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:02.121285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919faf47-f535-4033-881f-f2a689d512a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:02.123452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919faf47-f535-4033-881f-f2a689d512a9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:02.124178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15770e0a-c6f7-4bdb-8754-8c90cdda8521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:02.126700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15770e0a-c6f7-4bdb-8754-8c90cdda8521 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:02.139452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 236/465] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:02.140809 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919faf47-f535-4033-881f-f2a689d512a9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-15770e0a-c6f7-4bdb-8754-8c90cdda8521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:02.150471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:02.151392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:02.152263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:02.152263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:02.152263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:02.154357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 230/466] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:02.155337 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15770e0a-c6f7-4bdb-8754-8c90cdda8521 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:02.252753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919faf47-f535-4033-881f-f2a689d512a9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:02.269193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15770e0a-c6f7-4bdb-8754-8c90cdda8521 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:02.290696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1636e-fef2-4e32-9bdf-6c929bcc22d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:02.291322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1636e-fef2-4e32-9bdf-6c929bcc22d2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:02.291599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1636e-fef2-4e32-9bdf-6c929bcc22d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:02.292340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1636e-fef2-4e32-9bdf-6c929bcc22d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:02.302227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1636e-fef2-4e32-9bdf-6c929bcc22d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:02.303648 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1636e-fef2-4e32-9bdf-6c929bcc22d2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:02.306422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a1392-1356-4ae3-b743-bbf26dbcb6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:02.307021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a1392-1356-4ae3-b743-bbf26dbcb6e2 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:02.307298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a1392-1356-4ae3-b743-bbf26dbcb6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:02.307562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a1392-1356-4ae3-b743-bbf26dbcb6e2 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:02.308225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a1392-1356-4ae3-b743-bbf26dbcb6e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:02.309648 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a1392-1356-4ae3-b743-bbf26dbcb6e2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:02.310354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-63e1636e-fef2-4e32-9bdf-6c929bcc22d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:02.318432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:02.319524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:02.330239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:02.330239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:02.330239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:02.330239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 237/467] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:02.330239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1636e-fef2-4e32-9bdf-6c929bcc22d2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:02.421519 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1636e-fef2-4e32-9bdf-6c929bcc22d2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:02.435572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 231/468] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:14:02 2022] POST /identity/v3/users => generated 246 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:14:02.444160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a1392-1356-4ae3-b743-bbf26dbcb6e2 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:02.444160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:02.472856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79138fb-cd7b-4fd0-a21f-b26b3981d207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:02.473483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79138fb-cd7b-4fd0-a21f-b26b3981d207 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:02.474117 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79138fb-cd7b-4fd0-a21f-b26b3981d207 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:02.474395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79138fb-cd7b-4fd0-a21f-b26b3981d207 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:02.475341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79138fb-cd7b-4fd0-a21f-b26b3981d207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:02.475649 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79138fb-cd7b-4fd0-a21f-b26b3981d207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:02.477081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79138fb-cd7b-4fd0-a21f-b26b3981d207 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:02.494188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 238/469] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:02.497090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79138fb-cd7b-4fd0-a21f-b26b3981d207 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:02.567537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a1392-1356-4ae3-b743-bbf26dbcb6e2 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:02.587818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:02.619992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a14c6-4b71-400e-9597-432fb2d99220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:02.621964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a14c6-4b71-400e-9597-432fb2d99220 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:02.623006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a14c6-4b71-400e-9597-432fb2d99220 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:02.623509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a14c6-4b71-400e-9597-432fb2d99220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:02.640254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79138fb-cd7b-4fd0-a21f-b26b3981d207 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:02.642786 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a14c6-4b71-400e-9597-432fb2d99220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:02.644292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a14c6-4b71-400e-9597-432fb2d99220 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-ac2a14c6-4b71-400e-9597-432fb2d99220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:02.661730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:02.664539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:02.665459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:02.665459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:02.665459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:02.665459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 232/470] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:02.665459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a14c6-4b71-400e-9597-432fb2d99220 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:02.690353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb44ec-527b-4351-a9cc-61eb4694c65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:02.690891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb44ec-527b-4351-a9cc-61eb4694c65e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:02.691166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb44ec-527b-4351-a9cc-61eb4694c65e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:02.691435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb44ec-527b-4351-a9cc-61eb4694c65e None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:02.692756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb44ec-527b-4351-a9cc-61eb4694c65e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:02.692756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb44ec-527b-4351-a9cc-61eb4694c65e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:02.693831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb44ec-527b-4351-a9cc-61eb4694c65e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:02.708486 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 239/471] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:02.709030 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb44ec-527b-4351-a9cc-61eb4694c65e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:02.732449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:02.789201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a14c6-4b71-400e-9597-432fb2d99220 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:02.819220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb44ec-527b-4351-a9cc-61eb4694c65e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:02.824068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335ab52-e347-4baf-a421-0a610d7790f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:02.824670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335ab52-e347-4baf-a421-0a610d7790f8 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:02.824941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335ab52-e347-4baf-a421-0a610d7790f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:02.825204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335ab52-e347-4baf-a421-0a610d7790f8 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:02.825838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335ab52-e347-4baf-a421-0a610d7790f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:02.827373 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335ab52-e347-4baf-a421-0a610d7790f8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:02.837957 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:02.854044 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913e7bc-156b-4469-b0a6-8d4c732fde73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:02.854645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913e7bc-156b-4469-b0a6-8d4c732fde73 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:02.854919 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913e7bc-156b-4469-b0a6-8d4c732fde73 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:02.855188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913e7bc-156b-4469-b0a6-8d4c732fde73 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:02.855823 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913e7bc-156b-4469-b0a6-8d4c732fde73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:02.856162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913e7bc-156b-4469-b0a6-8d4c732fde73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:02.857559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913e7bc-156b-4469-b0a6-8d4c732fde73 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:02.869137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 240/472] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:02.871454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913e7bc-156b-4469-b0a6-8d4c732fde73 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:02.893641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 233/473] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:14:02 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:14:02.893641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d905ae-4498-4067-ba70-7ea9a0fbae6d None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:02.893641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d905ae-4498-4067-ba70-7ea9a0fbae6d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:02.893641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d905ae-4498-4067-ba70-7ea9a0fbae6d None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:02.893641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 234/474] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:02.893641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d905ae-4498-4067-ba70-7ea9a0fbae6d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:03.015780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913e7bc-156b-4469-b0a6-8d4c732fde73 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:03.030423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d905ae-4498-4067-ba70-7ea9a0fbae6d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:03.048610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:03.059032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf75b6-7221-4dc2-bfda-44db92be0a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:03.059903 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf75b6-7221-4dc2-bfda-44db92be0a43 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:03.065640 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf75b6-7221-4dc2-bfda-44db92be0a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:03.065640 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf75b6-7221-4dc2-bfda-44db92be0a43 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:03.065640 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf75b6-7221-4dc2-bfda-44db92be0a43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:03.065640 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf75b6-7221-4dc2-bfda-44db92be0a43 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:03.072527 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291484bd-4a75-48eb-be72-d6c5daafc315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:03.073640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291484bd-4a75-48eb-be72-d6c5daafc315 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:03.073983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291484bd-4a75-48eb-be72-d6c5daafc315 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:03.074321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291484bd-4a75-48eb-be72-d6c5daafc315 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:03.075705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291484bd-4a75-48eb-be72-d6c5daafc315 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:03.078266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291484bd-4a75-48eb-be72-d6c5daafc315 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:03.152473 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 241/475] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:14:02 2022] POST /identity/v3/users => generated 248 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:14:03.153804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175128b-fd89-49ce-980e-66897b18662a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:03.154093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175128b-fd89-49ce-980e-66897b18662a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:03.154362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175128b-fd89-49ce-980e-66897b18662a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:03.175068 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7175128b-fd89-49ce-980e-66897b18662a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:03.176655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7175128b-fd89-49ce-980e-66897b18662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:03.179050 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 235/476] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:14:02 2022] POST /identity/v3/users => generated 249 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:14:03.211131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:03.263119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 242/477] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:03.538042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291484bd-4a75-48eb-be72-d6c5daafc315 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:03.658746 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291484bd-4a75-48eb-be72-d6c5daafc315 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:03.704673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62befbd-d023-4df0-b9c6-0e7c990640f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:03.705638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62befbd-d023-4df0-b9c6-0e7c990640f8 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:03.706134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62befbd-d023-4df0-b9c6-0e7c990640f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:03.706599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62befbd-d023-4df0-b9c6-0e7c990640f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:03.707487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62befbd-d023-4df0-b9c6-0e7c990640f8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:03.709085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62befbd-d023-4df0-b9c6-0e7c990640f8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:03.749096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.sql.core [None req-b62befbd-d023-4df0-b9c6-0e7c990640f8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 10:14:03.749096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 10:14:03.749096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [parameters: {'id': '6391da13dc4d4404b4ee3b90796cc9eb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 10:14:03.749096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81578) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-b62befbd-d023-4df0-b9c6-0e7c990640f8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application conn.query(q) Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application result.read() Oct 04 10:14:03.769577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return ref.to_dict() Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 10:14:03.770517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application next(self.gen) Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application yield resource Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application next(self.gen) Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise self.value Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application session.commit() Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 10:14:03.771442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.session.flush() Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application compat.raise_( Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 10:14:03.772344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 10:14:03.773219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application conn.query(q) Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application result.read() Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 10:14:03.774139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [parameters: {'id': '6391da13dc4d4404b4ee3b90796cc9eb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:03.775023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 10:14:03.775840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:03.784941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 236/478] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Oct 4 10:14:03 2022] POST /identity/v3/roles => generated 144 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:03.791034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175128b-fd89-49ce-980e-66897b18662a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:03.934091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175128b-fd89-49ce-980e-66897b18662a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:03.980134 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be35261-429a-4152-a782-f1b0d7230cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:03.980772 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be35261-429a-4152-a782-f1b0d7230cba None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:03.981050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be35261-429a-4152-a782-f1b0d7230cba None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:03.981324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be35261-429a-4152-a782-f1b0d7230cba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:03.999584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be35261-429a-4152-a782-f1b0d7230cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3be35261-429a-4152-a782-f1b0d7230cba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:04.004482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:04.005376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:04.006777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 243/479] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:14:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:04.011377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62befbd-d023-4df0-b9c6-0e7c990640f8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:04.067626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:04.164581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62befbd-d023-4df0-b9c6-0e7c990640f8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:04.210478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d57e22-e93f-413d-8307-b04ad7a4a33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:04.211090 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d57e22-e93f-413d-8307-b04ad7a4a33b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:04.211352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d57e22-e93f-413d-8307-b04ad7a4a33b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:04.211624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d57e22-e93f-413d-8307-b04ad7a4a33b None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:04.212837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d57e22-e93f-413d-8307-b04ad7a4a33b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:04.213141 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d57e22-e93f-413d-8307-b04ad7a4a33b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:04.214769 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d57e22-e93f-413d-8307-b04ad7a4a33b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:04.223214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 237/480] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:04.957620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a1f14-f76c-4c0f-a77b-7f3aab97c324 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:04.958128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a1f14-f76c-4c0f-a77b-7f3aab97c324 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:04.958128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a1f14-f76c-4c0f-a77b-7f3aab97c324 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:04.959752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 244/481] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:04.965785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ac8df-272a-4fde-b142-116edf924ca0 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:04.966068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ac8df-272a-4fde-b142-116edf924ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:04.966342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ac8df-272a-4fde-b142-116edf924ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:04.985126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3d9ac8df-272a-4fde-b142-116edf924ca0 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:04.986302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3d9ac8df-272a-4fde-b142-116edf924ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:05.065825 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 238/482] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:14:05.490316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a1f14-f76c-4c0f-a77b-7f3aab97c324 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:05.521782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:05.605665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a1f14-f76c-4c0f-a77b-7f3aab97c324 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:05.640655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9b3c0-9ad4-43a1-956b-e2ee686144db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:05.641301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9b3c0-9ad4-43a1-956b-e2ee686144db None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:05.641573 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9b3c0-9ad4-43a1-956b-e2ee686144db None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:05.641839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9b3c0-9ad4-43a1-956b-e2ee686144db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:05.654723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9b3c0-9ad4-43a1-956b-e2ee686144db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4cb9b3c0-9ad4-43a1-956b-e2ee686144db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:05.659566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:05.660525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:05.661538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 245/483] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:05.669304 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ac8df-272a-4fde-b142-116edf924ca0 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:05.678991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a22f19-3c2a-49f6-9e6f-6bd250a78b16 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:05.679261 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a22f19-3c2a-49f6-9e6f-6bd250a78b16 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:05.679527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a22f19-3c2a-49f6-9e6f-6bd250a78b16 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:05.681641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 246/484] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:05.686825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c951330-7db3-49e3-be9d-4d8a4b87c2a6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:05.687280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c951330-7db3-49e3-be9d-4d8a4b87c2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:05.687696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c951330-7db3-49e3-be9d-4d8a4b87c2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:05.716303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:05.717132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8c951330-7db3-49e3-be9d-4d8a4b87c2a6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:05.719756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8c951330-7db3-49e3-be9d-4d8a4b87c2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:05.833253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ac8df-272a-4fde-b142-116edf924ca0 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:05.872834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2109fa-254e-4671-b573-536c6ef76a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:05.873473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2109fa-254e-4671-b573-536c6ef76a86 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:05.873755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2109fa-254e-4671-b573-536c6ef76a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:05.874031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2109fa-254e-4671-b573-536c6ef76a86 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:05.874772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2109fa-254e-4671-b573-536c6ef76a86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:05.875082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2109fa-254e-4671-b573-536c6ef76a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:05.876790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2109fa-254e-4671-b573-536c6ef76a86 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:05.878413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 247/485] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:05.897644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 239/486] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:05.898914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c951330-7db3-49e3-be9d-4d8a4b87c2a6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:05.931023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:05.941891 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891a166-045c-41d2-9af5-7c7ff5069383 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:05.942175 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891a166-045c-41d2-9af5-7c7ff5069383 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:05.942449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891a166-045c-41d2-9af5-7c7ff5069383 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:05.944025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 240/487] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:05.949362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24805d-dd26-4cfb-888e-dcffa885f757 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:05.949643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24805d-dd26-4cfb-888e-dcffa885f757 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:05.950095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24805d-dd26-4cfb-888e-dcffa885f757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:05.968593 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-8d24805d-dd26-4cfb-888e-dcffa885f757 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:05.969788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8d24805d-dd26-4cfb-888e-dcffa885f757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:06.054273 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c951330-7db3-49e3-be9d-4d8a4b87c2a6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:06.056580 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 241/488] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:14:06.061038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35a5d5-334b-49cf-9f4c-be89057db2b4 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:06.061520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35a5d5-334b-49cf-9f4c-be89057db2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:06.061998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35a5d5-334b-49cf-9f4c-be89057db2b4 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:06.063423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 242/489] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:06.077188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc4e6-718b-42f5-a2be-5305135a364d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:06.077717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc4e6-718b-42f5-a2be-5305135a364d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:06.078200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc4e6-718b-42f5-a2be-5305135a364d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:06.104620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-712cc4e6-718b-42f5-a2be-5305135a364d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:06.105745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-712cc4e6-718b-42f5-a2be-5305135a364d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:06.112695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bce34e-712a-41a0-a41a-143321161250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:06.113560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bce34e-712a-41a0-a41a-143321161250 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:06.114030 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bce34e-712a-41a0-a41a-143321161250 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:06.114510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bce34e-712a-41a0-a41a-143321161250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:06.125292 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bce34e-712a-41a0-a41a-143321161250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:06.127069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bce34e-712a-41a0-a41a-143321161250 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:06.129320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-50bce34e-712a-41a0-a41a-143321161250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:06.143992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:06.144922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:06.145769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:06.145769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:06.145769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:06.148088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 248/490] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:06.157473 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bce34e-712a-41a0-a41a-143321161250 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:06.220976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 243/491] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:06.222213 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cc4e6-718b-42f5-a2be-5305135a364d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:06.238884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:06.277858 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bce34e-712a-41a0-a41a-143321161250 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:06.314686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b37785-8d1e-4ce3-8963-c7a07d1af5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:06.315282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b37785-8d1e-4ce3-8963-c7a07d1af5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:06.315560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b37785-8d1e-4ce3-8963-c7a07d1af5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:06.315835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b37785-8d1e-4ce3-8963-c7a07d1af5e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:06.316499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b37785-8d1e-4ce3-8963-c7a07d1af5e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:06.316806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b37785-8d1e-4ce3-8963-c7a07d1af5e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:06.318152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b37785-8d1e-4ce3-8963-c7a07d1af5e8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:06.335851 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 249/492] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:06.341855 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b37785-8d1e-4ce3-8963-c7a07d1af5e8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:06.375918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cc4e6-718b-42f5-a2be-5305135a364d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:06.433755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f541c-d0b9-48dc-b92f-e97d44d14304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:06.435352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f541c-d0b9-48dc-b92f-e97d44d14304 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:06.435853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f541c-d0b9-48dc-b92f-e97d44d14304 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:06.436359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f541c-d0b9-48dc-b92f-e97d44d14304 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:06.451298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f541c-d0b9-48dc-b92f-e97d44d14304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-299f541c-d0b9-48dc-b92f-e97d44d14304 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:06.458275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:06.459351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:06.460367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:06.460367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:06.460367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:06.460367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:06.460367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:06.460367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:06.460367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:06.460367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:06.460367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:06.460367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:06.460367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:06.460367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:06.463751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 244/493] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:06.464735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f541c-d0b9-48dc-b92f-e97d44d14304 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:06.477541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:06.482502 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b37785-8d1e-4ce3-8963-c7a07d1af5e8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:06.509370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:06.518683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615299f9-410e-48e9-91d5-44a3348d9eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:06.519524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615299f9-410e-48e9-91d5-44a3348d9eae None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:06.519993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615299f9-410e-48e9-91d5-44a3348d9eae None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:06.520434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615299f9-410e-48e9-91d5-44a3348d9eae None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:06.528440 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615299f9-410e-48e9-91d5-44a3348d9eae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:06.530067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615299f9-410e-48e9-91d5-44a3348d9eae None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-615299f9-410e-48e9-91d5-44a3348d9eae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:06.544236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:06.545326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:06.546444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:06.546444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:06.546444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:06.546444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:06.546444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:06.546444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:06.546444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:06.546444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:06.546444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:14:06.546444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:06.548589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 250/494] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 10:14:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:06.549558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615299f9-410e-48e9-91d5-44a3348d9eae None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:06.589552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f541c-d0b9-48dc-b92f-e97d44d14304 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:06.624904 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5355770-8fc9-4581-8be6-f592364b2a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:06.625532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5355770-8fc9-4581-8be6-f592364b2a79 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:06.625809 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5355770-8fc9-4581-8be6-f592364b2a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:06.626135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5355770-8fc9-4581-8be6-f592364b2a79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:06.638069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5355770-8fc9-4581-8be6-f592364b2a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-c5355770-8fc9-4581-8be6-f592364b2a79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:06.643159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:06.644302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:06.645153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 245/495] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:06.645835 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5355770-8fc9-4581-8be6-f592364b2a79 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:06.660598 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615299f9-410e-48e9-91d5-44a3348d9eae None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:06.699029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94309276-e805-4a5e-a110-dced65e74eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:06.699632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94309276-e805-4a5e-a110-dced65e74eac None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:06.700442 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94309276-e805-4a5e-a110-dced65e74eac None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:06.700724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94309276-e805-4a5e-a110-dced65e74eac None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:06.701706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94309276-e805-4a5e-a110-dced65e74eac None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:06.702012 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94309276-e805-4a5e-a110-dced65e74eac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:06.703707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94309276-e805-4a5e-a110-dced65e74eac None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:06.713286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:06.717320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 251/496] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:06.718095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94309276-e805-4a5e-a110-dced65e74eac None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:06.749162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5355770-8fc9-4581-8be6-f592364b2a79 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:06.768658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:06.787407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1919555-2424-4fe0-b3a1-f12a0aec1e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:06.788039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1919555-2424-4fe0-b3a1-f12a0aec1e1e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:06.788398 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1919555-2424-4fe0-b3a1-f12a0aec1e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:06.788641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1919555-2424-4fe0-b3a1-f12a0aec1e1e None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:06.789294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1919555-2424-4fe0-b3a1-f12a0aec1e1e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:06.789634 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1919555-2424-4fe0-b3a1-f12a0aec1e1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:06.791633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1919555-2424-4fe0-b3a1-f12a0aec1e1e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:06.821236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94309276-e805-4a5e-a110-dced65e74eac None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:06.833881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 246/497] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 10:14:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:06.833881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1919555-2424-4fe0-b3a1-f12a0aec1e1e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:06.860688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820dee6-306c-485b-b4e9-ede83b607d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:06.861325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820dee6-306c-485b-b4e9-ede83b607d67 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:06.861608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820dee6-306c-485b-b4e9-ede83b607d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:06.861883 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820dee6-306c-485b-b4e9-ede83b607d67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:06.871927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820dee6-306c-485b-b4e9-ede83b607d67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7820dee6-306c-485b-b4e9-ede83b607d67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:06.877191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:06.878219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:06.879024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 252/498] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:06.879685 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820dee6-306c-485b-b4e9-ede83b607d67 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:06.948232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1919555-2424-4fe0-b3a1-f12a0aec1e1e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:06.972555 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:06.983480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e08db-d122-4263-97f4-637af1d3fb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:06.984137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e08db-d122-4263-97f4-637af1d3fb86 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:06.984418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e08db-d122-4263-97f4-637af1d3fb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:06.989885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e08db-d122-4263-97f4-637af1d3fb86 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:06.989885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e08db-d122-4263-97f4-637af1d3fb86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:06.989885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e08db-d122-4263-97f4-637af1d3fb86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:06.989885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e08db-d122-4263-97f4-637af1d3fb86 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:06.990453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820dee6-306c-485b-b4e9-ede83b607d67 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:06.996671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 247/499] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:06.997556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e08db-d122-4263-97f4-637af1d3fb86 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:07.005399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:07.033413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ab26b-2b3a-4aef-bec3-478a982a8117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:07.034042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ab26b-2b3a-4aef-bec3-478a982a8117 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:07.034321 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ab26b-2b3a-4aef-bec3-478a982a8117 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:07.034600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ab26b-2b3a-4aef-bec3-478a982a8117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:07.045568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ab26b-2b3a-4aef-bec3-478a982a8117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:07.046995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ab26b-2b3a-4aef-bec3-478a982a8117 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d02ab26b-2b3a-4aef-bec3-478a982a8117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:07.061718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:07.063056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:07.063907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:07.063907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:07.063907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:07.063907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 253/500] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:07.063907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ab26b-2b3a-4aef-bec3-478a982a8117 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:07.115474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e08db-d122-4263-97f4-637af1d3fb86 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:07.148925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e687e-5b7e-4184-972a-0c167c68d249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:07.149455 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e687e-5b7e-4184-972a-0c167c68d249 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:07.149758 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e687e-5b7e-4184-972a-0c167c68d249 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:07.150027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e687e-5b7e-4184-972a-0c167c68d249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:07.167002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ab26b-2b3a-4aef-bec3-478a982a8117 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:07.199471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7ae5-9dac-4e93-9923-92ce54d1e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:07.200104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7ae5-9dac-4e93-9923-92ce54d1e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:07.200380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7ae5-9dac-4e93-9923-92ce54d1e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:07.200651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7ae5-9dac-4e93-9923-92ce54d1e1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:07.201309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e7ae5-9dac-4e93-9923-92ce54d1e1c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:07.201609 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e7ae5-9dac-4e93-9923-92ce54d1e1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:07.202427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:07.202976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e7ae5-9dac-4e93-9923-92ce54d1e1c3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:07.210567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 254/501] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:07.213343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7ae5-9dac-4e93-9923-92ce54d1e1c3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:07.216207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e687e-5b7e-4184-972a-0c167c68d249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:07.217654 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e687e-5b7e-4184-972a-0c167c68d249 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:07.237324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:07.312814 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7ae5-9dac-4e93-9923-92ce54d1e1c3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:07.313948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 248/502] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:14:07.314765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e687e-5b7e-4184-972a-0c167c68d249 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:07.347167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e42ce-a434-40f3-b1fc-d8db16b13de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:07.347785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e42ce-a434-40f3-b1fc-d8db16b13de6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:07.348122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e42ce-a434-40f3-b1fc-d8db16b13de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:07.348397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e42ce-a434-40f3-b1fc-d8db16b13de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:07.359565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e42ce-a434-40f3-b1fc-d8db16b13de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:07.361031 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e42ce-a434-40f3-b1fc-d8db16b13de6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-578e42ce-a434-40f3-b1fc-d8db16b13de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:07.375548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:07.376638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:07.377656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:07.377656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:07.377656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:07.377656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 255/503] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:07.378072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6c49-3ee6-47f2-853e-c7abdc205d6e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:07.378349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6c49-3ee6-47f2-853e-c7abdc205d6e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:07.378622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6c49-3ee6-47f2-853e-c7abdc205d6e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:07.379840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 256/504] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:07.380595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc6c49-3ee6-47f2-853e-c7abdc205d6e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:07.403671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:07.418532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e687e-5b7e-4184-972a-0c167c68d249 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:07.452020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1c967-acd5-46f7-a1d5-7f8301b2f2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:07.452636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c967-acd5-46f7-a1d5-7f8301b2f2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:07.453129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c967-acd5-46f7-a1d5-7f8301b2f2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:07.453463 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c967-acd5-46f7-a1d5-7f8301b2f2e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:07.454630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1c967-acd5-46f7-a1d5-7f8301b2f2e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:07.454924 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1c967-acd5-46f7-a1d5-7f8301b2f2e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:07.457722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:07.461244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1c967-acd5-46f7-a1d5-7f8301b2f2e8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:07.482042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc6c49-3ee6-47f2-853e-c7abdc205d6e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:07.482590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 249/505] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:07.483443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1c967-acd5-46f7-a1d5-7f8301b2f2e8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:07.517859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe99d8-abe1-4f6e-a940-ac1c8bfd589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:07.518479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe99d8-abe1-4f6e-a940-ac1c8bfd589d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:07.518755 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe99d8-abe1-4f6e-a940-ac1c8bfd589d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:07.519038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe99d8-abe1-4f6e-a940-ac1c8bfd589d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:07.529962 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe99d8-abe1-4f6e-a940-ac1c8bfd589d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:07.531391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe99d8-abe1-4f6e-a940-ac1c8bfd589d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-89fe99d8-abe1-4f6e-a940-ac1c8bfd589d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:07.545256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:07.546215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:07.547231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:07.547231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:07.547231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:07.547231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 257/506] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:07.551606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe99d8-abe1-4f6e-a940-ac1c8bfd589d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:07.580918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1c967-acd5-46f7-a1d5-7f8301b2f2e8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:07.613955 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1f46e-4c16-4f50-bc8f-2a581b8a66f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:07.614568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1f46e-4c16-4f50-bc8f-2a581b8a66f5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:07.614848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1f46e-4c16-4f50-bc8f-2a581b8a66f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:07.615114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1f46e-4c16-4f50-bc8f-2a581b8a66f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:07.624647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1f46e-4c16-4f50-bc8f-2a581b8a66f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:07.626109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1f46e-4c16-4f50-bc8f-2a581b8a66f5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:07.632676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-45c1f46e-4c16-4f50-bc8f-2a581b8a66f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:07.640765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:07.646369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:07.647466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:07.647466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:07.647466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:07.647466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 250/507] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:07.647466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013fb83-12c1-4340-93f6-5dc8ebcf045d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:07.647466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013fb83-12c1-4340-93f6-5dc8ebcf045d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:07.647466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013fb83-12c1-4340-93f6-5dc8ebcf045d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:07.650175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe99d8-abe1-4f6e-a940-ac1c8bfd589d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:07.660654 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4013fb83-12c1-4340-93f6-5dc8ebcf045d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:07.661769 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4013fb83-12c1-4340-93f6-5dc8ebcf045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:07.675674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:07.683730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa3e27-b0fd-4541-b887-01e2afafbfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:07.684359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa3e27-b0fd-4541-b887-01e2afafbfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:07.684636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa3e27-b0fd-4541-b887-01e2afafbfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:07.684905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa3e27-b0fd-4541-b887-01e2afafbfc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:07.685596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa3e27-b0fd-4541-b887-01e2afafbfc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:07.685844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa3e27-b0fd-4541-b887-01e2afafbfc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:07.687218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa3e27-b0fd-4541-b887-01e2afafbfc6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:07.699001 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 258/508] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:07.699790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa3e27-b0fd-4541-b887-01e2afafbfc6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:07.727978 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 251/509] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:07.728752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013fb83-12c1-4340-93f6-5dc8ebcf045d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:07.806057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa3e27-b0fd-4541-b887-01e2afafbfc6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:07.831512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013fb83-12c1-4340-93f6-5dc8ebcf045d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:07.842403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bc941-b458-4cd1-9592-aa3c69d6762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:07.843236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bc941-b458-4cd1-9592-aa3c69d6762a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:07.843679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bc941-b458-4cd1-9592-aa3c69d6762a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:07.844136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bc941-b458-4cd1-9592-aa3c69d6762a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:07.851817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bc941-b458-4cd1-9592-aa3c69d6762a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:07.853872 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bc941-b458-4cd1-9592-aa3c69d6762a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:07.860110 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-567bc941-b458-4cd1-9592-aa3c69d6762a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:07.865247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:07.866185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:07.867095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:07.867095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:07.867095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:07.867095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:07.867095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:07.867095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:07.867095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:07.867095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:07.867095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 10:14:07.867095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:07.867095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 259/510] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:14:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:07.867095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bc941-b458-4cd1-9592-aa3c69d6762a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:07.874506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217351d-6243-45c6-91dc-4faad6627cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:07.879839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217351d-6243-45c6-91dc-4faad6627cee None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:07.879839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217351d-6243-45c6-91dc-4faad6627cee None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:07.879839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217351d-6243-45c6-91dc-4faad6627cee None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:07.879839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217351d-6243-45c6-91dc-4faad6627cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:07.879839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217351d-6243-45c6-91dc-4faad6627cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:07.879839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217351d-6243-45c6-91dc-4faad6627cee None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:07.891417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 252/511] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:07.892826 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217351d-6243-45c6-91dc-4faad6627cee None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:07.920800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:07.977701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bc941-b458-4cd1-9592-aa3c69d6762a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.000461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217351d-6243-45c6-91dc-4faad6627cee None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.011661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c08685-87e0-42cb-826f-05c0a521a250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.012286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c08685-87e0-42cb-826f-05c0a521a250 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.012565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c08685-87e0-42cb-826f-05c0a521a250 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.012839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c08685-87e0-42cb-826f-05c0a521a250 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.013479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c08685-87e0-42cb-826f-05c0a521a250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:08.013780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c08685-87e0-42cb-826f-05c0a521a250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:08.015129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c08685-87e0-42cb-826f-05c0a521a250 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:08.027249 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 260/512] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:08.028233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c08685-87e0-42cb-826f-05c0a521a250 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:08.033262 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b1618-6d3b-43d9-b8e5-d244631b45ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.033888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b1618-6d3b-43d9-b8e5-d244631b45ae None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.034160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b1618-6d3b-43d9-b8e5-d244631b45ae None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.034426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b1618-6d3b-43d9-b8e5-d244631b45ae None admin] PATH_INFO: `/v3/users/glance` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.042428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b1618-6d3b-43d9-b8e5-d244631b45ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:08.043882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b1618-6d3b-43d9-b8e5-d244631b45ae None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-e73b1618-6d3b-43d9-b8e5-d244631b45ae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:08.056181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:08.057105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:08.058012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:08.058012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:08.058012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:08.058012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:08.058012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:08.058012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:08.058012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:08.058012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:08.058012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 10:14:08.058012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:08.058012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 253/513] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:14:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:08.058012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b1618-6d3b-43d9-b8e5-d244631b45ae None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:08.106921 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:08.128965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c08685-87e0-42cb-826f-05c0a521a250 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.136626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:08.158565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b1618-6d3b-43d9-b8e5-d244631b45ae None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.163472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cbbb2-2329-4624-a99f-21808fa64b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.164037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cbbb2-2329-4624-a99f-21808fa64b0b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.164315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cbbb2-2329-4624-a99f-21808fa64b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.164583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cbbb2-2329-4624-a99f-21808fa64b0b None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.165319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cbbb2-2329-4624-a99f-21808fa64b0b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:08.165830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cbbb2-2329-4624-a99f-21808fa64b0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:08.167547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cbbb2-2329-4624-a99f-21808fa64b0b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:08.190851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885745d-4f41-4371-a450-25f5c8b3b5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.191469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885745d-4f41-4371-a450-25f5c8b3b5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.191751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885745d-4f41-4371-a450-25f5c8b3b5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.192048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885745d-4f41-4371-a450-25f5c8b3b5e0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.201062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885745d-4f41-4371-a450-25f5c8b3b5e0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:08.202489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885745d-4f41-4371-a450-25f5c8b3b5e0 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:08.203475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 261/514] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Oct 4 10:14:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:08.204326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cbbb2-2329-4624-a99f-21808fa64b0b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-6885745d-4f41-4371-a450-25f5c8b3b5e0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:08.214571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:08.215652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:08.216598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:08.216598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:08.216598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:08.216598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:08.216598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:08.216598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:08.216598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:08.216598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:08.216598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 10:14:08.216598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:08.216598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 254/515] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:08.217188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885745d-4f41-4371-a450-25f5c8b3b5e0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:08.308570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cbbb2-2329-4624-a99f-21808fa64b0b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.310762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885745d-4f41-4371-a450-25f5c8b3b5e0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.319220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:08.342510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ec611-c7a8-451b-beef-a86d0891ff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.343133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ec611-c7a8-451b-beef-a86d0891ff24 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.343410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ec611-c7a8-451b-beef-a86d0891ff24 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.343678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ec611-c7a8-451b-beef-a86d0891ff24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.343768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93286-b6c3-418c-be79-85d0816e6c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.344412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93286-b6c3-418c-be79-85d0816e6c3a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.344682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93286-b6c3-418c-be79-85d0816e6c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.344948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93286-b6c3-418c-be79-85d0816e6c3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.351447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b93286-b6c3-418c-be79-85d0816e6c3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:08.353263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b93286-b6c3-418c-be79-85d0816e6c3a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:08.353646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ec611-c7a8-451b-beef-a86d0891ff24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:08.355069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ec611-c7a8-451b-beef-a86d0891ff24 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-e6b93286-b6c3-418c-be79-85d0816e6c3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:08.364734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:08.365747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:08.366797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:08.366797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:08.366797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:08.366797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:08.366797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:08.366797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:08.366797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:08.366797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-bd5ec611-c7a8-451b-beef-a86d0891ff24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:08.369405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:08.372033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:08.372929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:08.372929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:08.372929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:08.373124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 255/516] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:08.373196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 262/517] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:08.373261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93286-b6c3-418c-be79-85d0816e6c3a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:08.373327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ec611-c7a8-451b-beef-a86d0891ff24 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:08.390702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:08.468538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93286-b6c3-418c-be79-85d0816e6c3a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.470727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ec611-c7a8-451b-beef-a86d0891ff24 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.500863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12afba-006e-43f1-b4e1-91882b522115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.501470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12afba-006e-43f1-b4e1-91882b522115 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.501752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12afba-006e-43f1-b4e1-91882b522115 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.502025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12afba-006e-43f1-b4e1-91882b522115 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.502754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12afba-006e-43f1-b4e1-91882b522115 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:08.503090 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12afba-006e-43f1-b4e1-91882b522115 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:08.503839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98770b1e-48eb-4ed3-a605-472d65c237f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.504508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98770b1e-48eb-4ed3-a605-472d65c237f3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.510178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12afba-006e-43f1-b4e1-91882b522115 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:08.510474 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98770b1e-48eb-4ed3-a605-472d65c237f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.510474 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98770b1e-48eb-4ed3-a605-472d65c237f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.522370 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 256/518] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Oct 4 10:14:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:08.523195 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12afba-006e-43f1-b4e1-91882b522115 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:08.550628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:08.576253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98770b1e-48eb-4ed3-a605-472d65c237f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:08.577711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98770b1e-48eb-4ed3-a605-472d65c237f3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:08.593824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:08.621939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12afba-006e-43f1-b4e1-91882b522115 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.655046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580619b7-81d9-4e56-8359-167d6e502c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.655640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580619b7-81d9-4e56-8359-167d6e502c73 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.655911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580619b7-81d9-4e56-8359-167d6e502c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.656212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580619b7-81d9-4e56-8359-167d6e502c73 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.656920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580619b7-81d9-4e56-8359-167d6e502c73 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:08.657219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580619b7-81d9-4e56-8359-167d6e502c73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:08.658614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580619b7-81d9-4e56-8359-167d6e502c73 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:08.674067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 263/519] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:14:08.679559 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 257/520] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Oct 4 10:14:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:08.679694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98770b1e-48eb-4ed3-a605-472d65c237f3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:08.679810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580619b7-81d9-4e56-8359-167d6e502c73 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:08.761277 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:08.776532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98770b1e-48eb-4ed3-a605-472d65c237f3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.776665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580619b7-81d9-4e56-8359-167d6e502c73 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.792289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:08.809382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f709e-a8d2-4b65-969f-c6dbb57c83fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.809978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f709e-a8d2-4b65-969f-c6dbb57c83fc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.810255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f709e-a8d2-4b65-969f-c6dbb57c83fc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.810522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f709e-a8d2-4b65-969f-c6dbb57c83fc None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.810803 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aede0-9e54-4844-bd87-ef5d093cb148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.811210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f709e-a8d2-4b65-969f-c6dbb57c83fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:08.811394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aede0-9e54-4844-bd87-ef5d093cb148 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.811515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f709e-a8d2-4b65-969f-c6dbb57c83fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:08.811675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aede0-9e54-4844-bd87-ef5d093cb148 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.811941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aede0-9e54-4844-bd87-ef5d093cb148 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.812597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aede0-9e54-4844-bd87-ef5d093cb148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:08.812909 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aede0-9e54-4844-bd87-ef5d093cb148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:08.813054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f709e-a8d2-4b65-969f-c6dbb57c83fc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:08.814234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aede0-9e54-4844-bd87-ef5d093cb148 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:08.825035 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 258/521] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:08.825803 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aede0-9e54-4844-bd87-ef5d093cb148 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:08.832398 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 264/522] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:08.833163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f709e-a8d2-4b65-969f-c6dbb57c83fc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:08.920594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aede0-9e54-4844-bd87-ef5d093cb148 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.935999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f709e-a8d2-4b65-969f-c6dbb57c83fc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:08.953663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a6752-b5ed-4ae1-829f-075a14ffd39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.954259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a6752-b5ed-4ae1-829f-075a14ffd39b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.954534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a6752-b5ed-4ae1-829f-075a14ffd39b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.954800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a6752-b5ed-4ae1-829f-075a14ffd39b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.969004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:08.969121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91016a6-a029-4957-9ff4-20b131f74ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:08.969697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91016a6-a029-4957-9ff4-20b131f74ded None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:08.969973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91016a6-a029-4957-9ff4-20b131f74ded None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:08.970245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91016a6-a029-4957-9ff4-20b131f74ded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:08.980584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91016a6-a029-4957-9ff4-20b131f74ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:08.982032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91016a6-a029-4957-9ff4-20b131f74ded None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f91016a6-a029-4957-9ff4-20b131f74ded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:08.996493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:08.997458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:08.998309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:08.998309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:08.998309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:08.998309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 265/523] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:08.998522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91016a6-a029-4957-9ff4-20b131f74ded None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:09.024856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a6752-b5ed-4ae1-829f-075a14ffd39b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:09.026256 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a6752-b5ed-4ae1-829f-075a14ffd39b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:09.026396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:09.095392 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91016a6-a029-4957-9ff4-20b131f74ded None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:09.123243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 259/524] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:14:09.123879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a6752-b5ed-4ae1-829f-075a14ffd39b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:09.128494 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f2d69-51d8-4f19-936a-2854baaa0db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:09.129104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f2d69-51d8-4f19-936a-2854baaa0db6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:09.129629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f2d69-51d8-4f19-936a-2854baaa0db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:09.129629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f2d69-51d8-4f19-936a-2854baaa0db6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:09.167278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:09.195415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f2d69-51d8-4f19-936a-2854baaa0db6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:09.197417 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f2d69-51d8-4f19-936a-2854baaa0db6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:09.220344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a6752-b5ed-4ae1-829f-075a14ffd39b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:09.223305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:09.253589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebfd4a-54fa-4b78-8a53-5bff3949b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:09.254187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebfd4a-54fa-4b78-8a53-5bff3949b180 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:09.254459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebfd4a-54fa-4b78-8a53-5bff3949b180 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:09.254726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebfd4a-54fa-4b78-8a53-5bff3949b180 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:09.255361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebfd4a-54fa-4b78-8a53-5bff3949b180 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:09.256812 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebfd4a-54fa-4b78-8a53-5bff3949b180 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:09.292927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 266/525] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:14:09.293687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f2d69-51d8-4f19-936a-2854baaa0db6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:09.382937 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 260/526] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:14:09 2022] POST /identity/v3/users => generated 247 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:14:09.383755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebfd4a-54fa-4b78-8a53-5bff3949b180 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:09.397198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f2d69-51d8-4f19-936a-2854baaa0db6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:09.428971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:09.439050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d503e1-3b72-4287-829d-65cc31bf38d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:09.439674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d503e1-3b72-4287-829d-65cc31bf38d3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:09.439981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d503e1-3b72-4287-829d-65cc31bf38d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:09.440254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d503e1-3b72-4287-829d-65cc31bf38d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:09.441004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d503e1-3b72-4287-829d-65cc31bf38d3 None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=567188b7c4fe40c1a1623d2f60092d26) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:09.441316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d503e1-3b72-4287-829d-65cc31bf38d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:09.442938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d503e1-3b72-4287-829d-65cc31bf38d3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:09.450430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 267/527] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:09 2022] GET /identity/v3/role_assignments?user.id=567188b7c4fe40c1a1623d2f60092d26&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:09.451288 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d503e1-3b72-4287-829d-65cc31bf38d3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:09.536461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:09.541416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebfd4a-54fa-4b78-8a53-5bff3949b180 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:09.598019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b73a98-0ddb-4904-b9c4-932023e2c56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:09.598563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b73a98-0ddb-4904-b9c4-932023e2c56e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:09.598839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b73a98-0ddb-4904-b9c4-932023e2c56e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:09.599106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b73a98-0ddb-4904-b9c4-932023e2c56e None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:09.599512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d503e1-3b72-4287-829d-65cc31bf38d3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:09.599763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b73a98-0ddb-4904-b9c4-932023e2c56e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:09.600713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b73a98-0ddb-4904-b9c4-932023e2c56e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:09.601879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b73a98-0ddb-4904-b9c4-932023e2c56e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:09.618693 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 261/528] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:09.621100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b73a98-0ddb-4904-b9c4-932023e2c56e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:09.646406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06ffd9-ae5c-436a-9f6a-d0f89ab14d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:09.647282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06ffd9-ae5c-436a-9f6a-d0f89ab14d06 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:09.647718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06ffd9-ae5c-436a-9f6a-d0f89ab14d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:09.648161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06ffd9-ae5c-436a-9f6a-d0f89ab14d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:09.660831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06ffd9-ae5c-436a-9f6a-d0f89ab14d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:09.662301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06ffd9-ae5c-436a-9f6a-d0f89ab14d06 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-aa06ffd9-ae5c-436a-9f6a-d0f89ab14d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:09.680098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:09.681900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:09.682951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:09.682951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:09.682951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:09.682951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 268/529] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:09.682951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06ffd9-ae5c-436a-9f6a-d0f89ab14d06 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:09.738984 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:09.770402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b73a98-0ddb-4904-b9c4-932023e2c56e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:09.811762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06ffd9-ae5c-436a-9f6a-d0f89ab14d06 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:09.813245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d941d1f-5c65-49b3-b585-4545f0d96a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:09.815293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941d1f-5c65-49b3-b585-4545f0d96a99 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:09.815773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941d1f-5c65-49b3-b585-4545f0d96a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:09.816230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941d1f-5c65-49b3-b585-4545f0d96a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:09.830177 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d941d1f-5c65-49b3-b585-4545f0d96a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:09.831808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d941d1f-5c65-49b3-b585-4545f0d96a99 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-5d941d1f-5c65-49b3-b585-4545f0d96a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:09.852030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:09.854210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:09.855063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:09.855063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:09.855063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:09.855063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 262/530] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:09.855063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d941d1f-5c65-49b3-b585-4545f0d96a99 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:09.862128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550231-ae7d-44aa-952b-6a001d3f23d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:09.862767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550231-ae7d-44aa-952b-6a001d3f23d1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:09.863045 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550231-ae7d-44aa-952b-6a001d3f23d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:09.863314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550231-ae7d-44aa-952b-6a001d3f23d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:09.875613 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:09.879255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17550231-ae7d-44aa-952b-6a001d3f23d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:09.881478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17550231-ae7d-44aa-952b-6a001d3f23d1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-17550231-ae7d-44aa-952b-6a001d3f23d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:09.898857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:09.905669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:09.907008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:09.907008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:09.907008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:09.907008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:09.907008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:09.907008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:09.907008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:09.907008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:09.907008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 269/531] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:09.907008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550231-ae7d-44aa-952b-6a001d3f23d1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:09.985103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d941d1f-5c65-49b3-b585-4545f0d96a99 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:10.021452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a471-4e26-40aa-be63-728bc5db12a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:10.022098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a471-4e26-40aa-be63-728bc5db12a5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:10.022377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a471-4e26-40aa-be63-728bc5db12a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:10.022651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a471-4e26-40aa-be63-728bc5db12a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:10.023309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894a471-4e26-40aa-be63-728bc5db12a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:10.023591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894a471-4e26-40aa-be63-728bc5db12a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:10.025528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894a471-4e26-40aa-be63-728bc5db12a5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:10.041914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 263/532] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:10.041914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a471-4e26-40aa-be63-728bc5db12a5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:10.050074 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550231-ae7d-44aa-952b-6a001d3f23d1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:10.053368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:10.102759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032ed11-91ce-4aac-9c74-9587bfc0f043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:10.104509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032ed11-91ce-4aac-9c74-9587bfc0f043 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:10.105379 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032ed11-91ce-4aac-9c74-9587bfc0f043 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:10.106221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032ed11-91ce-4aac-9c74-9587bfc0f043 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:10.107314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032ed11-91ce-4aac-9c74-9587bfc0f043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:10.108176 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032ed11-91ce-4aac-9c74-9587bfc0f043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:10.109571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032ed11-91ce-4aac-9c74-9587bfc0f043 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:10.120462 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:10.124111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 270/533] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:10.124111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032ed11-91ce-4aac-9c74-9587bfc0f043 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:10.165814 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a471-4e26-40aa-be63-728bc5db12a5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:10.202872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b233dc2-8f79-4612-b2bc-3a8478de072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:10.203926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233dc2-8f79-4612-b2bc-3a8478de072a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:10.204499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233dc2-8f79-4612-b2bc-3a8478de072a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:10.204973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233dc2-8f79-4612-b2bc-3a8478de072a None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:10.205866 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b233dc2-8f79-4612-b2bc-3a8478de072a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:10.206378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b233dc2-8f79-4612-b2bc-3a8478de072a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:10.208065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b233dc2-8f79-4612-b2bc-3a8478de072a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:10.228913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 264/534] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:10.229896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b233dc2-8f79-4612-b2bc-3a8478de072a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:10.245048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032ed11-91ce-4aac-9c74-9587bfc0f043 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:10.282250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4aa68-e8d7-440e-81d4-52171a1ab22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:10.283317 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4aa68-e8d7-440e-81d4-52171a1ab22e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:10.283799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4aa68-e8d7-440e-81d4-52171a1ab22e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:10.284347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4aa68-e8d7-440e-81d4-52171a1ab22e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:10.291633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4aa68-e8d7-440e-81d4-52171a1ab22e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:10.293347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4aa68-e8d7-440e-81d4-52171a1ab22e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-75b4aa68-e8d7-440e-81d4-52171a1ab22e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:10.305161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:10.306548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:10.307503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:10.307503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:10.307503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:10.307503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:10.307503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:10.307503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:10.307503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:10.307503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:10.309962 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 271/535] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:10.311007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4aa68-e8d7-440e-81d4-52171a1ab22e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:10.345032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:10.357725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b233dc2-8f79-4612-b2bc-3a8478de072a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:10.391235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:10.396729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedd32d-5244-4fed-a1af-2ade91237e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:10.397640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedd32d-5244-4fed-a1af-2ade91237e3b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:10.398146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedd32d-5244-4fed-a1af-2ade91237e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:10.398616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedd32d-5244-4fed-a1af-2ade91237e3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:10.405888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedd32d-5244-4fed-a1af-2ade91237e3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:10.407564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedd32d-5244-4fed-a1af-2ade91237e3b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-4cedd32d-5244-4fed-a1af-2ade91237e3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:10.419925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:10.420802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:10.421649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:10.421649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:10.421649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:10.421649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:10.421649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:10.421649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:10.421649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:10.421649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:10.424414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 265/536] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:10.425521 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedd32d-5244-4fed-a1af-2ade91237e3b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:10.447908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4aa68-e8d7-440e-81d4-52171a1ab22e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:10.491816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fbba9-7312-400a-be8c-46e409272ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:10.492583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fbba9-7312-400a-be8c-46e409272ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:10.492864 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fbba9-7312-400a-be8c-46e409272ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:10.493139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fbba9-7312-400a-be8c-46e409272ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:10.493928 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fbba9-7312-400a-be8c-46e409272ae9 None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=2bf4d6e392fd4f8dadb37527f1750fc0) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:10.494490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fbba9-7312-400a-be8c-46e409272ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:10.496702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fbba9-7312-400a-be8c-46e409272ae9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:10.504504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 272/537] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:10 2022] GET /identity/v3/role_assignments?user.id=2bf4d6e392fd4f8dadb37527f1750fc0&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:10.505367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fbba9-7312-400a-be8c-46e409272ae9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:10.561592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedd32d-5244-4fed-a1af-2ade91237e3b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:10.615679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7300960-467e-4cf2-8999-01abc6862f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:10.616753 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7300960-467e-4cf2-8999-01abc6862f22 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:10.617334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7300960-467e-4cf2-8999-01abc6862f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:10.617819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:10.618841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7300960-467e-4cf2-8999-01abc6862f22 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:10.619768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7300960-467e-4cf2-8999-01abc6862f22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:10.621466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7300960-467e-4cf2-8999-01abc6862f22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:10.624813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7300960-467e-4cf2-8999-01abc6862f22 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:10.646161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fbba9-7312-400a-be8c-46e409272ae9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:10.649926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 266/538] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:10.657071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7300960-467e-4cf2-8999-01abc6862f22 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:10.722435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:10.746106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c45978-931d-4134-8649-57a82632a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:10.746892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c45978-931d-4134-8649-57a82632a5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:10.747275 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c45978-931d-4134-8649-57a82632a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:10.747645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c45978-931d-4134-8649-57a82632a5c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:10.748552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c45978-931d-4134-8649-57a82632a5c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:10.748959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c45978-931d-4134-8649-57a82632a5c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:10.750489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c45978-931d-4134-8649-57a82632a5c5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:10.777235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7300960-467e-4cf2-8999-01abc6862f22 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:10.782475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 273/539] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:10.789671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c45978-931d-4134-8649-57a82632a5c5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:10.832600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e2564-c885-412a-b419-3be919de5730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:10.833629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e2564-c885-412a-b419-3be919de5730 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:10.834105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e2564-c885-412a-b419-3be919de5730 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:10.835578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e2564-c885-412a-b419-3be919de5730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:10.836558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e2564-c885-412a-b419-3be919de5730 None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=6462736c485545d8a26766360ebe0c0e) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:10.838495 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e2564-c885-412a-b419-3be919de5730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:10.840398 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e2564-c885-412a-b419-3be919de5730 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:10.855771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 267/540] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:10 2022] GET /identity/v3/role_assignments?user.id=6462736c485545d8a26766360ebe0c0e&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:10.966744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c45978-931d-4134-8649-57a82632a5c5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:11.016430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccef12e-9c74-49e5-b238-176fabe77559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:11.017043 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccef12e-9c74-49e5-b238-176fabe77559 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:11.017313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccef12e-9c74-49e5-b238-176fabe77559 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:11.017643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccef12e-9c74-49e5-b238-176fabe77559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:11.018376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccef12e-9c74-49e5-b238-176fabe77559 None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=b040de20aa6f4e7b8366c7daa54c093c) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:11.018734 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccef12e-9c74-49e5-b238-176fabe77559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:11.020207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccef12e-9c74-49e5-b238-176fabe77559 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:11.029109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 274/541] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:10 2022] GET /identity/v3/role_assignments?user.id=b040de20aa6f4e7b8366c7daa54c093c&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:11.821032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e289e-9bdb-4014-ae2a-2f7e7efe9a8e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:11.821611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e289e-9bdb-4014-ae2a-2f7e7efe9a8e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:11.821721 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e289e-9bdb-4014-ae2a-2f7e7efe9a8e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:11.823247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 268/542] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:11.828856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8217e5-5ccb-4f6a-afef-1b221fd4066b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:11.829266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8217e5-5ccb-4f6a-afef-1b221fd4066b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:11.829467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8217e5-5ccb-4f6a-afef-1b221fd4066b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:11.833768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262211-0fec-40df-aded-1d1b769a2226 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:11.834300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262211-0fec-40df-aded-1d1b769a2226 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:11.834771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262211-0fec-40df-aded-1d1b769a2226 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:11.836898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 269/543] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:11.843367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15eace-3c98-4658-a7ae-e73f4991fb5e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:11.843911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15eace-3c98-4658-a7ae-e73f4991fb5e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:11.844930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15eace-3c98-4658-a7ae-e73f4991fb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:11.856026 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-bd8217e5-5ccb-4f6a-afef-1b221fd4066b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:11.857240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bd8217e5-5ccb-4f6a-afef-1b221fd4066b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:11.866993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3f15eace-3c98-4658-a7ae-e73f4991fb5e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:11.868536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3f15eace-3c98-4658-a7ae-e73f4991fb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:11.870665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:11.950698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 275/544] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:14:12.003144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 270/545] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:14:12.306467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8217e5-5ccb-4f6a-afef-1b221fd4066b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:12.349314 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15eace-3c98-4658-a7ae-e73f4991fb5e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:12.404297 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:12.479959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8217e5-5ccb-4f6a-afef-1b221fd4066b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:12.502981 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15eace-3c98-4658-a7ae-e73f4991fb5e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:12.553724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96123a-1c6f-4b78-8b07-8d262b297e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:12.554358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96123a-1c6f-4b78-8b07-8d262b297e1d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:12.554632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96123a-1c6f-4b78-8b07-8d262b297e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:12.554897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96123a-1c6f-4b78-8b07-8d262b297e1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:12.568700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4cb67-0efa-48c7-85fd-618f6b150fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:12.569263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4cb67-0efa-48c7-85fd-618f6b150fdd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:12.569533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4cb67-0efa-48c7-85fd-618f6b150fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:12.569799 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4cb67-0efa-48c7-85fd-618f6b150fdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:12.577638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96123a-1c6f-4b78-8b07-8d262b297e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7a96123a-1c6f-4b78-8b07-8d262b297e1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:12.582358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:12.583257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:12.584080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 276/546] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:12.591149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96123a-1c6f-4b78-8b07-8d262b297e1d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:12.592595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4cb67-0efa-48c7-85fd-618f6b150fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:12.599006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-5cb4cb67-0efa-48c7-85fd-618f6b150fdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:12.606994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:12.609119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:12.610820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 271/547] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:12.616671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4cb67-0efa-48c7-85fd-618f6b150fdd None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:12.735079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96123a-1c6f-4b78-8b07-8d262b297e1d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:12.770195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6caf2f-a7cd-4a6b-a9a5-c54a856875ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:12.770790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6caf2f-a7cd-4a6b-a9a5-c54a856875ac None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:12.771065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6caf2f-a7cd-4a6b-a9a5-c54a856875ac None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:12.771330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6caf2f-a7cd-4a6b-a9a5-c54a856875ac None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:12.772038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6caf2f-a7cd-4a6b-a9a5-c54a856875ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:12.772348 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6caf2f-a7cd-4a6b-a9a5-c54a856875ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:12.774193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6caf2f-a7cd-4a6b-a9a5-c54a856875ac None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:12.782923 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 277/548] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:12.788310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6caf2f-a7cd-4a6b-a9a5-c54a856875ac None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:12.869089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4cb67-0efa-48c7-85fd-618f6b150fdd None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:12.885450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:12.888324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:12.891856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6caf2f-a7cd-4a6b-a9a5-c54a856875ac None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:12.927149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7e8ee-cca7-4eeb-9fb9-9a7c11dbad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:12.927980 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7e8ee-cca7-4eeb-9fb9-9a7c11dbad89 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:12.928252 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7e8ee-cca7-4eeb-9fb9-9a7c11dbad89 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:12.928512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7e8ee-cca7-4eeb-9fb9-9a7c11dbad89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:12.940287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7e8ee-cca7-4eeb-9fb9-9a7c11dbad89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:12.941724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7e8ee-cca7-4eeb-9fb9-9a7c11dbad89 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-27d7e8ee-cca7-4eeb-9fb9-9a7c11dbad89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:12.957368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:12.958322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:12.959208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:12.959208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:12.959208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:12.959208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 278/549] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:12.964669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f343b12-e79a-454b-b523-399646b13a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:12.965305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f343b12-e79a-454b-b523-399646b13a72 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:12.965590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f343b12-e79a-454b-b523-399646b13a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:12.965776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7e8ee-cca7-4eeb-9fb9-9a7c11dbad89 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:12.965932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f343b12-e79a-454b-b523-399646b13a72 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:12.966535 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f343b12-e79a-454b-b523-399646b13a72 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:12.966844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f343b12-e79a-454b-b523-399646b13a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:12.968257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f343b12-e79a-454b-b523-399646b13a72 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:12.985074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 272/550] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:12.993078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f343b12-e79a-454b-b523-399646b13a72 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:13.074033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7e8ee-cca7-4eeb-9fb9-9a7c11dbad89 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:13.099840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:13.119819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dd9aa-b182-4ffd-963a-a68fa6874baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:13.121209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd9aa-b182-4ffd-963a-a68fa6874baa None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:13.121209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd9aa-b182-4ffd-963a-a68fa6874baa None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:13.121466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd9aa-b182-4ffd-963a-a68fa6874baa None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:13.122130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd9aa-b182-4ffd-963a-a68fa6874baa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:13.122432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd9aa-b182-4ffd-963a-a68fa6874baa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:13.123798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd9aa-b182-4ffd-963a-a68fa6874baa None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:13.139830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 279/551] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:13.141089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f09a8-d9a4-431d-8477-ede4f7a8605d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:13.141364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f09a8-d9a4-431d-8477-ede4f7a8605d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:13.141694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f09a8-d9a4-431d-8477-ede4f7a8605d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:13.146870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 280/552] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:13.146870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f09a8-d9a4-431d-8477-ede4f7a8605d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:13.166863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f343b12-e79a-454b-b523-399646b13a72 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:13.219427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08edbb-37cb-4535-ad56-734b8cfa7857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:13.220094 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08edbb-37cb-4535-ad56-734b8cfa7857 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:13.220381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08edbb-37cb-4535-ad56-734b8cfa7857 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:13.220656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08edbb-37cb-4535-ad56-734b8cfa7857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:13.233340 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08edbb-37cb-4535-ad56-734b8cfa7857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:13.236557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08edbb-37cb-4535-ad56-734b8cfa7857 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-ea08edbb-37cb-4535-ad56-734b8cfa7857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:13.250953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:13.252151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:13.253330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:13.253330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:13.253330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:13.254674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 273/553] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:13.256078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bec9e-2bbe-4414-adb9-77b085f1fc56 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:13.256453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bec9e-2bbe-4414-adb9-77b085f1fc56 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:13.256859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bec9e-2bbe-4414-adb9-77b085f1fc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:13.276625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-028bec9e-2bbe-4414-adb9-77b085f1fc56 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:13.278047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-028bec9e-2bbe-4414-adb9-77b085f1fc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:13.279045 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f09a8-d9a4-431d-8477-ede4f7a8605d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:13.294713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:13.331291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1af31-18e3-4c38-a02a-eb077beb6db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:13.332876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1af31-18e3-4c38-a02a-eb077beb6db4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:13.333419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1af31-18e3-4c38-a02a-eb077beb6db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:13.333831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1af31-18e3-4c38-a02a-eb077beb6db4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:13.344990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1af31-18e3-4c38-a02a-eb077beb6db4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:13.347544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1af31-18e3-4c38-a02a-eb077beb6db4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:13.356226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 274/554] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:13.357275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bec9e-2bbe-4414-adb9-77b085f1fc56 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-cff1af31-18e3-4c38-a02a-eb077beb6db4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:13.360821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:13.361743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:13.362659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:13.362659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:13.362659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:13.362659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:13.362659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:13.362659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:13.362659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:13.362659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:13.362659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 10:14:13.362659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:13.366184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 281/555] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:14:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:13.373282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1af31-18e3-4c38-a02a-eb077beb6db4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:13.411018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:13.514439 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1af31-18e3-4c38-a02a-eb077beb6db4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:13.554722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bec9e-2bbe-4414-adb9-77b085f1fc56 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:13.580566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34672-f406-4421-8769-1c610f0c9f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:13.581190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34672-f406-4421-8769-1c610f0c9f98 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:13.581531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34672-f406-4421-8769-1c610f0c9f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:13.581800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34672-f406-4421-8769-1c610f0c9f98 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:13.582592 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b34672-f406-4421-8769-1c610f0c9f98 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:13.582902 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b34672-f406-4421-8769-1c610f0c9f98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:13.585659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b34672-f406-4421-8769-1c610f0c9f98 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:13.619817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782d94e-29d2-4f1a-8127-0a762abceae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:13.620539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782d94e-29d2-4f1a-8127-0a762abceae8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:13.620647 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 282/556] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Oct 4 10:14:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:13.620807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782d94e-29d2-4f1a-8127-0a762abceae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:13.621076 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782d94e-29d2-4f1a-8127-0a762abceae8 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:13.621737 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782d94e-29d2-4f1a-8127-0a762abceae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:13.621842 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3b5de-81cf-4bfa-8f45-f7c28f6104c8 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:13.622039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782d94e-29d2-4f1a-8127-0a762abceae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:13.622137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3b5de-81cf-4bfa-8f45-f7c28f6104c8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:13.622357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3b5de-81cf-4bfa-8f45-f7c28f6104c8 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:13.623459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782d94e-29d2-4f1a-8127-0a762abceae8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:13.623939 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 283/557] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:13.626688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3b5de-81cf-4bfa-8f45-f7c28f6104c8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:13.637220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 275/558] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:13.638590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8813c2-20ba-4ca3-a1e4-743e8c3b3b7b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:13.638908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8813c2-20ba-4ca3-a1e4-743e8c3b3b7b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:13.639196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8813c2-20ba-4ca3-a1e4-743e8c3b3b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:13.659278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ea8813c2-20ba-4ca3-a1e4-743e8c3b3b7b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:13.660592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ea8813c2-20ba-4ca3-a1e4-743e8c3b3b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:13.663378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:13.731917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 276/559] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:13.733067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8813c2-20ba-4ca3-a1e4-743e8c3b3b7b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:13.736291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:13.745001 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3b5de-81cf-4bfa-8f45-f7c28f6104c8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:13.784135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3023fd-510b-4489-a145-06b3b041d951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:13.784738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3023fd-510b-4489-a145-06b3b041d951 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:13.785026 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3023fd-510b-4489-a145-06b3b041d951 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:13.785291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3023fd-510b-4489-a145-06b3b041d951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:13.834001 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8813c2-20ba-4ca3-a1e4-743e8c3b3b7b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:13.853463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3023fd-510b-4489-a145-06b3b041d951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:13.854905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3023fd-510b-4489-a145-06b3b041d951 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:13.867360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c503a-52c6-4281-ab54-9fb42d8adfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:13.868012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c503a-52c6-4281-ab54-9fb42d8adfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:13.868818 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c503a-52c6-4281-ab54-9fb42d8adfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:13.869091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c503a-52c6-4281-ab54-9fb42d8adfa0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:13.875971 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c503a-52c6-4281-ab54-9fb42d8adfa0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:13.878152 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c503a-52c6-4281-ab54-9fb42d8adfa0 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:13.881001 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-fe8c503a-52c6-4281-ab54-9fb42d8adfa0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:13.890255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:13.894822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:13.895801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:13.895801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:13.895801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:13.895801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:13.895801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:13.895801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:13.895801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:13.895801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:13.895801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:14:13.895801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:13.895801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 277/560] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 10:14:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:13.895801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c503a-52c6-4281-ab54-9fb42d8adfa0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:13.962944 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:13.971289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 284/561] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 10:14:13.972342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d85324-5b18-4468-8258-4d51dc461049 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:13.972620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d85324-5b18-4468-8258-4d51dc461049 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:13.972886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d85324-5b18-4468-8258-4d51dc461049 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:13.974170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 285/562] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:13.979176 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d85324-5b18-4468-8258-4d51dc461049 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:14.015824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c503a-52c6-4281-ab54-9fb42d8adfa0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.049686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482edb17-125e-4b22-b136-3b33561a574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:14.050312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482edb17-125e-4b22-b136-3b33561a574b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.050591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482edb17-125e-4b22-b136-3b33561a574b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.050861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482edb17-125e-4b22-b136-3b33561a574b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.061565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482edb17-125e-4b22-b136-3b33561a574b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-482edb17-125e-4b22-b136-3b33561a574b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:14.066638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:14.067614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:14.068500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:14.068500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:14.068500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:14.068500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:14.068500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:14.068500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:14.068500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:14.068500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:14.068500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:14.068500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:14.068500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:14.068500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:14.073184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 278/563] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:14.074020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482edb17-125e-4b22-b136-3b33561a574b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:14.078709 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d85324-5b18-4468-8258-4d51dc461049 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.113147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762a163-8722-4aa8-84c4-e9e66444ea86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:14.113977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762a163-8722-4aa8-84c4-e9e66444ea86 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.114092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762a163-8722-4aa8-84c4-e9e66444ea86 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.114276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762a163-8722-4aa8-84c4-e9e66444ea86 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.115000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762a163-8722-4aa8-84c4-e9e66444ea86 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:14.115314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762a163-8722-4aa8-84c4-e9e66444ea86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:14.116753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762a163-8722-4aa8-84c4-e9e66444ea86 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:14.131571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:14.133228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 286/564] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 10:14:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:14.134920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51eafb-928b-4112-91ad-993e5d5701ab None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.135206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51eafb-928b-4112-91ad-993e5d5701ab None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.135477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51eafb-928b-4112-91ad-993e5d5701ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.152862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9a51eafb-928b-4112-91ad-993e5d5701ab None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:14.154200 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9a51eafb-928b-4112-91ad-993e5d5701ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:14.174416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482edb17-125e-4b22-b136-3b33561a574b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.200300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:14.207104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b915b2-870f-43ba-874e-30a49de09f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:14.207724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b915b2-870f-43ba-874e-30a49de09f79 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.208026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b915b2-870f-43ba-874e-30a49de09f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.208297 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b915b2-870f-43ba-874e-30a49de09f79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.218761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b915b2-870f-43ba-874e-30a49de09f79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:14.219040 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 287/565] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:14.219834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51eafb-928b-4112-91ad-993e5d5701ab None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:14.220240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b915b2-870f-43ba-874e-30a49de09f79 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-b7b915b2-870f-43ba-874e-30a49de09f79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:14.236546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:14.237712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:14.238617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:14.238617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:14.238617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:14.238617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 279/566] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:14.238840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b915b2-870f-43ba-874e-30a49de09f79 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:14.328858 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51eafb-928b-4112-91ad-993e5d5701ab None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.347898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b915b2-870f-43ba-874e-30a49de09f79 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.360761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:14.366309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d1c96-6a0d-4e75-9898-bc7ff0266eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:14.366943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d1c96-6a0d-4e75-9898-bc7ff0266eda None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.367220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d1c96-6a0d-4e75-9898-bc7ff0266eda None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.367779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d1c96-6a0d-4e75-9898-bc7ff0266eda None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.378135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d1c96-6a0d-4e75-9898-bc7ff0266eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:14.381310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee4a38-3e5a-4fc1-b06e-c752afd8e9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:14.382035 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee4a38-3e5a-4fc1-b06e-c752afd8e9ea None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.382228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee4a38-3e5a-4fc1-b06e-c752afd8e9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.382486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee4a38-3e5a-4fc1-b06e-c752afd8e9ea None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-094d1c96-6a0d-4e75-9898-bc7ff0266eda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:14.383063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:14.384527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:14.385366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:14.385366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:14.385366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:14.385366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:14.385366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:14.385366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:14.385366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:14.385366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:14.385366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:14.385366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:14.385366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:14.385366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:14.385999 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee4a38-3e5a-4fc1-b06e-c752afd8e9ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:14.385999 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee4a38-3e5a-4fc1-b06e-c752afd8e9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:14.386133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 288/567] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:14.386210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee4a38-3e5a-4fc1-b06e-c752afd8e9ea None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:14.390224 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d1c96-6a0d-4e75-9898-bc7ff0266eda None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:14.398985 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 280/568] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:14.399911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee4a38-3e5a-4fc1-b06e-c752afd8e9ea None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:14.437090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:14.498008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d1c96-6a0d-4e75-9898-bc7ff0266eda None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.499650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee4a38-3e5a-4fc1-b06e-c752afd8e9ea None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.531388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221345c3-73c6-4b6d-b3ad-3f698d5a5d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:14.532034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221345c3-73c6-4b6d-b3ad-3f698d5a5d76 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.532311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221345c3-73c6-4b6d-b3ad-3f698d5a5d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.532484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51446b53-82b8-4573-90ad-948e5a93d397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:14.532590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221345c3-73c6-4b6d-b3ad-3f698d5a5d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.533085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51446b53-82b8-4573-90ad-948e5a93d397 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.533360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51446b53-82b8-4573-90ad-948e5a93d397 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.533627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51446b53-82b8-4573-90ad-948e5a93d397 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.534257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51446b53-82b8-4573-90ad-948e5a93d397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:14.534555 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51446b53-82b8-4573-90ad-948e5a93d397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:14.535924 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51446b53-82b8-4573-90ad-948e5a93d397 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:14.542331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221345c3-73c6-4b6d-b3ad-3f698d5a5d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:14.543731 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221345c3-73c6-4b6d-b3ad-3f698d5a5d76 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:14.547450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 281/569] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:14.548329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51446b53-82b8-4573-90ad-948e5a93d397 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-221345c3-73c6-4b6d-b3ad-3f698d5a5d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:14.559029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:14.560210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:14.561352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:14.561352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:14.561352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:14.561352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 289/570] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:14.561352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221345c3-73c6-4b6d-b3ad-3f698d5a5d76 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:14.583693 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:14.647749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51446b53-82b8-4573-90ad-948e5a93d397 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.654676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:14.660925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221345c3-73c6-4b6d-b3ad-3f698d5a5d76 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.681416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee758f7f-9380-4a67-952c-03df568109bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:14.682011 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee758f7f-9380-4a67-952c-03df568109bc None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.682288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee758f7f-9380-4a67-952c-03df568109bc None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.682557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee758f7f-9380-4a67-952c-03df568109bc None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.683207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee758f7f-9380-4a67-952c-03df568109bc None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:14.683507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee758f7f-9380-4a67-952c-03df568109bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:14.684892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee758f7f-9380-4a67-952c-03df568109bc None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:14.692539 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df601c89-280f-4e72-8061-9243c1e0f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:14.693052 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 282/571] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:14.693274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df601c89-280f-4e72-8061-9243c1e0f13c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.693512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df601c89-280f-4e72-8061-9243c1e0f13c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.693724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee758f7f-9380-4a67-952c-03df568109bc None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:14.694228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df601c89-280f-4e72-8061-9243c1e0f13c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.706203 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df601c89-280f-4e72-8061-9243c1e0f13c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:14.707786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df601c89-280f-4e72-8061-9243c1e0f13c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-df601c89-280f-4e72-8061-9243c1e0f13c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:14.722415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:14.723520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:14.724722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:14.724722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:14.724722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:14.724722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 290/572] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:14.724722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df601c89-280f-4e72-8061-9243c1e0f13c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:14.791160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:14.796505 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee758f7f-9380-4a67-952c-03df568109bc None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.826976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df601c89-280f-4e72-8061-9243c1e0f13c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.829621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85344d-f631-49d2-a9ca-6acf1c0a96ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:14.830319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85344d-f631-49d2-a9ca-6acf1c0a96ee None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.830599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85344d-f631-49d2-a9ca-6acf1c0a96ee None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.830868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85344d-f631-49d2-a9ca-6acf1c0a96ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.841033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85344d-f631-49d2-a9ca-6acf1c0a96ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-4f85344d-f631-49d2-a9ca-6acf1c0a96ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:14.845745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:14.846873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 283/573] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:14.847723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85344d-f631-49d2-a9ca-6acf1c0a96ee None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:14.863974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62944b5f-5268-4ffe-b30a-dcd2e90131d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:14.864607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62944b5f-5268-4ffe-b30a-dcd2e90131d9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.864885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62944b5f-5268-4ffe-b30a-dcd2e90131d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.865156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62944b5f-5268-4ffe-b30a-dcd2e90131d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.871697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62944b5f-5268-4ffe-b30a-dcd2e90131d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:14.873154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62944b5f-5268-4ffe-b30a-dcd2e90131d9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-62944b5f-5268-4ffe-b30a-dcd2e90131d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:14.884577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:14.886228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:14.888014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:14.888014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:14.888014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:14.888014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:14.888014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:14.888014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:14.888014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:14.888014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:14.888965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 291/574] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:14.889440 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62944b5f-5268-4ffe-b30a-dcd2e90131d9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:14.898258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:14.952474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85344d-f631-49d2-a9ca-6acf1c0a96ee None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.985022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1453b81-28a0-46e5-b15c-f735519360be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:14.985620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1453b81-28a0-46e5-b15c-f735519360be None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:14.985895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1453b81-28a0-46e5-b15c-f735519360be None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:14.986165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1453b81-28a0-46e5-b15c-f735519360be None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:14.986798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1453b81-28a0-46e5-b15c-f735519360be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:14.987096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1453b81-28a0-46e5-b15c-f735519360be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:14.988487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1453b81-28a0-46e5-b15c-f735519360be None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:14.989930 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62944b5f-5268-4ffe-b30a-dcd2e90131d9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:14.999682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 284/575] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:15.002897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1453b81-28a0-46e5-b15c-f735519360be None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.019918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:15.023822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113875f-55c9-4c1d-ad58-51ae05c7e6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:15.024482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113875f-55c9-4c1d-ad58-51ae05c7e6ab None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:15.025299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113875f-55c9-4c1d-ad58-51ae05c7e6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:15.025565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113875f-55c9-4c1d-ad58-51ae05c7e6ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:15.035656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113875f-55c9-4c1d-ad58-51ae05c7e6ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:15.037111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113875f-55c9-4c1d-ad58-51ae05c7e6ab None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6113875f-55c9-4c1d-ad58-51ae05c7e6ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:15.050477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:15.051456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:15.052390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:15.052390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:15.052390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:15.052390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 292/576] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:15.052390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113875f-55c9-4c1d-ad58-51ae05c7e6ab None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.099626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1453b81-28a0-46e5-b15c-f735519360be None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:15.114433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:15.132790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639e31a-691a-4612-81d8-98a20d49c081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:15.133389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639e31a-691a-4612-81d8-98a20d49c081 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:15.133664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639e31a-691a-4612-81d8-98a20d49c081 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:15.134468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639e31a-691a-4612-81d8-98a20d49c081 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:15.135100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639e31a-691a-4612-81d8-98a20d49c081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:15.135402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639e31a-691a-4612-81d8-98a20d49c081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:15.136788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639e31a-691a-4612-81d8-98a20d49c081 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:15.147781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 285/577] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:15.148816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639e31a-691a-4612-81d8-98a20d49c081 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.155044 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113875f-55c9-4c1d-ad58-51ae05c7e6ab None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:15.190147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d88656-d531-4edb-90ef-502c6fb21617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:15.190736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d88656-d531-4edb-90ef-502c6fb21617 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:15.191012 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d88656-d531-4edb-90ef-502c6fb21617 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:15.191281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d88656-d531-4edb-90ef-502c6fb21617 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:15.191936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d88656-d531-4edb-90ef-502c6fb21617 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:15.192263 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d88656-d531-4edb-90ef-502c6fb21617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:15.193614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d88656-d531-4edb-90ef-502c6fb21617 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:15.201747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 293/578] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:15.202520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d88656-d531-4edb-90ef-502c6fb21617 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.225919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:15.248006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639e31a-691a-4612-81d8-98a20d49c081 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:15.281073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b573a59-abc2-4677-93a9-1db7d8ab72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:15.281680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b573a59-abc2-4677-93a9-1db7d8ab72a0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:15.281957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b573a59-abc2-4677-93a9-1db7d8ab72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:15.282226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b573a59-abc2-4677-93a9-1db7d8ab72a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:15.282906 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b573a59-abc2-4677-93a9-1db7d8ab72a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:15.283208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b573a59-abc2-4677-93a9-1db7d8ab72a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:15.284659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b573a59-abc2-4677-93a9-1db7d8ab72a0 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:15.296230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 286/579] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:15.297002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b573a59-abc2-4677-93a9-1db7d8ab72a0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.297667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d88656-d531-4edb-90ef-502c6fb21617 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:15.319531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:15.333451 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4899b6-2934-4db8-84ca-b8247b30c510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:15.334073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4899b6-2934-4db8-84ca-b8247b30c510 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:15.334348 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4899b6-2934-4db8-84ca-b8247b30c510 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:15.334616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4899b6-2934-4db8-84ca-b8247b30c510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:15.342205 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4899b6-2934-4db8-84ca-b8247b30c510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:15.343622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4899b6-2934-4db8-84ca-b8247b30c510 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-fc4899b6-2934-4db8-84ca-b8247b30c510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:15.355156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:15.356076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:15.356983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:15.356983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:15.356983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:15.356983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:15.356983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:15.356983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:15.356983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:15.356983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:15.356983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 294/580] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:15.357541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4899b6-2934-4db8-84ca-b8247b30c510 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.398766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b573a59-abc2-4677-93a9-1db7d8ab72a0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:15.433142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeaa90-9891-4f2f-9814-2344414959a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:15.433702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeaa90-9891-4f2f-9814-2344414959a3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:15.433974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeaa90-9891-4f2f-9814-2344414959a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:15.434239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeaa90-9891-4f2f-9814-2344414959a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:15.434876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afeaa90-9891-4f2f-9814-2344414959a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:15.435174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afeaa90-9891-4f2f-9814-2344414959a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:15.436551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afeaa90-9891-4f2f-9814-2344414959a3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:15.438785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:15.447813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 287/581] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:15.448630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeaa90-9891-4f2f-9814-2344414959a3 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.454156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4899b6-2934-4db8-84ca-b8247b30c510 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:15.488792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a15b6-5ab5-4854-a016-321a76484c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:15.489406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a15b6-5ab5-4854-a016-321a76484c3c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:15.489682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a15b6-5ab5-4854-a016-321a76484c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:15.489954 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a15b6-5ab5-4854-a016-321a76484c3c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:15.497131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a15b6-5ab5-4854-a016-321a76484c3c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:15.498543 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a15b6-5ab5-4854-a016-321a76484c3c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ca3a15b6-5ab5-4854-a016-321a76484c3c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:15.509509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:15.510612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:15.511728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:15.511728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:15.511728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:15.511728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:15.511728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:15.511728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:15.511728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:15.511728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:15.511728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 10:14:15.511728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:15.511728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 295/582] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:14:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:15.515982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a15b6-5ab5-4854-a016-321a76484c3c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.546647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeaa90-9891-4f2f-9814-2344414959a3 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:15.565642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:15.590393 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dce1b-6e5b-4af1-8316-b394a0066952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:15.591025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dce1b-6e5b-4af1-8316-b394a0066952 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:15.591302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dce1b-6e5b-4af1-8316-b394a0066952 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:15.591572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dce1b-6e5b-4af1-8316-b394a0066952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:15.602044 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dce1b-6e5b-4af1-8316-b394a0066952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:15.603980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dce1b-6e5b-4af1-8316-b394a0066952 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-686dce1b-6e5b-4af1-8316-b394a0066952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:15.617958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:15.619556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:15.620496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:15.620496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:15.620496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:15.620496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 288/583] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:15.620496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dce1b-6e5b-4af1-8316-b394a0066952 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.627802 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a15b6-5ab5-4854-a016-321a76484c3c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:15.659531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aee1ad-5bb3-4d2e-a72e-14225c22742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:15.660146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aee1ad-5bb3-4d2e-a72e-14225c22742d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:15.660417 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aee1ad-5bb3-4d2e-a72e-14225c22742d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:15.660685 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aee1ad-5bb3-4d2e-a72e-14225c22742d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:15.661393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aee1ad-5bb3-4d2e-a72e-14225c22742d None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=fe9c03800bc6451aa9e5a39ca4ea0bf7) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:15.661692 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aee1ad-5bb3-4d2e-a72e-14225c22742d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:15.663079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aee1ad-5bb3-4d2e-a72e-14225c22742d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:15.667278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:15.668716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 296/584] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:15 2022] GET /identity/v3/role_assignments?user.id=fe9c03800bc6451aa9e5a39ca4ea0bf7&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:15.677065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aee1ad-5bb3-4d2e-a72e-14225c22742d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.724248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dce1b-6e5b-4af1-8316-b394a0066952 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:15.764694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3a61-5c7a-47a0-ba48-7aaaa2057a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:15.765310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3a61-5c7a-47a0-ba48-7aaaa2057a25 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:15.765584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3a61-5c7a-47a0-ba48-7aaaa2057a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:15.765852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3a61-5c7a-47a0-ba48-7aaaa2057a25 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:15.766543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d3a61-5c7a-47a0-ba48-7aaaa2057a25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:15.766844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d3a61-5c7a-47a0-ba48-7aaaa2057a25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:15.768371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d3a61-5c7a-47a0-ba48-7aaaa2057a25 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:15.786744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 289/585] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:15.786744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3a61-5c7a-47a0-ba48-7aaaa2057a25 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.795344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aee1ad-5bb3-4d2e-a72e-14225c22742d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:15.798952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:15.836272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bd20f-637d-4537-916a-59ef8c7991a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:15.836917 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bd20f-637d-4537-916a-59ef8c7991a3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:15.837256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bd20f-637d-4537-916a-59ef8c7991a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:15.837654 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bd20f-637d-4537-916a-59ef8c7991a3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:15.846002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bd20f-637d-4537-916a-59ef8c7991a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:15.847433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bd20f-637d-4537-916a-59ef8c7991a3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-c39bd20f-637d-4537-916a-59ef8c7991a3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:15.859972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:15.860943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:15.861890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:15.861890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:15.861890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:15.861890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:15.861890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:15.861890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:15.861890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:15.861890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:15.861890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 10:14:15.861890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:15.861890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 297/586] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:14:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:15.863014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bd20f-637d-4537-916a-59ef8c7991a3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.898618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3a61-5c7a-47a0-ba48-7aaaa2057a25 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:15.909873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:15.936735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fce29-ff1f-42c6-a2a0-705c51574a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:15.937468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fce29-ff1f-42c6-a2a0-705c51574a39 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:15.937821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fce29-ff1f-42c6-a2a0-705c51574a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:15.938165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fce29-ff1f-42c6-a2a0-705c51574a39 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:15.938959 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fce29-ff1f-42c6-a2a0-705c51574a39 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:15.939345 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fce29-ff1f-42c6-a2a0-705c51574a39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:15.940882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fce29-ff1f-42c6-a2a0-705c51574a39 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:15.961421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 290/587] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Oct 4 10:14:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:15.964733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fce29-ff1f-42c6-a2a0-705c51574a39 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:15.990066 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bd20f-637d-4537-916a-59ef8c7991a3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:16.027568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519fc8f-c848-4db0-b67f-4893de200264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:16.028354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519fc8f-c848-4db0-b67f-4893de200264 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:16.028642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519fc8f-c848-4db0-b67f-4893de200264 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:16.028912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519fc8f-c848-4db0-b67f-4893de200264 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:16.029857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519fc8f-c848-4db0-b67f-4893de200264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:16.030166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519fc8f-c848-4db0-b67f-4893de200264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:16.031507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519fc8f-c848-4db0-b67f-4893de200264 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:16.044976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 298/588] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:16.045739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519fc8f-c848-4db0-b67f-4893de200264 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:16.071630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:16.072338 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fce29-ff1f-42c6-a2a0-705c51574a39 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:16.107686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518fb66-3c6f-408d-b538-f16cfd3a7296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:16.108379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518fb66-3c6f-408d-b538-f16cfd3a7296 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:16.108657 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518fb66-3c6f-408d-b538-f16cfd3a7296 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:16.108934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518fb66-3c6f-408d-b538-f16cfd3a7296 None admin] PATH_INFO: `/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/567188b7c4fe40c1a1623d2f60092d26/roles/f53f657a7b1f44a98ec5e754a93d8b3c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:16.124603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518fb66-3c6f-408d-b538-f16cfd3a7296 None admin] RBAC: Authorizing `identity:create_grant(project_id=c41ae2f9d03c48be8017a1ca480bf7db, user_id=567188b7c4fe40c1a1623d2f60092d26, role_id=f53f657a7b1f44a98ec5e754a93d8b3c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:16.126046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518fb66-3c6f-408d-b538-f16cfd3a7296 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:16.150562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519fc8f-c848-4db0-b67f-4893de200264 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:16.184323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27801408-07b2-4b02-8232-60f86a48d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:16.185032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27801408-07b2-4b02-8232-60f86a48d7eb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:16.185307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27801408-07b2-4b02-8232-60f86a48d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:16.185580 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27801408-07b2-4b02-8232-60f86a48d7eb None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:16.186371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 291/589] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:14:15 2022] PUT /identity/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/567188b7c4fe40c1a1623d2f60092d26/roles/f53f657a7b1f44a98ec5e754a93d8b3c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:14:16.186489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27801408-07b2-4b02-8232-60f86a48d7eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:16.186654 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27801408-07b2-4b02-8232-60f86a48d7eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:16.188157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27801408-07b2-4b02-8232-60f86a48d7eb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:16.197258 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518fb66-3c6f-408d-b538-f16cfd3a7296 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:16.219912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 299/590] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Oct 4 10:14:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:16.219912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27801408-07b2-4b02-8232-60f86a48d7eb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:16.234623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:16.330849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:16.354258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27801408-07b2-4b02-8232-60f86a48d7eb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:16.362249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518fb66-3c6f-408d-b538-f16cfd3a7296 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:16.401174 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3a97a-2887-4192-94fd-a9804f93b879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:16.401819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3a97a-2887-4192-94fd-a9804f93b879 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:16.402099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3a97a-2887-4192-94fd-a9804f93b879 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:16.402370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3a97a-2887-4192-94fd-a9804f93b879 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:16.405260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346545c1-811b-4301-b811-cb19cb16bd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:16.406111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346545c1-811b-4301-b811-cb19cb16bd6f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:16.406579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346545c1-811b-4301-b811-cb19cb16bd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:16.407068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346545c1-811b-4301-b811-cb19cb16bd6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:16.410574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3a97a-2887-4192-94fd-a9804f93b879 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:16.412207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3a97a-2887-4192-94fd-a9804f93b879 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:16.420998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346545c1-811b-4301-b811-cb19cb16bd6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:16.422709 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346545c1-811b-4301-b811-cb19cb16bd6f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-99b3a97a-2887-4192-94fd-a9804f93b879 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:16.425244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:16.426165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:16.427113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:16.427113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:16.427113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:16.427113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:16.427113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:16.427113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:16.427113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:16.427113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:16.427113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 10:14:16.427113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:16.432359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 300/591] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:16.433387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3a97a-2887-4192-94fd-a9804f93b879 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-346545c1-811b-4301-b811-cb19cb16bd6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:16.445291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:16.446259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:16.447684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:16.447684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:16.447684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:16.450375 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 292/592] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:16.451474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346545c1-811b-4301-b811-cb19cb16bd6f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:16.520117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:16.556429 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3a97a-2887-4192-94fd-a9804f93b879 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:16.559566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346545c1-811b-4301-b811-cb19cb16bd6f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:16.594549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746616e-e2cf-4328-8751-e69fd4da3fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:16.595281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746616e-e2cf-4328-8751-e69fd4da3fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:16.595648 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746616e-e2cf-4328-8751-e69fd4da3fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:16.596067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746616e-e2cf-4328-8751-e69fd4da3fe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:16.598267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2760701-3be7-4e40-a32f-745c28c4fb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:16.599161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2760701-3be7-4e40-a32f-745c28c4fb79 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:16.599611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2760701-3be7-4e40-a32f-745c28c4fb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:16.600083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2760701-3be7-4e40-a32f-745c28c4fb79 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:16.600996 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2760701-3be7-4e40-a32f-745c28c4fb79 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:16.601471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2760701-3be7-4e40-a32f-745c28c4fb79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:16.603594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2760701-3be7-4e40-a32f-745c28c4fb79 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:16.608333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746616e-e2cf-4328-8751-e69fd4da3fe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:16.609880 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746616e-e2cf-4328-8751-e69fd4da3fe9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:16.611863 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:16.623102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 293/593] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Oct 4 10:14:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:16.624223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2760701-3be7-4e40-a32f-745c28c4fb79 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-8746616e-e2cf-4328-8751-e69fd4da3fe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:16.624702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:16.627660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:16.628585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:16.628585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:16.628585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:16.628585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 301/594] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:16.629706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746616e-e2cf-4328-8751-e69fd4da3fe9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:16.734182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746616e-e2cf-4328-8751-e69fd4da3fe9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:16.735293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2760701-3be7-4e40-a32f-745c28c4fb79 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:16.767715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:16.779929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a922891-6bfe-4f39-8d96-de914ae16e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:16.784333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a922891-6bfe-4f39-8d96-de914ae16e32 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:16.784333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a922891-6bfe-4f39-8d96-de914ae16e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:16.784333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a922891-6bfe-4f39-8d96-de914ae16e32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:16.785274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb8903-663c-4465-a8c8-4843d9c0b786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:16.785891 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb8903-663c-4465-a8c8-4843d9c0b786 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:16.786172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb8903-663c-4465-a8c8-4843d9c0b786 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:16.786444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb8903-663c-4465-a8c8-4843d9c0b786 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:16.787088 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb8903-663c-4465-a8c8-4843d9c0b786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:16.787390 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb8903-663c-4465-a8c8-4843d9c0b786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:16.788800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb8903-663c-4465-a8c8-4843d9c0b786 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:16.794113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a922891-6bfe-4f39-8d96-de914ae16e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:16.795543 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a922891-6bfe-4f39-8d96-de914ae16e32 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-8a922891-6bfe-4f39-8d96-de914ae16e32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:16.811811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:16.812875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:16.813768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:16.813768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:16.813768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:16.813768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 302/595] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:16.814656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a922891-6bfe-4f39-8d96-de914ae16e32 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:16.815171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 294/596] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:16.816315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb8903-663c-4465-a8c8-4843d9c0b786 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:16.866929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:16.947059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a922891-6bfe-4f39-8d96-de914ae16e32 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:16.947488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb8903-663c-4465-a8c8-4843d9c0b786 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:16.993007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099fe31-b591-4d8b-b93c-0fdc8b132d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:16.994250 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772468a-d223-41c4-8820-dc5b4eaaab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:16.995045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772468a-d223-41c4-8820-dc5b4eaaab5e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:16.995338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099fe31-b591-4d8b-b93c-0fdc8b132d57 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:16.995529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772468a-d223-41c4-8820-dc5b4eaaab5e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:16.995897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772468a-d223-41c4-8820-dc5b4eaaab5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:16.996064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099fe31-b591-4d8b-b93c-0fdc8b132d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:16.996462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099fe31-b591-4d8b-b93c-0fdc8b132d57 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:16.997248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099fe31-b591-4d8b-b93c-0fdc8b132d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:16.997694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099fe31-b591-4d8b-b93c-0fdc8b132d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:16.999423 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099fe31-b591-4d8b-b93c-0fdc8b132d57 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:17.003751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772468a-d223-41c4-8820-dc5b4eaaab5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:17.005375 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772468a-d223-41c4-8820-dc5b4eaaab5e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:17.013485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 303/597] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:17.014591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099fe31-b591-4d8b-b93c-0fdc8b132d57 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-f772468a-d223-41c4-8820-dc5b4eaaab5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:17.017908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:17.018887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:17.019765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:17.019765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:17.019765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:17.019765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:17.019765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:17.019765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:17.019765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:17.019765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:17.024047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 295/598] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:17.025610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772468a-d223-41c4-8820-dc5b4eaaab5e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:17.077198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:17.138780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099fe31-b591-4d8b-b93c-0fdc8b132d57 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:17.140040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772468a-d223-41c4-8820-dc5b4eaaab5e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:17.148589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:17.177542 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073b71-fda3-46c6-9112-6e68f23c9428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:17.178648 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073b71-fda3-46c6-9112-6e68f23c9428 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:17.179323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073b71-fda3-46c6-9112-6e68f23c9428 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:17.179913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073b71-fda3-46c6-9112-6e68f23c9428 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:17.180381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984389a-ed7a-4a63-a1ed-e8a097c34e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:17.181031 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984389a-ed7a-4a63-a1ed-e8a097c34e8c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:17.181319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984389a-ed7a-4a63-a1ed-e8a097c34e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:17.181586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984389a-ed7a-4a63-a1ed-e8a097c34e8c None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:17.182224 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984389a-ed7a-4a63-a1ed-e8a097c34e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:17.183693 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984389a-ed7a-4a63-a1ed-e8a097c34e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:17.185488 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984389a-ed7a-4a63-a1ed-e8a097c34e8c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:17.188906 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3073b71-fda3-46c6-9112-6e68f23c9428 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:17.190554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3073b71-fda3-46c6-9112-6e68f23c9428 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:17.198188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 304/599] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:17.199069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984389a-ed7a-4a63-a1ed-e8a097c34e8c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-c3073b71-fda3-46c6-9112-6e68f23c9428 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:17.203467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:17.204392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:17.205317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:17.205317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:17.205317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:17.205317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:17.205317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:17.205317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:17.205317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:17.205317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:17.207669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 296/600] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:17.208684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073b71-fda3-46c6-9112-6e68f23c9428 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:17.312590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073b71-fda3-46c6-9112-6e68f23c9428 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:17.317218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984389a-ed7a-4a63-a1ed-e8a097c34e8c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:17.320442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:17.349507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1ea08-c3bd-494f-a1c4-01f42988dcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:17.350284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1ea08-c3bd-494f-a1c4-01f42988dcaf None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:17.350810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1ea08-c3bd-494f-a1c4-01f42988dcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:17.351191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1ea08-c3bd-494f-a1c4-01f42988dcaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:17.357942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75730f4-4570-45d6-92d7-21ac6cc70071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:17.358725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75730f4-4570-45d6-92d7-21ac6cc70071 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:17.359152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75730f4-4570-45d6-92d7-21ac6cc70071 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:17.359596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75730f4-4570-45d6-92d7-21ac6cc70071 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:17.360172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1ea08-c3bd-494f-a1c4-01f42988dcaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:17.360619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75730f4-4570-45d6-92d7-21ac6cc70071 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:17.361067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75730f4-4570-45d6-92d7-21ac6cc70071 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:17.362012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1ea08-c3bd-494f-a1c4-01f42988dcaf None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:17.362917 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75730f4-4570-45d6-92d7-21ac6cc70071 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-ecb1ea08-c3bd-494f-a1c4-01f42988dcaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:17.379577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:17.380550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:17.381445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:17.381445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:17.381445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:17.381445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:17.381445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:17.381445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:17.381445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:17.381445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:17.383036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 297/602] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:17.384509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1ea08-c3bd-494f-a1c4-01f42988dcaf None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:17.385038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 305/602] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:17.385999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75730f4-4570-45d6-92d7-21ac6cc70071 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:17.417613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:17.491896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1ea08-c3bd-494f-a1c4-01f42988dcaf None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:17.508024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75730f4-4570-45d6-92d7-21ac6cc70071 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:17.532578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fe87e-a658-45d1-9d97-e425b36a5f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:17.533191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fe87e-a658-45d1-9d97-e425b36a5f4d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:17.533468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fe87e-a658-45d1-9d97-e425b36a5f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:17.533792 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fe87e-a658-45d1-9d97-e425b36a5f4d None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:17.535071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fe87e-a658-45d1-9d97-e425b36a5f4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:17.535616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fe87e-a658-45d1-9d97-e425b36a5f4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:17.537389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fe87e-a658-45d1-9d97-e425b36a5f4d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:17.550687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc154105-4973-4187-a012-5d76b0362975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:17.556532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc154105-4973-4187-a012-5d76b0362975 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:17.556532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc154105-4973-4187-a012-5d76b0362975 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:17.556532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc154105-4973-4187-a012-5d76b0362975 None admin] PATH_INFO: `/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/2bf4d6e392fd4f8dadb37527f1750fc0/roles/f53f657a7b1f44a98ec5e754a93d8b3c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:17.556923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 298/603] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:17.556923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fe87e-a658-45d1-9d97-e425b36a5f4d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:17.572547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc154105-4973-4187-a012-5d76b0362975 None admin] RBAC: Authorizing `identity:create_grant(project_id=c41ae2f9d03c48be8017a1ca480bf7db, user_id=2bf4d6e392fd4f8dadb37527f1750fc0, role_id=f53f657a7b1f44a98ec5e754a93d8b3c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:17.574278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc154105-4973-4187-a012-5d76b0362975 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:17.586343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:17.650089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 306/604] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:14:17 2022] PUT /identity/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/2bf4d6e392fd4f8dadb37527f1750fc0/roles/f53f657a7b1f44a98ec5e754a93d8b3c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:14:17.659752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc154105-4973-4187-a012-5d76b0362975 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:17.677950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fe87e-a658-45d1-9d97-e425b36a5f4d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:17.759394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8779e86-4786-4841-802d-908aeaa56dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:17.760111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8779e86-4786-4841-802d-908aeaa56dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:17.760393 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8779e86-4786-4841-802d-908aeaa56dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:17.760665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8779e86-4786-4841-802d-908aeaa56dd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:17.761386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8779e86-4786-4841-802d-908aeaa56dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:17.761692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8779e86-4786-4841-802d-908aeaa56dd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:17.763178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8779e86-4786-4841-802d-908aeaa56dd9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:17.789905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 299/605] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:17.801041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8779e86-4786-4841-802d-908aeaa56dd9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:17.810809 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:17.839361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc154105-4973-4187-a012-5d76b0362975 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:17.894376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda18c8-a14d-4931-a051-52804c186a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:17.895836 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda18c8-a14d-4931-a051-52804c186a2f None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:17.896634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda18c8-a14d-4931-a051-52804c186a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:17.897141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda18c8-a14d-4931-a051-52804c186a2f None admin] PATH_INFO: `/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/6462736c485545d8a26766360ebe0c0e/roles/f53f657a7b1f44a98ec5e754a93d8b3c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:17.923003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda18c8-a14d-4931-a051-52804c186a2f None admin] RBAC: Authorizing `identity:create_grant(project_id=c41ae2f9d03c48be8017a1ca480bf7db, user_id=6462736c485545d8a26766360ebe0c0e, role_id=f53f657a7b1f44a98ec5e754a93d8b3c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:17.925577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda18c8-a14d-4931-a051-52804c186a2f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:17.952315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:17.968770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8779e86-4786-4841-802d-908aeaa56dd9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:18.003286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996675e0-4be7-410c-a7c7-af341f84d379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:18.003931 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996675e0-4be7-410c-a7c7-af341f84d379 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:18.004237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996675e0-4be7-410c-a7c7-af341f84d379 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:18.004511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996675e0-4be7-410c-a7c7-af341f84d379 None admin] PATH_INFO: `/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/b040de20aa6f4e7b8366c7daa54c093c/roles/f53f657a7b1f44a98ec5e754a93d8b3c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:18.019440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996675e0-4be7-410c-a7c7-af341f84d379 None admin] RBAC: Authorizing `identity:create_grant(project_id=c41ae2f9d03c48be8017a1ca480bf7db, user_id=b040de20aa6f4e7b8366c7daa54c093c, role_id=f53f657a7b1f44a98ec5e754a93d8b3c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:18.020987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996675e0-4be7-410c-a7c7-af341f84d379 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:18.036787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 307/606] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:14:17 2022] PUT /identity/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/6462736c485545d8a26766360ebe0c0e/roles/f53f657a7b1f44a98ec5e754a93d8b3c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:14:18.040565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54acb4-32a9-4e21-bbbe-4025f9c12ef4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:18.040565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54acb4-32a9-4e21-bbbe-4025f9c12ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:18.040565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54acb4-32a9-4e21-bbbe-4025f9c12ef4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:18.040565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 308/607] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:18.050346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76dc1b-9101-44d5-8a36-3e7f6c90f276 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:18.050925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76dc1b-9101-44d5-8a36-3e7f6c90f276 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:18.051349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76dc1b-9101-44d5-8a36-3e7f6c90f276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:18.073281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ae76dc1b-9101-44d5-8a36-3e7f6c90f276 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:18.074775 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ae76dc1b-9101-44d5-8a36-3e7f6c90f276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:18.085279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 300/608] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:14:17 2022] PUT /identity/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/b040de20aa6f4e7b8366c7daa54c093c/roles/f53f657a7b1f44a98ec5e754a93d8b3c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:14:18.160412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 309/609] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:18.450738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30654b42-b6fc-465f-99b4-bfd8909bfac4 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:18.451039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30654b42-b6fc-465f-99b4-bfd8909bfac4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:18.451303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30654b42-b6fc-465f-99b4-bfd8909bfac4 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:18.452923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 301/610] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:18.462460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96e0a-59c6-4a20-b300-ad64d056bcb7 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:18.462460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96e0a-59c6-4a20-b300-ad64d056bcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:18.462460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96e0a-59c6-4a20-b300-ad64d056bcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:18.483111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d8c96e0a-59c6-4a20-b300-ad64d056bcb7 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:18.484690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d8c96e0a-59c6-4a20-b300-ad64d056bcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:18.503782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30654b42-b6fc-465f-99b4-bfd8909bfac4 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:18.568266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:18.599914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 310/611] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:18.654564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30654b42-b6fc-465f-99b4-bfd8909bfac4 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:18.701590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041e7e0-3a87-4b99-b048-1d290a9192df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:18.702556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041e7e0-3a87-4b99-b048-1d290a9192df None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:18.703039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041e7e0-3a87-4b99-b048-1d290a9192df None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:18.703522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041e7e0-3a87-4b99-b048-1d290a9192df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:18.709007 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:18.718593 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041e7e0-3a87-4b99-b048-1d290a9192df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-7041e7e0-3a87-4b99-b048-1d290a9192df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:18.723344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:18.725729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:18.726772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 302/612] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:18.733483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c96e0a-59c6-4a20-b300-ad64d056bcb7 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:18.878680 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c96e0a-59c6-4a20-b300-ad64d056bcb7 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:18.925643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652a845-0980-47a0-8fff-e7e4a9f8579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:18.926255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a845-0980-47a0-8fff-e7e4a9f8579d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:18.926533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a845-0980-47a0-8fff-e7e4a9f8579d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:18.926806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a845-0980-47a0-8fff-e7e4a9f8579d None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:18.927473 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652a845-0980-47a0-8fff-e7e4a9f8579d None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:18.927770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652a845-0980-47a0-8fff-e7e4a9f8579d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:18.929149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652a845-0980-47a0-8fff-e7e4a9f8579d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:18.943413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 311/613] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:18.949578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041e7e0-3a87-4b99-b048-1d290a9192df None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:18.992976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652a845-0980-47a0-8fff-e7e4a9f8579d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:19.052182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:19.108802 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652a845-0980-47a0-8fff-e7e4a9f8579d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:19.139293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041e7e0-3a87-4b99-b048-1d290a9192df None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:19.154834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18f4a1-066a-45a9-bfd9-d0702341cf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:19.155804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18f4a1-066a-45a9-bfd9-d0702341cf5c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:19.156651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18f4a1-066a-45a9-bfd9-d0702341cf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:19.157134 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18f4a1-066a-45a9-bfd9-d0702341cf5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:19.174947 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18f4a1-066a-45a9-bfd9-d0702341cf5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5e18f4a1-066a-45a9-bfd9-d0702341cf5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:19.186463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:19.187487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:19.188389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 312/614] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:19.197980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771cf54-4609-45dd-ab2e-5c03f8c142ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:19.198640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771cf54-4609-45dd-ab2e-5c03f8c142ff None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:19.198918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771cf54-4609-45dd-ab2e-5c03f8c142ff None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:19.199191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771cf54-4609-45dd-ab2e-5c03f8c142ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:19.200674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18f4a1-066a-45a9-bfd9-d0702341cf5c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:19.223804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771cf54-4609-45dd-ab2e-5c03f8c142ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:19.225311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771cf54-4609-45dd-ab2e-5c03f8c142ff None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-7771cf54-4609-45dd-ab2e-5c03f8c142ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:19.241720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:19.242678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:19.245113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:19.245113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:19.245113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:19.245113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 303/615] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:19.249424 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771cf54-4609-45dd-ab2e-5c03f8c142ff None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:19.328866 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:19.360984 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18f4a1-066a-45a9-bfd9-d0702341cf5c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:19.384664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:19.397337 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8036056-36d0-4b6a-9ee1-df0afa587036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:19.397960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8036056-36d0-4b6a-9ee1-df0afa587036 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:19.398245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8036056-36d0-4b6a-9ee1-df0afa587036 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:19.398525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8036056-36d0-4b6a-9ee1-df0afa587036 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:19.399363 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8036056-36d0-4b6a-9ee1-df0afa587036 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:19.399738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8036056-36d0-4b6a-9ee1-df0afa587036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:19.401218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8036056-36d0-4b6a-9ee1-df0afa587036 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:19.417333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 313/616] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:19.423075 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8036056-36d0-4b6a-9ee1-df0afa587036 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:19.439744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771cf54-4609-45dd-ab2e-5c03f8c142ff None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:19.542257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8036056-36d0-4b6a-9ee1-df0afa587036 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:19.548699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37145fcf-0388-405e-abde-3295c08e8bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:19.549410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37145fcf-0388-405e-abde-3295c08e8bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:19.549700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37145fcf-0388-405e-abde-3295c08e8bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:19.549976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37145fcf-0388-405e-abde-3295c08e8bc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:19.550712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37145fcf-0388-405e-abde-3295c08e8bc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:19.551022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37145fcf-0388-405e-abde-3295c08e8bc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:19.556521 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37145fcf-0388-405e-abde-3295c08e8bc3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:19.576819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa5277-aaa5-4d08-a98f-83c2a11a691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:19.577242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 304/617] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:19.582024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa5277-aaa5-4d08-a98f-83c2a11a691a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:19.582314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa5277-aaa5-4d08-a98f-83c2a11a691a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:19.582594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa5277-aaa5-4d08-a98f-83c2a11a691a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:19.593522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37145fcf-0388-405e-abde-3295c08e8bc3 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:19.594673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa5277-aaa5-4d08-a98f-83c2a11a691a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:19.596144 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa5277-aaa5-4d08-a98f-83c2a11a691a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-40fa5277-aaa5-4d08-a98f-83c2a11a691a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:19.613620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:19.614632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:19.615662 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:19.615662 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:19.615662 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:19.619567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 314/618] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:19.621088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa5277-aaa5-4d08-a98f-83c2a11a691a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:19.649354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:19.730370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa5277-aaa5-4d08-a98f-83c2a11a691a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:19.767511 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd30c6a-2d36-4d10-864d-6f972d9c2068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:19.768158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd30c6a-2d36-4d10-864d-6f972d9c2068 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:19.768443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd30c6a-2d36-4d10-864d-6f972d9c2068 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:19.768721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd30c6a-2d36-4d10-864d-6f972d9c2068 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:19.769368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd30c6a-2d36-4d10-864d-6f972d9c2068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:19.769678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd30c6a-2d36-4d10-864d-6f972d9c2068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:19.771196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd30c6a-2d36-4d10-864d-6f972d9c2068 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:19.788065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 315/619] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:19.789796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd30c6a-2d36-4d10-864d-6f972d9c2068 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:19.807289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37145fcf-0388-405e-abde-3295c08e8bc3 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:19.824524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:19.867397 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d08e2f-acbd-4d44-95df-14cab8c61755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:19.868073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d08e2f-acbd-4d44-95df-14cab8c61755 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:19.868876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d08e2f-acbd-4d44-95df-14cab8c61755 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:19.869144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d08e2f-acbd-4d44-95df-14cab8c61755 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:19.883263 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:19.884372 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d08e2f-acbd-4d44-95df-14cab8c61755 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:19.885995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d08e2f-acbd-4d44-95df-14cab8c61755 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:19.895470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd30c6a-2d36-4d10-864d-6f972d9c2068 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-99d08e2f-acbd-4d44-95df-14cab8c61755 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:19.903876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:19.904855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:19.905813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:19.905813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:19.905813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:19.905813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:19.905813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:19.905813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:19.905813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:19.905813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:19.905813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 10:14:19.905813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:19.912455 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 305/620] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:14:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:19.926597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d08e2f-acbd-4d44-95df-14cab8c61755 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:19.938104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741f2c-5ed7-4391-ad83-3514182bf7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:19.938735 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741f2c-5ed7-4391-ad83-3514182bf7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:19.939015 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741f2c-5ed7-4391-ad83-3514182bf7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:19.939286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741f2c-5ed7-4391-ad83-3514182bf7d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:19.946779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11741f2c-5ed7-4391-ad83-3514182bf7d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:19.948239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11741f2c-5ed7-4391-ad83-3514182bf7d3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-11741f2c-5ed7-4391-ad83-3514182bf7d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:19.960165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:19.962973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:19.965636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:19.965636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:19.965636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:19.965636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:19.965636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:19.965636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:19.965636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:19.965636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:19.965636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:14:19.965636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:19.966938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 316/621] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 10:14:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:19.972126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741f2c-5ed7-4391-ad83-3514182bf7d3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:20.082508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741f2c-5ed7-4391-ad83-3514182bf7d3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:20.120620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aec9e-bedc-4334-aa51-4f9bab9ad810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:20.121614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aec9e-bedc-4334-aa51-4f9bab9ad810 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:20.122043 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aec9e-bedc-4334-aa51-4f9bab9ad810 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:20.122466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aec9e-bedc-4334-aa51-4f9bab9ad810 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:20.123344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aec9e-bedc-4334-aa51-4f9bab9ad810 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:20.123799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aec9e-bedc-4334-aa51-4f9bab9ad810 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:20.125558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aec9e-bedc-4334-aa51-4f9bab9ad810 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:20.141728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:20.149865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 317/622] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 10:14:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:20.152172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aec9e-bedc-4334-aa51-4f9bab9ad810 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:20.215742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d08e2f-acbd-4d44-95df-14cab8c61755 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:20.266781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aec9e-bedc-4334-aa51-4f9bab9ad810 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:20.301763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a1cac-68d4-4471-9b64-a54d624522c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:20.302476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a1cac-68d4-4471-9b64-a54d624522c7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:20.302820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a1cac-68d4-4471-9b64-a54d624522c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:20.303164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a1cac-68d4-4471-9b64-a54d624522c7 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:20.304019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a1cac-68d4-4471-9b64-a54d624522c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:20.304451 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a1cac-68d4-4471-9b64-a54d624522c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:20.305993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a1cac-68d4-4471-9b64-a54d624522c7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:20.315313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b17c4-f674-4b6a-8cd9-f524f9b944f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:20.320193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b17c4-f674-4b6a-8cd9-f524f9b944f7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:20.320702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b17c4-f674-4b6a-8cd9-f524f9b944f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:20.321204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b17c4-f674-4b6a-8cd9-f524f9b944f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:20.345814 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 306/623] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Oct 4 10:14:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:20.351603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a1cac-68d4-4471-9b64-a54d624522c7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:20.398936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:20.428426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:20.432884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b17c4-f674-4b6a-8cd9-f524f9b944f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:20.435033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b17c4-f674-4b6a-8cd9-f524f9b944f7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:20.487093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a1cac-68d4-4471-9b64-a54d624522c7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:20.522173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc5777-cae8-4fc1-a51b-8dd05ce7b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:20.522811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc5777-cae8-4fc1-a51b-8dd05ce7b891 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:20.523154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc5777-cae8-4fc1-a51b-8dd05ce7b891 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:20.523428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc5777-cae8-4fc1-a51b-8dd05ce7b891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:20.534697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc5777-cae8-4fc1-a51b-8dd05ce7b891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:20.536188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc5777-cae8-4fc1-a51b-8dd05ce7b891 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-fcfc5777-cae8-4fc1-a51b-8dd05ce7b891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:20.552458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:20.554704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:20.555682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:20.555682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:20.555682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:20.555682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 307/624] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:20.555682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c40f71-e8a8-44ec-94b6-7073486c3c0e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:20.555682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c40f71-e8a8-44ec-94b6-7073486c3c0e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:20.555682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c40f71-e8a8-44ec-94b6-7073486c3c0e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:20.557421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 308/625] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:20.561963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c40f71-e8a8-44ec-94b6-7073486c3c0e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:20.576421 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 318/626] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 10:14:20.578197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531cd5c-5219-4db3-9a75-c4d2c7913811 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:20.578491 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531cd5c-5219-4db3-9a75-c4d2c7913811 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:20.578767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531cd5c-5219-4db3-9a75-c4d2c7913811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:20.602606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4531cd5c-5219-4db3-9a75-c4d2c7913811 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:20.604658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4531cd5c-5219-4db3-9a75-c4d2c7913811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:20.654995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:20.684922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c40f71-e8a8-44ec-94b6-7073486c3c0e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:20.692329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 319/627] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:20.693678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531cd5c-5219-4db3-9a75-c4d2c7913811 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:20.735008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:20.736755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f0b2e-f756-4174-a021-6b54dc6eabea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:20.737708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f0b2e-f756-4174-a021-6b54dc6eabea None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:20.738056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f0b2e-f756-4174-a021-6b54dc6eabea None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:20.738399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f0b2e-f756-4174-a021-6b54dc6eabea None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:20.739135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f0b2e-f756-4174-a021-6b54dc6eabea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:20.739508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f0b2e-f756-4174-a021-6b54dc6eabea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:20.741928 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f0b2e-f756-4174-a021-6b54dc6eabea None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:20.756391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 309/628] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:20.759878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84d51-52aa-4822-b290-c508438b70f8 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:20.760376 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84d51-52aa-4822-b290-c508438b70f8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:20.760812 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84d51-52aa-4822-b290-c508438b70f8 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:20.765587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 310/629] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:20.769914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b84d51-52aa-4822-b290-c508438b70f8 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:20.825196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531cd5c-5219-4db3-9a75-c4d2c7913811 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:20.860427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c75081-4297-48f7-93e6-fa8bc0cebd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:20.861363 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c75081-4297-48f7-93e6-fa8bc0cebd36 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:20.861861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c75081-4297-48f7-93e6-fa8bc0cebd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:20.862336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c75081-4297-48f7-93e6-fa8bc0cebd36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:20.876688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c75081-4297-48f7-93e6-fa8bc0cebd36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:20.878145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c75081-4297-48f7-93e6-fa8bc0cebd36 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-75c75081-4297-48f7-93e6-fa8bc0cebd36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:20.892800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:20.893895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:20.894906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:20.894906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:20.894906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:20.896270 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 320/630] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:20.897649 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b8071-c985-43b0-8f5c-56c88bb29c4a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:20.898070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b8071-c985-43b0-8f5c-56c88bb29c4a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:20.898483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b8071-c985-43b0-8f5c-56c88bb29c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:20.901992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b84d51-52aa-4822-b290-c508438b70f8 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:20.917733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-200b8071-c985-43b0-8f5c-56c88bb29c4a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:20.918910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-200b8071-c985-43b0-8f5c-56c88bb29c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:20.945703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b00597-9db9-4ce4-ac56-dc5e94629ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:20.946733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00597-9db9-4ce4-ac56-dc5e94629ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:20.947203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00597-9db9-4ce4-ac56-dc5e94629ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:20.947510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00597-9db9-4ce4-ac56-dc5e94629ae6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:20.954844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b00597-9db9-4ce4-ac56-dc5e94629ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:20.956302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b00597-9db9-4ce4-ac56-dc5e94629ae6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:20.958174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-c9b00597-9db9-4ce4-ac56-dc5e94629ae6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:20.968211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:20.972259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:20.973378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:20.973378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:20.973378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:20.973378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:20.973378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:20.973378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:20.973378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:20.973378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:20.973378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 311/631] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:20.973378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446461a-9a25-40f0-8c13-7b0d94cc6f2d None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:20.973378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446461a-9a25-40f0-8c13-7b0d94cc6f2d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:20.974259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446461a-9a25-40f0-8c13-7b0d94cc6f2d None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:20.974259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 312/632] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:20.974259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446461a-9a25-40f0-8c13-7b0d94cc6f2d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:21.002246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 321/633] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:21.003482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b8071-c985-43b0-8f5c-56c88bb29c4a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:21.017224 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:21.083255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446461a-9a25-40f0-8c13-7b0d94cc6f2d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:21.109611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b8071-c985-43b0-8f5c-56c88bb29c4a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:21.125825 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604998b-79c8-4ca0-a3bb-25fb6c49961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:21.126588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604998b-79c8-4ca0-a3bb-25fb6c49961a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:21.126871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604998b-79c8-4ca0-a3bb-25fb6c49961a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:21.127146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604998b-79c8-4ca0-a3bb-25fb6c49961a None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:21.127785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604998b-79c8-4ca0-a3bb-25fb6c49961a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:21.128134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604998b-79c8-4ca0-a3bb-25fb6c49961a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:21.129557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604998b-79c8-4ca0-a3bb-25fb6c49961a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:21.141987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 313/634] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:21.142689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604998b-79c8-4ca0-a3bb-25fb6c49961a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:21.150414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132d339-2ac5-4501-8bcb-60556bbdb751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:21.151020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132d339-2ac5-4501-8bcb-60556bbdb751 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:21.151298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132d339-2ac5-4501-8bcb-60556bbdb751 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:21.151569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132d339-2ac5-4501-8bcb-60556bbdb751 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:21.152295 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132d339-2ac5-4501-8bcb-60556bbdb751 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:21.152599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132d339-2ac5-4501-8bcb-60556bbdb751 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:21.154018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132d339-2ac5-4501-8bcb-60556bbdb751 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:21.166664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 322/635] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:21.172384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b8d5e-1bc7-4fd4-b426-36e1d71bf521 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:21.172673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b8d5e-1bc7-4fd4-b426-36e1d71bf521 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:21.173020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b8d5e-1bc7-4fd4-b426-36e1d71bf521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:21.190759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e27b8d5e-1bc7-4fd4-b426-36e1d71bf521 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:21.191938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e27b8d5e-1bc7-4fd4-b426-36e1d71bf521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:21.202298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:21.246030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604998b-79c8-4ca0-a3bb-25fb6c49961a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:21.267979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 323/636] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:21.267979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b8d5e-1bc7-4fd4-b426-36e1d71bf521 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:21.267979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:21.293708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec6695-3de1-4e69-9050-ff726c065f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:21.294341 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec6695-3de1-4e69-9050-ff726c065f88 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:21.294619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec6695-3de1-4e69-9050-ff726c065f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:21.294890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec6695-3de1-4e69-9050-ff726c065f88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:21.306659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec6695-3de1-4e69-9050-ff726c065f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-39ec6695-3de1-4e69-9050-ff726c065f88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:21.311436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:21.312627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:21.313499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 314/637] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:21.314224 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec6695-3de1-4e69-9050-ff726c065f88 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:21.372140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b8d5e-1bc7-4fd4-b426-36e1d71bf521 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:21.407146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffed162-38c8-4bd0-a383-f961595ed22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:21.407796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffed162-38c8-4bd0-a383-f961595ed22e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:21.408101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffed162-38c8-4bd0-a383-f961595ed22e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:21.408368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffed162-38c8-4bd0-a383-f961595ed22e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:21.415203 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffed162-38c8-4bd0-a383-f961595ed22e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:21.416652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffed162-38c8-4bd0-a383-f961595ed22e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:21.419775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec6695-3de1-4e69-9050-ff726c065f88 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6ffed162-38c8-4bd0-a383-f961595ed22e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:21.428098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:21.429003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:21.429914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:21.429914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:21.429914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:21.429914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:21.429914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:21.429914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:21.429914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:21.429914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:21.429914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 324/638] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:21.429914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffed162-38c8-4bd0-a383-f961595ed22e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:21.442982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:21.460117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921987f-3718-4b5c-bb22-24efe7f9bb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:21.460890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921987f-3718-4b5c-bb22-24efe7f9bb5d None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:21.461164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921987f-3718-4b5c-bb22-24efe7f9bb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:21.461459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921987f-3718-4b5c-bb22-24efe7f9bb5d None admin] PATH_INFO: `/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/fe9c03800bc6451aa9e5a39ca4ea0bf7/roles/f53f657a7b1f44a98ec5e754a93d8b3c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:21.478192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921987f-3718-4b5c-bb22-24efe7f9bb5d None admin] RBAC: Authorizing `identity:create_grant(project_id=c41ae2f9d03c48be8017a1ca480bf7db, user_id=fe9c03800bc6451aa9e5a39ca4ea0bf7, role_id=f53f657a7b1f44a98ec5e754a93d8b3c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:21.479623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921987f-3718-4b5c-bb22-24efe7f9bb5d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:21.495305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:21.532321 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffed162-38c8-4bd0-a383-f961595ed22e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:21.546104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 315/639] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:14:21 2022] PUT /identity/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/fe9c03800bc6451aa9e5a39ca4ea0bf7/roles/f53f657a7b1f44a98ec5e754a93d8b3c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:14:21.546935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921987f-3718-4b5c-bb22-24efe7f9bb5d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:21.569375 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646024b-385f-4928-83e5-68604131fbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:21.570027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646024b-385f-4928-83e5-68604131fbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:21.570303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646024b-385f-4928-83e5-68604131fbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:21.570570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646024b-385f-4928-83e5-68604131fbc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:21.583132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646024b-385f-4928-83e5-68604131fbc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6646024b-385f-4928-83e5-68604131fbc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:21.588726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:21.589988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 325/640] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:21.593041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646024b-385f-4928-83e5-68604131fbc4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:21.667578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921987f-3718-4b5c-bb22-24efe7f9bb5d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:21.705081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2384eb3-a29f-4880-977c-dd1c1a37009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:21.705863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2384eb3-a29f-4880-977c-dd1c1a37009c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:21.706143 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2384eb3-a29f-4880-977c-dd1c1a37009c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:21.706739 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2384eb3-a29f-4880-977c-dd1c1a37009c None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:21.707562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2384eb3-a29f-4880-977c-dd1c1a37009c None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:21.707862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2384eb3-a29f-4880-977c-dd1c1a37009c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:21.709161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646024b-385f-4928-83e5-68604131fbc4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:21.709281 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2384eb3-a29f-4880-977c-dd1c1a37009c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:21.722669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 316/641] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:21.723561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2384eb3-a29f-4880-977c-dd1c1a37009c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:21.739508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:21.755158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a0393-925e-4223-b1a2-9e240ca2bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:21.755768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a0393-925e-4223-b1a2-9e240ca2bdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:21.756088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a0393-925e-4223-b1a2-9e240ca2bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:21.756361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a0393-925e-4223-b1a2-9e240ca2bdf0 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:21.757052 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a0393-925e-4223-b1a2-9e240ca2bdf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:21.757354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a0393-925e-4223-b1a2-9e240ca2bdf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:21.759302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a0393-925e-4223-b1a2-9e240ca2bdf0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:21.764124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:21.771207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 326/642] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:21.776212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a0393-925e-4223-b1a2-9e240ca2bdf0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:21.847772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2384eb3-a29f-4880-977c-dd1c1a37009c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:21.883207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a0393-925e-4223-b1a2-9e240ca2bdf0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:21.886988 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfdaf9-d5ef-47b5-b653-8d96a83203a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:21.887686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfdaf9-d5ef-47b5-b653-8d96a83203a2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:21.887991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfdaf9-d5ef-47b5-b653-8d96a83203a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:21.888271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfdaf9-d5ef-47b5-b653-8d96a83203a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:21.899980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfdaf9-d5ef-47b5-b653-8d96a83203a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-32dfdaf9-d5ef-47b5-b653-8d96a83203a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:21.904765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:21.905755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:21.906663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:21.906663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:21.906663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:21.906663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:21.906663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:21.906663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:21.906663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:21.906663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:21.906663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:21.906663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:21.906663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:21.906663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:21.911330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 317/643] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:21.911750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfdaf9-d5ef-47b5-b653-8d96a83203a2 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:21.929373 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c1427-2536-4302-81d0-cec8ff08e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:21.929673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c1427-2536-4302-81d0-cec8ff08e6ea None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:21.929940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c1427-2536-4302-81d0-cec8ff08e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:21.930212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c1427-2536-4302-81d0-cec8ff08e6ea None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:21.930982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c1427-2536-4302-81d0-cec8ff08e6ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:21.931259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c1427-2536-4302-81d0-cec8ff08e6ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:21.932633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c1427-2536-4302-81d0-cec8ff08e6ea None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:21.941057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 327/644] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:21.941515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c1427-2536-4302-81d0-cec8ff08e6ea None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:21.989897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:22.013994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:22.023401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfdaf9-d5ef-47b5-b653-8d96a83203a2 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:22.051298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c1427-2536-4302-81d0-cec8ff08e6ea None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:22.059232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972be2a1-7bef-4a43-b2d1-da2f8583a811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:22.059869 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be2a1-7bef-4a43-b2d1-da2f8583a811 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:22.060179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be2a1-7bef-4a43-b2d1-da2f8583a811 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:22.060454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be2a1-7bef-4a43-b2d1-da2f8583a811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:22.070405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972be2a1-7bef-4a43-b2d1-da2f8583a811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:22.072457 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972be2a1-7bef-4a43-b2d1-da2f8583a811 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-972be2a1-7bef-4a43-b2d1-da2f8583a811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:22.087292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:22.088310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:22.089882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:22.089882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:22.089882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:22.091371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9d4d3-9351-4156-8a03-2d37cd0b6d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:22.092016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9d4d3-9351-4156-8a03-2d37cd0b6d7e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:22.092267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9d4d3-9351-4156-8a03-2d37cd0b6d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:22.092535 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9d4d3-9351-4156-8a03-2d37cd0b6d7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:22.093259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 318/645] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:22.093398 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9d4d3-9351-4156-8a03-2d37cd0b6d7e None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=567188b7c4fe40c1a1623d2f60092d26) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:22.093559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9d4d3-9351-4156-8a03-2d37cd0b6d7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:22.093903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972be2a1-7bef-4a43-b2d1-da2f8583a811 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:22.095034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9d4d3-9351-4156-8a03-2d37cd0b6d7e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:22.112359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 328/646] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:21 2022] GET /identity/v3/role_assignments?user.id=567188b7c4fe40c1a1623d2f60092d26&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:22.112359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9d4d3-9351-4156-8a03-2d37cd0b6d7e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:22.235476 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9d4d3-9351-4156-8a03-2d37cd0b6d7e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:22.243841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972be2a1-7bef-4a43-b2d1-da2f8583a811 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:22.249678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:22.286938 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e42ea-1c01-49ca-a892-63793b4d0768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:22.287602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e42ea-1c01-49ca-a892-63793b4d0768 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:22.287930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e42ea-1c01-49ca-a892-63793b4d0768 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:22.288160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e42ea-1c01-49ca-a892-63793b4d0768 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:22.288801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e42ea-1c01-49ca-a892-63793b4d0768 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:22.289731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e42ea-1c01-49ca-a892-63793b4d0768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:22.290959 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e42ea-1c01-49ca-a892-63793b4d0768 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:22.292707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a696f3-ac50-4b8d-9c88-cae8a508064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:22.293463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a696f3-ac50-4b8d-9c88-cae8a508064b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:22.293741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a696f3-ac50-4b8d-9c88-cae8a508064b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:22.294011 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a696f3-ac50-4b8d-9c88-cae8a508064b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:22.301251 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 319/647] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:22.305440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e42ea-1c01-49ca-a892-63793b4d0768 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:22.308949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a696f3-ac50-4b8d-9c88-cae8a508064b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:22.310531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a696f3-ac50-4b8d-9c88-cae8a508064b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:22.310774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-a9a696f3-ac50-4b8d-9c88-cae8a508064b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:22.327294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:22.330523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:22.331457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:22.331457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:22.331457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:22.331457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 329/648] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:22.331457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a696f3-ac50-4b8d-9c88-cae8a508064b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:22.432248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e42ea-1c01-49ca-a892-63793b4d0768 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:22.454942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a696f3-ac50-4b8d-9c88-cae8a508064b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:22.470970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8be24-a854-421d-9d6a-aeb9c52d3359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:22.471811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8be24-a854-421d-9d6a-aeb9c52d3359 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:22.472259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8be24-a854-421d-9d6a-aeb9c52d3359 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:22.472690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8be24-a854-421d-9d6a-aeb9c52d3359 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:22.473472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8be24-a854-421d-9d6a-aeb9c52d3359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:22.473930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8be24-a854-421d-9d6a-aeb9c52d3359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:22.475442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8be24-a854-421d-9d6a-aeb9c52d3359 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:22.488068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 320/649] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:22.489168 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8be24-a854-421d-9d6a-aeb9c52d3359 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:22.495296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0eda5-fd98-4404-a49c-20799c5ec76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:22.495927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0eda5-fd98-4404-a49c-20799c5ec76e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:22.496227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0eda5-fd98-4404-a49c-20799c5ec76e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:22.496493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0eda5-fd98-4404-a49c-20799c5ec76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:22.510343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0eda5-fd98-4404-a49c-20799c5ec76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:22.511815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0eda5-fd98-4404-a49c-20799c5ec76e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-bed0eda5-fd98-4404-a49c-20799c5ec76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:22.530061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:22.531278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:22.532470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:22.532470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:22.532470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:22.532470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 330/650] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:22.532470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0eda5-fd98-4404-a49c-20799c5ec76e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:22.552636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:22.564337 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:22.598631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8be24-a854-421d-9d6a-aeb9c52d3359 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:22.640062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e47b9-c4c0-43e9-9500-c9f3f944cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:22.641139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e47b9-c4c0-43e9-9500-c9f3f944cb71 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:22.641699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e47b9-c4c0-43e9-9500-c9f3f944cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:22.642173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e47b9-c4c0-43e9-9500-c9f3f944cb71 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:22.642996 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e47b9-c4c0-43e9-9500-c9f3f944cb71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:22.643478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e47b9-c4c0-43e9-9500-c9f3f944cb71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:22.645275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e47b9-c4c0-43e9-9500-c9f3f944cb71 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:22.662395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0eda5-fd98-4404-a49c-20799c5ec76e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:22.662776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 321/651] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:22.663783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e47b9-c4c0-43e9-9500-c9f3f944cb71 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:22.705145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415612d-9564-4663-a09a-d3ec686abd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:22.706817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415612d-9564-4663-a09a-d3ec686abd2e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:22.707189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415612d-9564-4663-a09a-d3ec686abd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:22.707550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415612d-9564-4663-a09a-d3ec686abd2e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:22.717583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415612d-9564-4663-a09a-d3ec686abd2e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:22.719858 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415612d-9564-4663-a09a-d3ec686abd2e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-0415612d-9564-4663-a09a-d3ec686abd2e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:22.734805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:22.736018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:22.737211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:22.737211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:22.737211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:22.737211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:22.737211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:22.737211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:22.737211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:22.737211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:22.737211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 10:14:22.737211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:22.739528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 331/652] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:14:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:22.740641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415612d-9564-4663-a09a-d3ec686abd2e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:22.785222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e47b9-c4c0-43e9-9500-c9f3f944cb71 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:22.809799 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:22.820976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bd06f-cdc2-442f-a1b8-b271dd8a2024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:22.821793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bd06f-cdc2-442f-a1b8-b271dd8a2024 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:22.824502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bd06f-cdc2-442f-a1b8-b271dd8a2024 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:22.824502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bd06f-cdc2-442f-a1b8-b271dd8a2024 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:22.824502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bd06f-cdc2-442f-a1b8-b271dd8a2024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:22.824502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bd06f-cdc2-442f-a1b8-b271dd8a2024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:22.825111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bd06f-cdc2-442f-a1b8-b271dd8a2024 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:22.826880 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:22.842340 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 322/653] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:22.842340 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bd06f-cdc2-442f-a1b8-b271dd8a2024 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:22.868146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415612d-9564-4663-a09a-d3ec686abd2e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:22.922767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e06356-3e19-40c7-be9e-b10dc6821a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:22.923509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e06356-3e19-40c7-be9e-b10dc6821a10 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:22.923879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e06356-3e19-40c7-be9e-b10dc6821a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:22.924288 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e06356-3e19-40c7-be9e-b10dc6821a10 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:22.936737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e06356-3e19-40c7-be9e-b10dc6821a10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:22.938292 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e06356-3e19-40c7-be9e-b10dc6821a10 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-52e06356-3e19-40c7-be9e-b10dc6821a10 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:22.950528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:22.951699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:22.952906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:22.952906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:22.952906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:22.952906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:22.952906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:22.952906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:22.952906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:22.952906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:22.952906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 10:14:22.952906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:22.954601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 332/654] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:14:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:22.955175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e06356-3e19-40c7-be9e-b10dc6821a10 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:22.961305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bd06f-cdc2-442f-a1b8-b271dd8a2024 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:23.012354 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2c21e-f423-4945-bf30-a08ed40cf0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:23.013193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c21e-f423-4945-bf30-a08ed40cf0de None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:23.013623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c21e-f423-4945-bf30-a08ed40cf0de None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:23.014058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c21e-f423-4945-bf30-a08ed40cf0de None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:23.015501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2c21e-f423-4945-bf30-a08ed40cf0de None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:23.015997 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2c21e-f423-4945-bf30-a08ed40cf0de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:23.018182 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2c21e-f423-4945-bf30-a08ed40cf0de None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:23.047102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 323/655] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Oct 4 10:14:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:23.047102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2c21e-f423-4945-bf30-a08ed40cf0de None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:23.075742 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e06356-3e19-40c7-be9e-b10dc6821a10 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:23.094939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:23.107682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:23.113422 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c09e49-e387-4e71-b4c8-d276b250f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:23.114090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c09e49-e387-4e71-b4c8-d276b250f956 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:23.114307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c09e49-e387-4e71-b4c8-d276b250f956 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:23.114577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c09e49-e387-4e71-b4c8-d276b250f956 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:23.125033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c09e49-e387-4e71-b4c8-d276b250f956 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:23.129384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c09e49-e387-4e71-b4c8-d276b250f956 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d7c09e49-e387-4e71-b4c8-d276b250f956 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:23.148844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:23.150173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:23.151517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:23.151517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:23.151517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:23.151517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:23.151517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:23.151517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:23.151517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:23.151517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:23.151517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 10:14:23.151517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:23.158268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 333/656] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:23.159555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c09e49-e387-4e71-b4c8-d276b250f956 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:23.173098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2c21e-f423-4945-bf30-a08ed40cf0de None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:23.211293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07b3c1-4707-49d6-9def-4ded23695e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:23.212235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07b3c1-4707-49d6-9def-4ded23695e06 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:23.212664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07b3c1-4707-49d6-9def-4ded23695e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:23.213084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07b3c1-4707-49d6-9def-4ded23695e06 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:23.214329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07b3c1-4707-49d6-9def-4ded23695e06 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:23.214781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07b3c1-4707-49d6-9def-4ded23695e06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:23.216504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07b3c1-4707-49d6-9def-4ded23695e06 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:23.237544 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 324/657] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Oct 4 10:14:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:23.238662 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07b3c1-4707-49d6-9def-4ded23695e06 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:23.274333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c09e49-e387-4e71-b4c8-d276b250f956 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:23.313298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8a7be-c8fd-4316-be3b-f1456e3f8490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:23.314067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8a7be-c8fd-4316-be3b-f1456e3f8490 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:23.314447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8a7be-c8fd-4316-be3b-f1456e3f8490 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:23.314816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8a7be-c8fd-4316-be3b-f1456e3f8490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:23.346008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:23.350276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07b3c1-4707-49d6-9def-4ded23695e06 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:23.388109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:23.392148 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca86de0-ea2e-4bda-8ebb-6096a0738671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:23.393218 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca86de0-ea2e-4bda-8ebb-6096a0738671 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:23.393798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca86de0-ea2e-4bda-8ebb-6096a0738671 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:23.394173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca86de0-ea2e-4bda-8ebb-6096a0738671 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:23.395006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca86de0-ea2e-4bda-8ebb-6096a0738671 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:23.395415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca86de0-ea2e-4bda-8ebb-6096a0738671 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:23.397116 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca86de0-ea2e-4bda-8ebb-6096a0738671 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:23.400686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8a7be-c8fd-4316-be3b-f1456e3f8490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:23.410420 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8a7be-c8fd-4316-be3b-f1456e3f8490 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:23.420115 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 325/658] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Oct 4 10:14:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:23.420992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca86de0-ea2e-4bda-8ebb-6096a0738671 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:23.529758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 334/659] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:14:23.530645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8a7be-c8fd-4316-be3b-f1456e3f8490 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:23.551993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca86de0-ea2e-4bda-8ebb-6096a0738671 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:23.602180 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf5540-dabc-439c-b727-325a7266333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:23.603059 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf5540-dabc-439c-b727-325a7266333e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:23.603337 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf5540-dabc-439c-b727-325a7266333e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:23.604210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf5540-dabc-439c-b727-325a7266333e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:23.630554 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:23.642134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:23.648513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8a7be-c8fd-4316-be3b-f1456e3f8490 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:23.687504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e4a88-a37c-4ea1-a8d1-04469dee8eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:23.688327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e4a88-a37c-4ea1-a8d1-04469dee8eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:23.688716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e4a88-a37c-4ea1-a8d1-04469dee8eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:23.689285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e4a88-a37c-4ea1-a8d1-04469dee8eb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:23.691466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf5540-dabc-439c-b727-325a7266333e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:23.694073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf5540-dabc-439c-b727-325a7266333e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:23.759885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e4a88-a37c-4ea1-a8d1-04469dee8eb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:23.761502 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e4a88-a37c-4ea1-a8d1-04469dee8eb4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:23.800276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 326/660] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:14:23.800276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf5540-dabc-439c-b727-325a7266333e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:23.855252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:23.866880 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:23.876740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 335/661] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:14:23.878177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c30d1-659e-4675-a3f7-946feb80f0b7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:23.878457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c30d1-659e-4675-a3f7-946feb80f0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:23.878723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c30d1-659e-4675-a3f7-946feb80f0b7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:23.879975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 336/662] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:23.884747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c30d1-659e-4675-a3f7-946feb80f0b7 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:23.904866 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf5540-dabc-439c-b727-325a7266333e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:23.940930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e65e5c-ac65-46e1-82c6-0d237abc5c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:23.941755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e65e5c-ac65-46e1-82c6-0d237abc5c9f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:23.942141 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e65e5c-ac65-46e1-82c6-0d237abc5c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:23.942549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e65e5c-ac65-46e1-82c6-0d237abc5c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:23.953578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e65e5c-ac65-46e1-82c6-0d237abc5c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:23.955164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e65e5c-ac65-46e1-82c6-0d237abc5c9f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-24e65e5c-ac65-46e1-82c6-0d237abc5c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:23.971605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:23.972806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:23.973879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:23.973879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:23.973879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:23.974387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 327/663] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:23.975166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e65e5c-ac65-46e1-82c6-0d237abc5c9f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:24.000533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c30d1-659e-4675-a3f7-946feb80f0b7 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:24.037267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d64d0-fcf4-4ba6-a512-77d990761064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:24.037978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d64d0-fcf4-4ba6-a512-77d990761064 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.038485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d64d0-fcf4-4ba6-a512-77d990761064 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.038485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d64d0-fcf4-4ba6-a512-77d990761064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.049412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d64d0-fcf4-4ba6-a512-77d990761064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:24.050900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d64d0-fcf4-4ba6-a512-77d990761064 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-684d64d0-fcf4-4ba6-a512-77d990761064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:24.066932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:24.067906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:24.068840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:24.068840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:24.068840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:24.072083 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 337/664] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:24.074111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4176-c74a-433f-8580-8fb4e3602d50 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.074396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4176-c74a-433f-8580-8fb4e3602d50 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.074815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4176-c74a-433f-8580-8fb4e3602d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.079324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e65e5c-ac65-46e1-82c6-0d237abc5c9f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:24.090633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:24.095762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-25ab4176-c74a-433f-8580-8fb4e3602d50 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:24.097095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-25ab4176-c74a-433f-8580-8fb4e3602d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:24.114076 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64923e6-a49d-4548-829b-44477fa76730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:24.114697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64923e6-a49d-4548-829b-44477fa76730 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.114968 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64923e6-a49d-4548-829b-44477fa76730 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.115256 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64923e6-a49d-4548-829b-44477fa76730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.127017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64923e6-a49d-4548-829b-44477fa76730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:24.128014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64923e6-a49d-4548-829b-44477fa76730 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-a64923e6-a49d-4548-829b-44477fa76730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:24.143884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:24.144868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:24.145802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:24.145802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:24.145802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:24.149201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:24.149781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 328/665] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:24.150553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64923e6-a49d-4548-829b-44477fa76730 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:24.176455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 338/666] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:24.177173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab4176-c74a-433f-8580-8fb4e3602d50 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:24.292062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64923e6-a49d-4548-829b-44477fa76730 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:24.293688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab4176-c74a-433f-8580-8fb4e3602d50 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:24.333005 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83eb1-e188-4289-b608-b08251dd22d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:24.333569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83eb1-e188-4289-b608-b08251dd22d5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.333822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83eb1-e188-4289-b608-b08251dd22d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.334157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83eb1-e188-4289-b608-b08251dd22d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.334816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83eb1-e188-4289-b608-b08251dd22d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:24.335164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83eb1-e188-4289-b608-b08251dd22d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:24.336551 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca07a4d-9ef3-4e42-8d98-ec657472be55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:24.336707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83eb1-e188-4289-b608-b08251dd22d5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:24.338113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca07a4d-9ef3-4e42-8d98-ec657472be55 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.338570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca07a4d-9ef3-4e42-8d98-ec657472be55 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.339653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca07a4d-9ef3-4e42-8d98-ec657472be55 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.341291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca07a4d-9ef3-4e42-8d98-ec657472be55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:24.341799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca07a4d-9ef3-4e42-8d98-ec657472be55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:24.343395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca07a4d-9ef3-4e42-8d98-ec657472be55 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:24.356143 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 329/667] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:24.359825 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83eb1-e188-4289-b608-b08251dd22d5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:24.363544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 339/668] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:24.364918 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca07a4d-9ef3-4e42-8d98-ec657472be55 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:24.390995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:24.405307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:24.482567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca07a4d-9ef3-4e42-8d98-ec657472be55 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:24.484242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83eb1-e188-4289-b608-b08251dd22d5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:24.515143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b172c92-8389-4eca-bbe5-35cc56127b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:24.515757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b172c92-8389-4eca-bbe5-35cc56127b0d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.516063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b172c92-8389-4eca-bbe5-35cc56127b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.516333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b172c92-8389-4eca-bbe5-35cc56127b0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.517304 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942073d-c4c2-44ad-af83-cdb42ed44c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:24.517909 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942073d-c4c2-44ad-af83-cdb42ed44c69 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.518191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942073d-c4c2-44ad-af83-cdb42ed44c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.518460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942073d-c4c2-44ad-af83-cdb42ed44c69 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.519098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942073d-c4c2-44ad-af83-cdb42ed44c69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:24.519424 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942073d-c4c2-44ad-af83-cdb42ed44c69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:24.520810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942073d-c4c2-44ad-af83-cdb42ed44c69 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:24.522895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b172c92-8389-4eca-bbe5-35cc56127b0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:24.524329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b172c92-8389-4eca-bbe5-35cc56127b0d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:24.532403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 330/669] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:24.533196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942073d-c4c2-44ad-af83-cdb42ed44c69 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9b172c92-8389-4eca-bbe5-35cc56127b0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:24.535620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:24.536673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:24.537783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:24.537783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:24.537783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:24.537783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:24.537783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:24.537783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:24.537783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:24.537783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:24.541804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 340/670] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:24.542917 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa820ae-7c8d-43fb-b7d4-1787d5637f29 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.543194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa820ae-7c8d-43fb-b7d4-1787d5637f29 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.543463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa820ae-7c8d-43fb-b7d4-1787d5637f29 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.544862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 341/671] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:24.545403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa820ae-7c8d-43fb-b7d4-1787d5637f29 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:24.620232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:24.637196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:24.637639 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942073d-c4c2-44ad-af83-cdb42ed44c69 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:24.644311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa820ae-7c8d-43fb-b7d4-1787d5637f29 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:24.670377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16882e15-fbdb-4325-a503-6290230e1cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:24.671000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16882e15-fbdb-4325-a503-6290230e1cbf None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.671277 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16882e15-fbdb-4325-a503-6290230e1cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.671547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16882e15-fbdb-4325-a503-6290230e1cbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.677274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85fefe-86f5-4c1c-999e-ee9874ded187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:24.677891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85fefe-86f5-4c1c-999e-ee9874ded187 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.678119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16882e15-fbdb-4325-a503-6290230e1cbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:24.678210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85fefe-86f5-4c1c-999e-ee9874ded187 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.678426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85fefe-86f5-4c1c-999e-ee9874ded187 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.679542 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16882e15-fbdb-4325-a503-6290230e1cbf None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:24.688900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85fefe-86f5-4c1c-999e-ee9874ded187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-16882e15-fbdb-4325-a503-6290230e1cbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:24.691063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:24.692081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:24.693166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:24.693166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:24.693166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:24.693166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:24.693166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:24.693166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:24.693166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:24.693166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:24.693166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 331/672] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:24.693729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16882e15-fbdb-4325-a503-6290230e1cbf None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2e85fefe-86f5-4c1c-999e-ee9874ded187 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:24.693936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:24.694800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:24.695646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:24.695646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:24.695646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:24.695646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:24.695646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:24.695646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:24.695646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:24.695646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:24.695646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:24.695646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:24.695646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:24.695646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:24.698476 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 342/673] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:24.699260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85fefe-86f5-4c1c-999e-ee9874ded187 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:24.791399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16882e15-fbdb-4325-a503-6290230e1cbf None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:24.795668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85fefe-86f5-4c1c-999e-ee9874ded187 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:24.827750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032add1-b1d0-4085-bafc-e1e741b0334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:24.828427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032add1-b1d0-4085-bafc-e1e741b0334d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.828705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032add1-b1d0-4085-bafc-e1e741b0334d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.828977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032add1-b1d0-4085-bafc-e1e741b0334d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.829999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7be327-7dbf-43d5-8f5f-794eed484544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:24.830686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7be327-7dbf-43d5-8f5f-794eed484544 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.831059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7be327-7dbf-43d5-8f5f-794eed484544 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.831441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7be327-7dbf-43d5-8f5f-794eed484544 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.832242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7be327-7dbf-43d5-8f5f-794eed484544 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:24.832532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7be327-7dbf-43d5-8f5f-794eed484544 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:24.833939 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7be327-7dbf-43d5-8f5f-794eed484544 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:24.835433 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032add1-b1d0-4085-bafc-e1e741b0334d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:24.836948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032add1-b1d0-4085-bafc-e1e741b0334d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:24.846413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 343/674] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:24.847549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84c73e-d60b-40ba-88f3-ff414fd0e7e3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.847830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84c73e-d60b-40ba-88f3-ff414fd0e7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.848131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84c73e-d60b-40ba-88f3-ff414fd0e7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d032add1-b1d0-4085-bafc-e1e741b0334d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:24.848673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:24.849525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:24.850418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:24.850418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:24.850418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:24.850418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:24.850418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:24.850418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:24.850418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:24.850418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:24.851487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 332/675] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:24.852349 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032add1-b1d0-4085-bafc-e1e741b0334d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:24.854946 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:24.869195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9a84c73e-d60b-40ba-88f3-ff414fd0e7e3 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:24.870434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9a84c73e-d60b-40ba-88f3-ff414fd0e7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:24.879306 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:24.936085 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 344/676] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:24.936933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84c73e-d60b-40ba-88f3-ff414fd0e7e3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:24.957442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032add1-b1d0-4085-bafc-e1e741b0334d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:24.992479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf016c-3a95-4c06-af8d-af808da6ccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:24.993078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf016c-3a95-4c06-af8d-af808da6ccca None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:24.993878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf016c-3a95-4c06-af8d-af808da6ccca None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:24.994152 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf016c-3a95-4c06-af8d-af808da6ccca None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:24.994844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf016c-3a95-4c06-af8d-af808da6ccca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:24.995130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf016c-3a95-4c06-af8d-af808da6ccca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:24.996576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf016c-3a95-4c06-af8d-af808da6ccca None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:25.008377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 333/677] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:25.009575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf016c-3a95-4c06-af8d-af808da6ccca None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:25.043606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84c73e-d60b-40ba-88f3-ff414fd0e7e3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:25.076013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:25.080723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0261-c154-48c6-86ee-877152c5583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:25.081808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0261-c154-48c6-86ee-877152c5583b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:25.082091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0261-c154-48c6-86ee-877152c5583b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:25.082513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0261-c154-48c6-86ee-877152c5583b None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:25.083299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee0261-c154-48c6-86ee-877152c5583b None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:25.083611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee0261-c154-48c6-86ee-877152c5583b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:25.085008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee0261-c154-48c6-86ee-877152c5583b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:25.096092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 345/678] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:25.096909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0261-c154-48c6-86ee-877152c5583b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:25.107220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:25.117320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf016c-3a95-4c06-af8d-af808da6ccca None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:25.154290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84118336-2566-4198-bf9d-c40e35760bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:25.155255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84118336-2566-4198-bf9d-c40e35760bee None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:25.155742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84118336-2566-4198-bf9d-c40e35760bee None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:25.156263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84118336-2566-4198-bf9d-c40e35760bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:25.157057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84118336-2566-4198-bf9d-c40e35760bee None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=2bf4d6e392fd4f8dadb37527f1750fc0) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:25.157446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84118336-2566-4198-bf9d-c40e35760bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:25.158858 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84118336-2566-4198-bf9d-c40e35760bee None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:25.171998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 334/679] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:25 2022] GET /identity/v3/role_assignments?user.id=2bf4d6e392fd4f8dadb37527f1750fc0&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:25.171998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84118336-2566-4198-bf9d-c40e35760bee None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:25.219613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0261-c154-48c6-86ee-877152c5583b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:25.259961 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d5e2b-6d89-4038-960e-22c481135968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:25.260662 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d5e2b-6d89-4038-960e-22c481135968 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:25.261019 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d5e2b-6d89-4038-960e-22c481135968 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:25.261296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d5e2b-6d89-4038-960e-22c481135968 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:25.262027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d5e2b-6d89-4038-960e-22c481135968 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:25.262335 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d5e2b-6d89-4038-960e-22c481135968 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:25.263771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d5e2b-6d89-4038-960e-22c481135968 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:25.277779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 346/680] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:25.278659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d5e2b-6d89-4038-960e-22c481135968 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:25.290571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84118336-2566-4198-bf9d-c40e35760bee None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:25.322948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:25.332118 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3dba8-7345-41bd-aa4b-226ee71c0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:25.332734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3dba8-7345-41bd-aa4b-226ee71c0ffa None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:25.333010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3dba8-7345-41bd-aa4b-226ee71c0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:25.338538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3dba8-7345-41bd-aa4b-226ee71c0ffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:25.338538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3dba8-7345-41bd-aa4b-226ee71c0ffa None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=6462736c485545d8a26766360ebe0c0e) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:25.338538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3dba8-7345-41bd-aa4b-226ee71c0ffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:25.338538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3dba8-7345-41bd-aa4b-226ee71c0ffa None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:25.343069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 335/681] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:25 2022] GET /identity/v3/role_assignments?user.id=6462736c485545d8a26766360ebe0c0e&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:25.343982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3dba8-7345-41bd-aa4b-226ee71c0ffa None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:25.365698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:25.413764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d5e2b-6d89-4038-960e-22c481135968 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:25.457006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6479f-88f1-420d-ac0e-6a83dcb812f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:25.457721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6479f-88f1-420d-ac0e-6a83dcb812f5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:25.457999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6479f-88f1-420d-ac0e-6a83dcb812f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:25.458317 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6479f-88f1-420d-ac0e-6a83dcb812f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:25.470898 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6479f-88f1-420d-ac0e-6a83dcb812f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:25.472398 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6479f-88f1-420d-ac0e-6a83dcb812f5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:25.486262 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3dba8-7345-41bd-aa4b-226ee71c0ffa None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ccb6479f-88f1-420d-ac0e-6a83dcb812f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:25.488537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:25.489465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:25.490354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:25.490354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:25.490354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:25.494494 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 347/682] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:25.495448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6479f-88f1-420d-ac0e-6a83dcb812f5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:25.538347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4cec9-2536-428e-a421-9bb8655e2185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:25.539053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4cec9-2536-428e-a421-9bb8655e2185 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:25.539336 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4cec9-2536-428e-a421-9bb8655e2185 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:25.539606 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4cec9-2536-428e-a421-9bb8655e2185 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:25.553126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4cec9-2536-428e-a421-9bb8655e2185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-f2e4cec9-2536-428e-a421-9bb8655e2185 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:25.560970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:25.562055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:25.563056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 336/683] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:14:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:25.563972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4cec9-2536-428e-a421-9bb8655e2185 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:25.630133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6479f-88f1-420d-ac0e-6a83dcb812f5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:25.631445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:25.649948 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:25.671414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532e3b-8252-4700-88b0-0da256474023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:25.671972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532e3b-8252-4700-88b0-0da256474023 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:25.672248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532e3b-8252-4700-88b0-0da256474023 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:25.672519 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532e3b-8252-4700-88b0-0da256474023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:25.673243 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532e3b-8252-4700-88b0-0da256474023 None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=b040de20aa6f4e7b8366c7daa54c093c) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:25.673550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532e3b-8252-4700-88b0-0da256474023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:25.674970 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532e3b-8252-4700-88b0-0da256474023 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:25.680873 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 348/684] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:25 2022] GET /identity/v3/role_assignments?user.id=b040de20aa6f4e7b8366c7daa54c093c&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:25.682472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532e3b-8252-4700-88b0-0da256474023 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:25.688249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4cec9-2536-428e-a421-9bb8655e2185 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:25.732854 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1bfec-a646-46f5-9c64-c9b77953bae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:25.734171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1bfec-a646-46f5-9c64-c9b77953bae9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:25.734652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1bfec-a646-46f5-9c64-c9b77953bae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:25.735122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1bfec-a646-46f5-9c64-c9b77953bae9 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:25.736017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1bfec-a646-46f5-9c64-c9b77953bae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:25.736553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1bfec-a646-46f5-9c64-c9b77953bae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:25.739024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1bfec-a646-46f5-9c64-c9b77953bae9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:25.760587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 337/685] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:25.762244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1bfec-a646-46f5-9c64-c9b77953bae9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:25.887897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532e3b-8252-4700-88b0-0da256474023 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:25.944972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1bfec-a646-46f5-9c64-c9b77953bae9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:25.951327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a775cd-fad2-40f7-a14e-b904d1e72832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:25.952057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a775cd-fad2-40f7-a14e-b904d1e72832 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:25.952406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a775cd-fad2-40f7-a14e-b904d1e72832 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:25.952745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a775cd-fad2-40f7-a14e-b904d1e72832 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:25.953475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a775cd-fad2-40f7-a14e-b904d1e72832 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:25.953848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a775cd-fad2-40f7-a14e-b904d1e72832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:25.955284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a775cd-fad2-40f7-a14e-b904d1e72832 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:25.968029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 349/686] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:14:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:25.971087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a775cd-fad2-40f7-a14e-b904d1e72832 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:25.971566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:25.999184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7094e3-337b-4436-8043-de59d65a3d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:26.000282 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7094e3-337b-4436-8043-de59d65a3d3f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:26.000568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7094e3-337b-4436-8043-de59d65a3d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:26.000839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7094e3-337b-4436-8043-de59d65a3d3f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:26.011211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7094e3-337b-4436-8043-de59d65a3d3f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:26.013946 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7094e3-337b-4436-8043-de59d65a3d3f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-2e7094e3-337b-4436-8043-de59d65a3d3f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:26.031530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:26.032717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:26.033871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:26.033871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:26.033871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:26.033871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:26.033871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:26.033871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:26.033871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:26.033871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:26.033871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 10:14:26.033871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:26.036371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:26.037077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 338/687] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:14:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:26.043556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7094e3-337b-4436-8043-de59d65a3d3f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:26.116228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a775cd-fad2-40f7-a14e-b904d1e72832 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:26.164684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad04de-3dd3-48b2-82b4-8900f9b5de50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:26.166719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad04de-3dd3-48b2-82b4-8900f9b5de50 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:26.168230 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad04de-3dd3-48b2-82b4-8900f9b5de50 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:26.169864 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad04de-3dd3-48b2-82b4-8900f9b5de50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:26.175700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7094e3-337b-4436-8043-de59d65a3d3f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:26.194319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad04de-3dd3-48b2-82b4-8900f9b5de50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:26.196067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad04de-3dd3-48b2-82b4-8900f9b5de50 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b0ad04de-3dd3-48b2-82b4-8900f9b5de50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:26.221810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:26.223404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:26.224562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:26.224562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:26.224562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:26.226593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 350/688] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:26.233495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad04de-3dd3-48b2-82b4-8900f9b5de50 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:26.257194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed1c8b-a7b4-44a0-a409-9046c412279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:26.257812 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed1c8b-a7b4-44a0-a409-9046c412279e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:26.258081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed1c8b-a7b4-44a0-a409-9046c412279e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:26.258354 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed1c8b-a7b4-44a0-a409-9046c412279e None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:26.259610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed1c8b-a7b4-44a0-a409-9046c412279e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:26.259911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed1c8b-a7b4-44a0-a409-9046c412279e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:26.261334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed1c8b-a7b4-44a0-a409-9046c412279e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:26.310184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 339/689] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Oct 4 10:14:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:26.316094 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed1c8b-a7b4-44a0-a409-9046c412279e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:26.345637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:26.354382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad04de-3dd3-48b2-82b4-8900f9b5de50 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:26.381935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:26.397112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0401d-3407-4195-aae6-a453fe363c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:26.397720 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0401d-3407-4195-aae6-a453fe363c53 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:26.397993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0401d-3407-4195-aae6-a453fe363c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:26.398261 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0401d-3407-4195-aae6-a453fe363c53 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:26.398899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0401d-3407-4195-aae6-a453fe363c53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:26.399197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0401d-3407-4195-aae6-a453fe363c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:26.400694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0401d-3407-4195-aae6-a453fe363c53 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:26.422438 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 351/690] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:26.429038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0401d-3407-4195-aae6-a453fe363c53 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:26.480963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed1c8b-a7b4-44a0-a409-9046c412279e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:26.520401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f3b4f-efd3-47ad-8473-9921bf8ae192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:26.521859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f3b4f-efd3-47ad-8473-9921bf8ae192 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:26.522335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f3b4f-efd3-47ad-8473-9921bf8ae192 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:26.522824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f3b4f-efd3-47ad-8473-9921bf8ae192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:26.561220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0401d-3407-4195-aae6-a453fe363c53 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:26.599974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d73c5d-8098-4505-aed6-fd656ccc1158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:26.599974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d73c5d-8098-4505-aed6-fd656ccc1158 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:26.599974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d73c5d-8098-4505-aed6-fd656ccc1158 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:26.599974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d73c5d-8098-4505-aed6-fd656ccc1158 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:26.605161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d73c5d-8098-4505-aed6-fd656ccc1158 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:26.606593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d73c5d-8098-4505-aed6-fd656ccc1158 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-19d73c5d-8098-4505-aed6-fd656ccc1158 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:26.627635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:26.628763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:26.629727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:26.629727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:26.629727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:26.629727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:26.629727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:26.629727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:26.629727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:26.629727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:26.629727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:14:26.629727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:26.629727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 352/691] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 10:14:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:26.637342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d73c5d-8098-4505-aed6-fd656ccc1158 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:26.650484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f3b4f-efd3-47ad-8473-9921bf8ae192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:26.651975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f3b4f-efd3-47ad-8473-9921bf8ae192 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:26.688322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:26.702323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:26.781108 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d73c5d-8098-4505-aed6-fd656ccc1158 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:26.815472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c7b3-2eb1-42c1-9eb6-f641e28a4f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:26.816107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c7b3-2eb1-42c1-9eb6-f641e28a4f6b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:26.816403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c7b3-2eb1-42c1-9eb6-f641e28a4f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:26.816659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c7b3-2eb1-42c1-9eb6-f641e28a4f6b None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:26.817385 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c7b3-2eb1-42c1-9eb6-f641e28a4f6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:26.817689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c7b3-2eb1-42c1-9eb6-f641e28a4f6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:26.819107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c7b3-2eb1-42c1-9eb6-f641e28a4f6b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:26.837295 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 353/692] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 10:14:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:26.846828 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c7b3-2eb1-42c1-9eb6-f641e28a4f6b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:26.871452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 340/693] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:14:26.874476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f3b4f-efd3-47ad-8473-9921bf8ae192 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:27.008340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:27.043368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c7b3-2eb1-42c1-9eb6-f641e28a4f6b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:27.069838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f3b4f-efd3-47ad-8473-9921bf8ae192 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:27.083226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4659389-e0a3-4118-9212-76a9eb34ab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:27.083831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4659389-e0a3-4118-9212-76a9eb34ab4d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:27.084141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4659389-e0a3-4118-9212-76a9eb34ab4d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:27.084411 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4659389-e0a3-4118-9212-76a9eb34ab4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:27.136723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:27.158791 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4659389-e0a3-4118-9212-76a9eb34ab4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:27.160292 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4659389-e0a3-4118-9212-76a9eb34ab4d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:27.163960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efb739-bb58-42cf-9cb0-1e47ea403c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:27.164850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efb739-bb58-42cf-9cb0-1e47ea403c7a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:27.165829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efb739-bb58-42cf-9cb0-1e47ea403c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:27.166289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efb739-bb58-42cf-9cb0-1e47ea403c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:27.189905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efb739-bb58-42cf-9cb0-1e47ea403c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:27.191678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efb739-bb58-42cf-9cb0-1e47ea403c7a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-b0efb739-bb58-42cf-9cb0-1e47ea403c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:27.223106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:27.224132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:27.225042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:27.225042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:27.225042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:27.225042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 341/694] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:27.232288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efb739-bb58-42cf-9cb0-1e47ea403c7a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:27.283527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:27.328218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 354/695] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 10:14:27.334001 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4659389-e0a3-4118-9212-76a9eb34ab4d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:27.405909 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efb739-bb58-42cf-9cb0-1e47ea403c7a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:27.456823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e3978-2548-4aa7-9d9a-0a1e960d626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:27.457619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e3978-2548-4aa7-9d9a-0a1e960d626a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:27.457902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e3978-2548-4aa7-9d9a-0a1e960d626a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:27.458174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e3978-2548-4aa7-9d9a-0a1e960d626a None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:27.458911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e3978-2548-4aa7-9d9a-0a1e960d626a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:27.459215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e3978-2548-4aa7-9d9a-0a1e960d626a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:27.460705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e3978-2548-4aa7-9d9a-0a1e960d626a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:27.464977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4659389-e0a3-4118-9212-76a9eb34ab4d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:27.485511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 342/696] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:27.491083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e3978-2548-4aa7-9d9a-0a1e960d626a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:27.519816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11b760-8172-40a5-b3c0-20ea06a62230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:27.520479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11b760-8172-40a5-b3c0-20ea06a62230 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:27.520756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11b760-8172-40a5-b3c0-20ea06a62230 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:27.521061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11b760-8172-40a5-b3c0-20ea06a62230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:27.543391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11b760-8172-40a5-b3c0-20ea06a62230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:27.548214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11b760-8172-40a5-b3c0-20ea06a62230 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:27.565862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3d11b760-8172-40a5-b3c0-20ea06a62230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:27.572454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:27.574706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:27.578189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:27.578189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:27.578189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:27.578189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 355/697] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:27.586960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11b760-8172-40a5-b3c0-20ea06a62230 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:27.636404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:27.678481 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e3978-2548-4aa7-9d9a-0a1e960d626a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:27.743999 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c8983-5634-44ed-8428-9098cbe59bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:27.744689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c8983-5634-44ed-8428-9098cbe59bfc None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:27.745027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c8983-5634-44ed-8428-9098cbe59bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:27.745306 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c8983-5634-44ed-8428-9098cbe59bfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:27.754796 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c8983-5634-44ed-8428-9098cbe59bfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:27.756293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c8983-5634-44ed-8428-9098cbe59bfc None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:27.768812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11b760-8172-40a5-b3c0-20ea06a62230 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-7b1c8983-5634-44ed-8428-9098cbe59bfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:27.772485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:27.774830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:27.776948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:27.776948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:27.776948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:27.776948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:27.776948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:27.776948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:27.776948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:27.776948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:27.776948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 343/698] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:27.776948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8da631-e464-42cf-adca-5f1389bcaa6d None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:27.776948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8da631-e464-42cf-adca-5f1389bcaa6d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:27.778365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8da631-e464-42cf-adca-5f1389bcaa6d None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:27.781714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 344/699] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:27.783027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6afc63-760e-4265-9520-6ab0a4e2db59 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:27.783310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6afc63-760e-4265-9520-6ab0a4e2db59 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:27.784076 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6afc63-760e-4265-9520-6ab0a4e2db59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:27.812193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9f6afc63-760e-4265-9520-6ab0a4e2db59 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:27.812675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17badf01-3c39-4c42-8873-ec04bec5e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:27.813308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17badf01-3c39-4c42-8873-ec04bec5e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:27.813552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9f6afc63-760e-4265-9520-6ab0a4e2db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:27.813724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17badf01-3c39-4c42-8873-ec04bec5e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:27.813885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17badf01-3c39-4c42-8873-ec04bec5e7c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:27.814483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17badf01-3c39-4c42-8873-ec04bec5e7c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:27.814785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17badf01-3c39-4c42-8873-ec04bec5e7c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:27.816410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17badf01-3c39-4c42-8873-ec04bec5e7c0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:27.835119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 356/700] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:27.836284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17badf01-3c39-4c42-8873-ec04bec5e7c0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:27.908510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 345/701] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:27.909516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6afc63-760e-4265-9520-6ab0a4e2db59 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:27.943260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:27.957349 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:27.962030 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17badf01-3c39-4c42-8873-ec04bec5e7c0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:28.002838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f453b9d-fa8b-496c-80e8-9b2d630b3aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:28.003449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f453b9d-fa8b-496c-80e8-9b2d630b3aff None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.003725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f453b9d-fa8b-496c-80e8-9b2d630b3aff None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.004125 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f453b9d-fa8b-496c-80e8-9b2d630b3aff None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.004891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f453b9d-fa8b-496c-80e8-9b2d630b3aff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:28.005192 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f453b9d-fa8b-496c-80e8-9b2d630b3aff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:28.007277 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f453b9d-fa8b-496c-80e8-9b2d630b3aff None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:28.024039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 357/702] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:28.025727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7034c-9437-47f8-97af-3ad4cb5d8f1a None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.026181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7034c-9437-47f8-97af-3ad4cb5d8f1a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.026623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7034c-9437-47f8-97af-3ad4cb5d8f1a None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.030340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 358/703] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:28.031619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7034c-9437-47f8-97af-3ad4cb5d8f1a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:28.063552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6afc63-760e-4265-9520-6ab0a4e2db59 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:28.111124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116ce93-7e6e-47b9-81b5-42fdb79b7003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:28.112082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116ce93-7e6e-47b9-81b5-42fdb79b7003 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.112414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116ce93-7e6e-47b9-81b5-42fdb79b7003 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.112695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116ce93-7e6e-47b9-81b5-42fdb79b7003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.121479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116ce93-7e6e-47b9-81b5-42fdb79b7003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:28.123184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116ce93-7e6e-47b9-81b5-42fdb79b7003 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-e116ce93-7e6e-47b9-81b5-42fdb79b7003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:28.134690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:28.135595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:28.136528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:28.136528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:28.136528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:28.136528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:28.136528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:28.136528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:28.136528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:28.136528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:28.143222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 346/704] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:28.144718 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f8a69-10a1-42d1-a890-9cd7a968cf52 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.145201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f8a69-10a1-42d1-a890-9cd7a968cf52 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.145782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f8a69-10a1-42d1-a890-9cd7a968cf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.163011 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7034c-9437-47f8-97af-3ad4cb5d8f1a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:28.165057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-965f8a69-10a1-42d1-a890-9cd7a968cf52 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:28.168740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-965f8a69-10a1-42d1-a890-9cd7a968cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:28.201062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102591ab-130c-4883-8e1e-bacedb763e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:28.201672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102591ab-130c-4883-8e1e-bacedb763e28 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.201952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102591ab-130c-4883-8e1e-bacedb763e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.202223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102591ab-130c-4883-8e1e-bacedb763e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.202957 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102591ab-130c-4883-8e1e-bacedb763e28 None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=fe9c03800bc6451aa9e5a39ca4ea0bf7) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:28.203266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102591ab-130c-4883-8e1e-bacedb763e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:28.204786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102591ab-130c-4883-8e1e-bacedb763e28 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:28.210674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 359/705] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:28 2022] GET /identity/v3/role_assignments?user.id=fe9c03800bc6451aa9e5a39ca4ea0bf7&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:28.211472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102591ab-130c-4883-8e1e-bacedb763e28 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:28.229191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:28.247226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 347/706] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:28.248650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f8a69-10a1-42d1-a890-9cd7a968cf52 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:28.275569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:28.344437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102591ab-130c-4883-8e1e-bacedb763e28 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:28.369835 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f8a69-10a1-42d1-a890-9cd7a968cf52 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:28.385425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e8c90-c038-4eff-9fd3-373ce2c088f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:28.386320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8c90-c038-4eff-9fd3-373ce2c088f3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.386603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8c90-c038-4eff-9fd3-373ce2c088f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.386876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8c90-c038-4eff-9fd3-373ce2c088f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.388117 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e8c90-c038-4eff-9fd3-373ce2c088f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:28.388432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e8c90-c038-4eff-9fd3-373ce2c088f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:28.390152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e8c90-c038-4eff-9fd3-373ce2c088f3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:28.406267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 360/707] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:28.407609 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63994-635a-46bc-bb98-27cb78842851 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.407894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63994-635a-46bc-bb98-27cb78842851 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.408274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63994-635a-46bc-bb98-27cb78842851 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.412535 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 361/708] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:28.413668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63994-635a-46bc-bb98-27cb78842851 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:28.418333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b3bad-7402-4f3a-880d-a98dbe7177c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:28.418990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b3bad-7402-4f3a-880d-a98dbe7177c2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.419274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b3bad-7402-4f3a-880d-a98dbe7177c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.419545 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b3bad-7402-4f3a-880d-a98dbe7177c2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.421184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b3bad-7402-4f3a-880d-a98dbe7177c2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:28.421575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b3bad-7402-4f3a-880d-a98dbe7177c2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-849b3bad-7402-4f3a-880d-a98dbe7177c2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:28.434356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:28.435454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:28.436958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 348/709] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Oct 4 10:14:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:28.437766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55d1fe-70fa-4be5-83ef-1db6b701deab None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.437766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55d1fe-70fa-4be5-83ef-1db6b701deab None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.437766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55d1fe-70fa-4be5-83ef-1db6b701deab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.459113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0a55d1fe-70fa-4be5-83ef-1db6b701deab None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:28.460839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0a55d1fe-70fa-4be5-83ef-1db6b701deab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:28.505049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:28.532927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63994-635a-46bc-bb98-27cb78842851 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:28.546102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 349/710] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:28.547206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55d1fe-70fa-4be5-83ef-1db6b701deab None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:28.563228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:28.577902 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5d7ec-2e64-4395-b962-02b1ca2aacbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:28.578767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5d7ec-2e64-4395-b962-02b1ca2aacbc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.579154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5d7ec-2e64-4395-b962-02b1ca2aacbc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.579524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5d7ec-2e64-4395-b962-02b1ca2aacbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.580390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5d7ec-2e64-4395-b962-02b1ca2aacbc None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=567188b7c4fe40c1a1623d2f60092d26) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:28.580960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5d7ec-2e64-4395-b962-02b1ca2aacbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:28.583069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5d7ec-2e64-4395-b962-02b1ca2aacbc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:28.589860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 362/711] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:28 2022] GET /identity/v3/role_assignments?user.id=567188b7c4fe40c1a1623d2f60092d26&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:28.612497 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5d7ec-2e64-4395-b962-02b1ca2aacbc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:28.687923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55d1fe-70fa-4be5-83ef-1db6b701deab None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:28.730897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd16087-197e-4e79-9f4e-bd9fa274abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:28.731720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd16087-197e-4e79-9f4e-bd9fa274abbe None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.732028 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd16087-197e-4e79-9f4e-bd9fa274abbe None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.732617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd16087-197e-4e79-9f4e-bd9fa274abbe None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.733543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd16087-197e-4e79-9f4e-bd9fa274abbe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:28.733849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd16087-197e-4e79-9f4e-bd9fa274abbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:28.735227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd16087-197e-4e79-9f4e-bd9fa274abbe None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:28.735531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5d7ec-2e64-4395-b962-02b1ca2aacbc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:28.742495 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 350/712] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Oct 4 10:14:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:28.750438 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd16087-197e-4e79-9f4e-bd9fa274abbe None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:28.795167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4156363-068b-4f54-b05e-56fc460315cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:28.797426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4156363-068b-4f54-b05e-56fc460315cc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.797861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4156363-068b-4f54-b05e-56fc460315cc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.798361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4156363-068b-4f54-b05e-56fc460315cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.804636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:28.821918 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4156363-068b-4f54-b05e-56fc460315cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:28.824576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4156363-068b-4f54-b05e-56fc460315cc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f4156363-068b-4f54-b05e-56fc460315cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:28.843845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:28.844920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:28.845906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:28.845906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:28.845906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:28.848274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 363/713] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:28.854378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4156363-068b-4f54-b05e-56fc460315cc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:28.862492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:28.886611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd16087-197e-4e79-9f4e-bd9fa274abbe None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:28.927702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0524d26-ebd7-4139-8778-3c36cb768068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:28.928450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0524d26-ebd7-4139-8778-3c36cb768068 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:28.928789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0524d26-ebd7-4139-8778-3c36cb768068 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:28.929136 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0524d26-ebd7-4139-8778-3c36cb768068 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:28.929949 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0524d26-ebd7-4139-8778-3c36cb768068 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:28.930318 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0524d26-ebd7-4139-8778-3c36cb768068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:28.932401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0524d26-ebd7-4139-8778-3c36cb768068 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:28.938897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 351/714] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Oct 4 10:14:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:28.944186 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0524d26-ebd7-4139-8778-3c36cb768068 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:29.002159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4156363-068b-4f54-b05e-56fc460315cc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:29.085683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34796e8e-7d18-42fb-8903-da539a6c06c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:29.086555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34796e8e-7d18-42fb-8903-da539a6c06c4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:29.087604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34796e8e-7d18-42fb-8903-da539a6c06c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:29.087879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34796e8e-7d18-42fb-8903-da539a6c06c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:29.088554 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34796e8e-7d18-42fb-8903-da539a6c06c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:29.088857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34796e8e-7d18-42fb-8903-da539a6c06c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:29.090490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34796e8e-7d18-42fb-8903-da539a6c06c4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:29.112572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 364/715] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:29.118191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34796e8e-7d18-42fb-8903-da539a6c06c4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:29.132756 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0524d26-ebd7-4139-8778-3c36cb768068 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:29.190838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:29.194942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234c7cf-bc7d-4a61-b340-335559c6d9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:29.195569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234c7cf-bc7d-4a61-b340-335559c6d9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:29.195847 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234c7cf-bc7d-4a61-b340-335559c6d9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:29.196144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234c7cf-bc7d-4a61-b340-335559c6d9f5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:29.198063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234c7cf-bc7d-4a61-b340-335559c6d9f5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:29.199428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234c7cf-bc7d-4a61-b340-335559c6d9f5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-4234c7cf-bc7d-4a61-b340-335559c6d9f5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:29.211725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:29.212925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 10:14:29.213783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:29.216798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 352/716] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:28 2022] GET /identity/v3/services/network => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:29.223111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234c7cf-bc7d-4a61-b340-335559c6d9f5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:29.235892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:29.265867 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34796e8e-7d18-42fb-8903-da539a6c06c4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:29.303936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd3b5c-2af1-4eba-a97a-2a4a637ded8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:29.304966 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd3b5c-2af1-4eba-a97a-2a4a637ded8f None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:29.305448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd3b5c-2af1-4eba-a97a-2a4a637ded8f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:29.306563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd3b5c-2af1-4eba-a97a-2a4a637ded8f None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:29.307411 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd3b5c-2af1-4eba-a97a-2a4a637ded8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:29.309091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd3b5c-2af1-4eba-a97a-2a4a637ded8f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:29.391591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 365/717] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:14:29 2022] POST /identity/v3/users => generated 254 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:14:29.396468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234c7cf-bc7d-4a61-b340-335559c6d9f5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:29.436841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de90a2-acee-4f34-9474-9af33139fc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:29.437952 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de90a2-acee-4f34-9474-9af33139fc89 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:29.438504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de90a2-acee-4f34-9474-9af33139fc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:29.439004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de90a2-acee-4f34-9474-9af33139fc89 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:29.439878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de90a2-acee-4f34-9474-9af33139fc89 None admin] RBAC: Adding query filter params (name=network) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:29.440454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de90a2-acee-4f34-9474-9af33139fc89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:29.442093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de90a2-acee-4f34-9474-9af33139fc89 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:29.448621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 353/718] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:14:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:29.456108 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd3b5c-2af1-4eba-a97a-2a4a637ded8f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:29.596918 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd3b5c-2af1-4eba-a97a-2a4a637ded8f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:29.598487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:29.634390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a4dca-9033-4ee5-9273-47afaf52c576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:29.635005 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a4dca-9033-4ee5-9273-47afaf52c576 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:29.635285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a4dca-9033-4ee5-9273-47afaf52c576 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:29.635555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a4dca-9033-4ee5-9273-47afaf52c576 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:29.636253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a4dca-9033-4ee5-9273-47afaf52c576 None admin] RBAC: Adding query filter params (type=network) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:29.636557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a4dca-9033-4ee5-9273-47afaf52c576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:29.637912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a4dca-9033-4ee5-9273-47afaf52c576 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:29.644186 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 366/719] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:14:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:31.085124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8169c-7e5a-4181-a35d-7784470df213 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:31.085639 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8169c-7e5a-4181-a35d-7784470df213 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:31.085639 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8169c-7e5a-4181-a35d-7784470df213 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:31.087784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 354/720] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:31.093181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db3e14-8f8f-41e0-9621-39fbbc27ac2f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:31.093577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db3e14-8f8f-41e0-9621-39fbbc27ac2f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:31.093760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db3e14-8f8f-41e0-9621-39fbbc27ac2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:31.116969 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f2db3e14-8f8f-41e0-9621-39fbbc27ac2f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:31.118695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f2db3e14-8f8f-41e0-9621-39fbbc27ac2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:31.161994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c59ce-54cf-442b-8d77-bfb7717fcdca None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:31.162731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c59ce-54cf-442b-8d77-bfb7717fcdca None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:31.163204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c59ce-54cf-442b-8d77-bfb7717fcdca None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:31.165124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 355/721] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:14:31.171045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc509724-cfb3-4d30-8b64-23c66408a51e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:31.171566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc509724-cfb3-4d30-8b64-23c66408a51e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:31.172478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc509724-cfb3-4d30-8b64-23c66408a51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:31.194274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-cc509724-cfb3-4d30-8b64-23c66408a51e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:31.196311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cc509724-cfb3-4d30-8b64-23c66408a51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:31.215849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 367/722] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:31.286314 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 356/723] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 10:14:31.291972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:31.543256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa508da5-3bb0-4aa3-8d24-52f21a048343 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:31.543586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa508da5-3bb0-4aa3-8d24-52f21a048343 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:31.543783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa508da5-3bb0-4aa3-8d24-52f21a048343 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:31.545352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 368/724] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:31.550585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a502752-fb0f-4c6b-a929-09200aaf3095 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:31.550873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a502752-fb0f-4c6b-a929-09200aaf3095 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:31.551146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a502752-fb0f-4c6b-a929-09200aaf3095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:31.552714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa508da5-3bb0-4aa3-8d24-52f21a048343 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:31.570012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3a502752-fb0f-4c6b-a929-09200aaf3095 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:31.571210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3a502752-fb0f-4c6b-a929-09200aaf3095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:31.679933 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 357/725] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:31.682010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a502752-fb0f-4c6b-a929-09200aaf3095 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:31.754344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:31.766011 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa508da5-3bb0-4aa3-8d24-52f21a048343 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:31.830939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a502752-fb0f-4c6b-a929-09200aaf3095 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:31.832783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb14e83-2185-4c45-9a7d-bed323688c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:31.833426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb14e83-2185-4c45-9a7d-bed323688c14 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:31.833702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb14e83-2185-4c45-9a7d-bed323688c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:31.835220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb14e83-2185-4c45-9a7d-bed323688c14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:31.851918 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb14e83-2185-4c45-9a7d-bed323688c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-dcb14e83-2185-4c45-9a7d-bed323688c14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:31.856968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:31.857897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:31.858729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 369/726] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:14:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:31.865638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb14e83-2185-4c45-9a7d-bed323688c14 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:31.896145 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:31.917684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb877cf-b541-4fe9-85e0-d2f0c4d745c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:31.918038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb877cf-b541-4fe9-85e0-d2f0c4d745c0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:31.918307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb877cf-b541-4fe9-85e0-d2f0c4d745c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:31.918628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb877cf-b541-4fe9-85e0-d2f0c4d745c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:31.939772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb877cf-b541-4fe9-85e0-d2f0c4d745c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-2bb877cf-b541-4fe9-85e0-d2f0c4d745c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:31.947829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:31.948899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:31.949752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:31.949752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:31.949752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:31.949752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:31.949752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:31.949752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:31.949752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:31.949752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:31.949752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:31.949752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:31.949752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:14:31.949752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:31.955849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 358/727] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:14:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:31.964252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb877cf-b541-4fe9-85e0-d2f0c4d745c0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:32.059888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb14e83-2185-4c45-9a7d-bed323688c14 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:32.091399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb877cf-b541-4fe9-85e0-d2f0c4d745c0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:32.104209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7544de2-7343-4528-a291-010882a381fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:32.105416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7544de2-7343-4528-a291-010882a381fd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:32.105888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7544de2-7343-4528-a291-010882a381fd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:32.106349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7544de2-7343-4528-a291-010882a381fd None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:32.107430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7544de2-7343-4528-a291-010882a381fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:32.108395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7544de2-7343-4528-a291-010882a381fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:32.110350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7544de2-7343-4528-a291-010882a381fd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:32.125175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 370/728] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:14:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:32.125175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7544de2-7343-4528-a291-010882a381fd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:32.138361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825c123-72ab-4429-8a4e-d1f53ace54df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:32.139409 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825c123-72ab-4429-8a4e-d1f53ace54df None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:32.139908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825c123-72ab-4429-8a4e-d1f53ace54df None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:32.140718 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825c123-72ab-4429-8a4e-d1f53ace54df None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:32.141842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825c123-72ab-4429-8a4e-d1f53ace54df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:32.142329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825c123-72ab-4429-8a4e-d1f53ace54df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:32.143766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:32.144875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825c123-72ab-4429-8a4e-d1f53ace54df None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:32.155705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 359/729] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:14:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:32.156907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825c123-72ab-4429-8a4e-d1f53ace54df None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:32.222733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:32.249387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7544de2-7343-4528-a291-010882a381fd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:32.281982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825c123-72ab-4429-8a4e-d1f53ace54df None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:32.293127 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72ed9c-b135-4111-92a8-bec556b14282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:32.294072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72ed9c-b135-4111-92a8-bec556b14282 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:32.294541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72ed9c-b135-4111-92a8-bec556b14282 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:32.294978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72ed9c-b135-4111-92a8-bec556b14282 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:32.295796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72ed9c-b135-4111-92a8-bec556b14282 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:32.298099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72ed9c-b135-4111-92a8-bec556b14282 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:32.320491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13f4a1-c2a6-4af5-8073-7a157702c8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:32.321789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13f4a1-c2a6-4af5-8073-7a157702c8ff None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:32.322136 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13f4a1-c2a6-4af5-8073-7a157702c8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:32.322474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13f4a1-c2a6-4af5-8073-7a157702c8ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:32.335304 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13f4a1-c2a6-4af5-8073-7a157702c8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:32.336964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13f4a1-c2a6-4af5-8073-7a157702c8ff None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-2c13f4a1-c2a6-4af5-8073-7a157702c8ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:32.353548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:32.354528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:32.355407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:32.355407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:32.355407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:32.355407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 360/730] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:32.356702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13f4a1-c2a6-4af5-8073-7a157702c8ff None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:32.424131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 371/731] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:14:32 2022] POST /identity/v3/services => generated 251 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:14:32.425461 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1f3af-9095-4c81-802a-2810d4f8bbfe None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:32.425807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1f3af-9095-4c81-802a-2810d4f8bbfe None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:32.426182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1f3af-9095-4c81-802a-2810d4f8bbfe None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:32.431675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 372/732] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:32.431675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1f3af-9095-4c81-802a-2810d4f8bbfe None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:32.469842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13f4a1-c2a6-4af5-8073-7a157702c8ff None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:32.472539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:32.515539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea169b1-949a-4f76-b800-9b5b8f3ce5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:32.516215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea169b1-949a-4f76-b800-9b5b8f3ce5eb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:32.516496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea169b1-949a-4f76-b800-9b5b8f3ce5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:32.516767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea169b1-949a-4f76-b800-9b5b8f3ce5eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:32.528756 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea169b1-949a-4f76-b800-9b5b8f3ce5eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:32.530248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea169b1-949a-4f76-b800-9b5b8f3ce5eb None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:32.533369 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-6ea169b1-949a-4f76-b800-9b5b8f3ce5eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:32.547025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:32.548087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:32.548984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:32.548984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:32.548984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:32.548984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 361/733] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:32.549731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc395-57be-4a35-8d74-8b4b104e6a1e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:32.550018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc395-57be-4a35-8d74-8b4b104e6a1e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:32.550295 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc395-57be-4a35-8d74-8b4b104e6a1e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:32.551842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 362/734] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:32.552897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3aa165-2a59-4c24-afe2-f31987961964 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:32.553083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3aa165-2a59-4c24-afe2-f31987961964 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:32.553355 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3aa165-2a59-4c24-afe2-f31987961964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:32.570938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1f3af-9095-4c81-802a-2810d4f8bbfe None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:32.584581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-8d3aa165-2a59-4c24-afe2-f31987961964 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:32.585902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8d3aa165-2a59-4c24-afe2-f31987961964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:32.612069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6930a8-ceb9-4200-9849-85831ef31def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:32.612602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6930a8-ceb9-4200-9849-85831ef31def None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:32.612879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6930a8-ceb9-4200-9849-85831ef31def None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:32.613151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6930a8-ceb9-4200-9849-85831ef31def None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:32.613792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6930a8-ceb9-4200-9849-85831ef31def None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:32.614097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6930a8-ceb9-4200-9849-85831ef31def None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:32.615456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6930a8-ceb9-4200-9849-85831ef31def None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:32.627988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 373/735] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:32.629106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6930a8-ceb9-4200-9849-85831ef31def None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:32.665682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 363/736] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:32.666629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86191-5a29-40f0-9596-4f6df3138005 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:32.666916 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86191-5a29-40f0-9596-4f6df3138005 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:32.667184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86191-5a29-40f0-9596-4f6df3138005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:32.691758 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-82e86191-5a29-40f0-9596-4f6df3138005 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:32.692992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-82e86191-5a29-40f0-9596-4f6df3138005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:32.747936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6930a8-ceb9-4200-9849-85831ef31def None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:32.772097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 364/737] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 10:14:32.773011 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e86191-5a29-40f0-9596-4f6df3138005 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:32.785278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb028ac-c811-476d-bc06-ac2d600eb67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:32.785888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb028ac-c811-476d-bc06-ac2d600eb67a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:32.786169 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb028ac-c811-476d-bc06-ac2d600eb67a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:32.786441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb028ac-c811-476d-bc06-ac2d600eb67a None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:32.787201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb028ac-c811-476d-bc06-ac2d600eb67a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:32.787510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb028ac-c811-476d-bc06-ac2d600eb67a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:32.789014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb028ac-c811-476d-bc06-ac2d600eb67a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:32.796749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:32.802716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:32.803585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 374/738] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:32.809156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb028ac-c811-476d-bc06-ac2d600eb67a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:32.954611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e86191-5a29-40f0-9596-4f6df3138005 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:32.995910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb028ac-c811-476d-bc06-ac2d600eb67a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:33.015870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379ca3e-9af2-49a2-a980-f4d63b3b5a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:33.016668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379ca3e-9af2-49a2-a980-f4d63b3b5a15 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:33.017069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379ca3e-9af2-49a2-a980-f4d63b3b5a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:33.017964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379ca3e-9af2-49a2-a980-f4d63b3b5a15 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:33.028759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379ca3e-9af2-49a2-a980-f4d63b3b5a15 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:33.030305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379ca3e-9af2-49a2-a980-f4d63b3b5a15 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:33.032359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50537453-9b1b-4501-a77d-cb426b3383fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:33.033191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50537453-9b1b-4501-a77d-cb426b3383fb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:33.033677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50537453-9b1b-4501-a77d-cb426b3383fb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:33.034158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50537453-9b1b-4501-a77d-cb426b3383fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:33.042642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50537453-9b1b-4501-a77d-cb426b3383fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-a379ca3e-9af2-49a2-a980-f4d63b3b5a15 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:33.044009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:33.044920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:33.045843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:33.045843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:33.045843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:33.045843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:33.045843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:33.045843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:33.045843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:33.045843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:33.045843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 10:14:33.045843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:33.047208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50537453-9b1b-4501-a77d-cb426b3383fb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:33.050151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 365/739] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:14:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:33.051671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379ca3e-9af2-49a2-a980-f4d63b3b5a15 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-50537453-9b1b-4501-a77d-cb426b3383fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:33.060354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:33.061286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:33.062232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:33.062232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:33.062232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:33.062232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:33.062232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:33.062232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:33.062232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:33.062232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:33.062232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:14:33.062232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:33.064717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 375/740] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 10:14:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:33.065670 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50537453-9b1b-4501-a77d-cb426b3383fb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:33.127960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:33.130998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:33.162330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379ca3e-9af2-49a2-a980-f4d63b3b5a15 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:33.179103 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50537453-9b1b-4501-a77d-cb426b3383fb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:33.198051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6ffa7-9b76-4618-84a4-e1420f77cb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:33.198693 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ffa7-9b76-4618-84a4-e1420f77cb70 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:33.198973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ffa7-9b76-4618-84a4-e1420f77cb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:33.199247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ffa7-9b76-4618-84a4-e1420f77cb70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:33.209886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6ffa7-9b76-4618-84a4-e1420f77cb70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:33.214162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b5613-b988-4510-96a6-068582f716fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:33.215035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b5613-b988-4510-96a6-068582f716fa None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:33.215311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b5613-b988-4510-96a6-068582f716fa None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d4f6ffa7-9b76-4618-84a4-e1420f77cb70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:33.215471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:33.216413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:33.217260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:33.217260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:33.217260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:33.217260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:33.217260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:33.217260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:33.217260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:33.217260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:33.217260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:33.217260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:33.217260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:33.217260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:33.217897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b5613-b988-4510-96a6-068582f716fa None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:33.217897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b5613-b988-4510-96a6-068582f716fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:33.217897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b5613-b988-4510-96a6-068582f716fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:33.218093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b5613-b988-4510-96a6-068582f716fa None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:33.221483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 366/741] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:33.222330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6ffa7-9b76-4618-84a4-e1420f77cb70 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:33.240257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 376/742] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Oct 4 10:14:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:33.240257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b5613-b988-4510-96a6-068582f716fa None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:33.329310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6ffa7-9b76-4618-84a4-e1420f77cb70 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:33.339157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b5613-b988-4510-96a6-068582f716fa None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:33.357472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:33.361643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:33.367534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f3db7-4379-4a12-854e-3ce563456dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:33.369326 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f3db7-4379-4a12-854e-3ce563456dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:33.369326 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f3db7-4379-4a12-854e-3ce563456dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:33.369490 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f3db7-4379-4a12-854e-3ce563456dd1 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:33.370177 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f3db7-4379-4a12-854e-3ce563456dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:33.370485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f3db7-4379-4a12-854e-3ce563456dd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:33.371915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f3db7-4379-4a12-854e-3ce563456dd1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:33.378355 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e59a87-6979-4f24-bacc-aa273321dcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:33.378961 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e59a87-6979-4f24-bacc-aa273321dcb0 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:33.379233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e59a87-6979-4f24-bacc-aa273321dcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:33.379498 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e59a87-6979-4f24-bacc-aa273321dcb0 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:33.380177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e59a87-6979-4f24-bacc-aa273321dcb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:33.381626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e59a87-6979-4f24-bacc-aa273321dcb0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:33.389901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 367/743] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 10:14:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:33.390720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f3db7-4379-4a12-854e-3ce563456dd1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:33.443323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 377/744] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:14:33 2022] POST /identity/v3/services => generated 240 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:14:33.444118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e59a87-6979-4f24-bacc-aa273321dcb0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:33.502351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f3db7-4379-4a12-854e-3ce563456dd1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:33.549578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3ebc5-48f6-489f-bd34-131fbe2cc845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:33.550234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3ebc5-48f6-489f-bd34-131fbe2cc845 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:33.552201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3ebc5-48f6-489f-bd34-131fbe2cc845 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:33.552813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3ebc5-48f6-489f-bd34-131fbe2cc845 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:33.554128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3ebc5-48f6-489f-bd34-131fbe2cc845 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:33.555350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3ebc5-48f6-489f-bd34-131fbe2cc845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:33.557607 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3ebc5-48f6-489f-bd34-131fbe2cc845 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:33.571784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 368/745] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:33.573264 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3ebc5-48f6-489f-bd34-131fbe2cc845 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:33.601156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e59a87-6979-4f24-bacc-aa273321dcb0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:33.643573 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b08f4-3a15-4802-97e0-74b1dae7a5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:33.644047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:33.645177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b08f4-3a15-4802-97e0-74b1dae7a5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:33.645517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b08f4-3a15-4802-97e0-74b1dae7a5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:33.645857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b08f4-3a15-4802-97e0-74b1dae7a5c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:33.703784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:33.709703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3ebc5-48f6-489f-bd34-131fbe2cc845 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:33.736084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b08f4-3a15-4802-97e0-74b1dae7a5c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:33.738235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b08f4-3a15-4802-97e0-74b1dae7a5c6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:33.747556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f086710-98d3-476f-9c12-e82111685301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:33.748434 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f086710-98d3-476f-9c12-e82111685301 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:33.748787 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f086710-98d3-476f-9c12-e82111685301 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:33.749134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f086710-98d3-476f-9c12-e82111685301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:33.760739 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f086710-98d3-476f-9c12-e82111685301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:33.762271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f086710-98d3-476f-9c12-e82111685301 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-5f086710-98d3-476f-9c12-e82111685301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:33.782592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:33.783584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:33.784513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:33.784513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:33.784513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:33.788286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 369/746] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:33.789095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f086710-98d3-476f-9c12-e82111685301 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:33.861903 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 378/747] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:14:33.863097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b08f4-3a15-4802-97e0-74b1dae7a5c6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:33.918358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:33.923524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f086710-98d3-476f-9c12-e82111685301 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:33.963846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:33.964068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c39ac-f3ba-4018-95a7-de00f6a79df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:33.964748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c39ac-f3ba-4018-95a7-de00f6a79df6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:33.965032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c39ac-f3ba-4018-95a7-de00f6a79df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:33.965594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c39ac-f3ba-4018-95a7-de00f6a79df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:33.976870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c39ac-f3ba-4018-95a7-de00f6a79df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:33.978350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c39ac-f3ba-4018-95a7-de00f6a79df6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:33.992478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b08f4-3a15-4802-97e0-74b1dae7a5c6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-103c39ac-f3ba-4018-95a7-de00f6a79df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:33.993932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:33.994886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:33.996418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:33.996418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:33.996418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:33.996418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 370/748] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:33.996418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c39ac-f3ba-4018-95a7-de00f6a79df6 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:34.038877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898be1b9-eacd-44ff-9a3d-fd155d582317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:34.039865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898be1b9-eacd-44ff-9a3d-fd155d582317 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:34.040419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898be1b9-eacd-44ff-9a3d-fd155d582317 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:34.040905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898be1b9-eacd-44ff-9a3d-fd155d582317 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:34.041745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898be1b9-eacd-44ff-9a3d-fd155d582317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:34.042245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898be1b9-eacd-44ff-9a3d-fd155d582317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:34.043967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898be1b9-eacd-44ff-9a3d-fd155d582317 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:34.061891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 379/749] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:34.063099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898be1b9-eacd-44ff-9a3d-fd155d582317 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:34.114255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c39ac-f3ba-4018-95a7-de00f6a79df6 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:34.159663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb1743-7cff-4402-ad3b-0e23c000c732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:34.161659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb1743-7cff-4402-ad3b-0e23c000c732 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:34.162142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb1743-7cff-4402-ad3b-0e23c000c732 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:34.162638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb1743-7cff-4402-ad3b-0e23c000c732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:34.177449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb1743-7cff-4402-ad3b-0e23c000c732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:34.179710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb1743-7cff-4402-ad3b-0e23c000c732 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:34.190548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898be1b9-eacd-44ff-9a3d-fd155d582317 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-53fb1743-7cff-4402-ad3b-0e23c000c732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:34.199589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:34.200563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:34.201484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:34.201484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:34.201484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:34.204538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 371/750] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:34.205833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb1743-7cff-4402-ad3b-0e23c000c732 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:34.212808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:34.232204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880bbdc-ea3c-4cd3-b25a-e1d5470bfc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:34.232725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880bbdc-ea3c-4cd3-b25a-e1d5470bfc95 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:34.233002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880bbdc-ea3c-4cd3-b25a-e1d5470bfc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:34.233327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880bbdc-ea3c-4cd3-b25a-e1d5470bfc95 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:34.233902 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880bbdc-ea3c-4cd3-b25a-e1d5470bfc95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:34.234201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880bbdc-ea3c-4cd3-b25a-e1d5470bfc95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:34.235556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880bbdc-ea3c-4cd3-b25a-e1d5470bfc95 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:34.238172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:34.249954 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 380/751] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:34.254128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880bbdc-ea3c-4cd3-b25a-e1d5470bfc95 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:34.330517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb1743-7cff-4402-ad3b-0e23c000c732 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:34.366065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2fb77-57fc-4a9f-81c1-1b8ac7888cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:34.367037 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2fb77-57fc-4a9f-81c1-1b8ac7888cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:34.367541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2fb77-57fc-4a9f-81c1-1b8ac7888cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:34.368090 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2fb77-57fc-4a9f-81c1-1b8ac7888cd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:34.375850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2fb77-57fc-4a9f-81c1-1b8ac7888cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:34.377550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2fb77-57fc-4a9f-81c1-1b8ac7888cd3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:34.383156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880bbdc-ea3c-4cd3-b25a-e1d5470bfc95 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d6f2fb77-57fc-4a9f-81c1-1b8ac7888cd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:34.389620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:34.390552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:34.391449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:34.391449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:34.391449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:34.391449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:34.391449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:34.391449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:34.391449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:34.391449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:34.393808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 372/752] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:34.394810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2fb77-57fc-4a9f-81c1-1b8ac7888cd3 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:34.434511 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72341c4-f30f-4dce-a737-97e0f4168ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:34.435127 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72341c4-f30f-4dce-a737-97e0f4168ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:34.435405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72341c4-f30f-4dce-a737-97e0f4168ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:34.435677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72341c4-f30f-4dce-a737-97e0f4168ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:34.436617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72341c4-f30f-4dce-a737-97e0f4168ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:34.436926 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72341c4-f30f-4dce-a737-97e0f4168ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:34.439252 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72341c4-f30f-4dce-a737-97e0f4168ab2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:34.455413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 381/753] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:34.456410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72341c4-f30f-4dce-a737-97e0f4168ab2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:34.468236 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:34.507321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2fb77-57fc-4a9f-81c1-1b8ac7888cd3 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:34.533568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:34.546021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7498-065d-4a3a-b8ce-22dba490c685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:34.547091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7498-065d-4a3a-b8ce-22dba490c685 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:34.547587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7498-065d-4a3a-b8ce-22dba490c685 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:34.548205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7498-065d-4a3a-b8ce-22dba490c685 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:34.557976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b7498-065d-4a3a-b8ce-22dba490c685 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:34.560093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b7498-065d-4a3a-b8ce-22dba490c685 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-7c0b7498-065d-4a3a-b8ce-22dba490c685 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:34.575636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:34.576863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:34.577838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:34.577838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:34.577838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:34.577838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:34.577838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:34.577838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:34.577838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:34.577838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:34.577838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 10:14:34.577838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:34.580539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 373/754] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 10:14:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:34.581784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7498-065d-4a3a-b8ce-22dba490c685 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:34.589111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72341c4-f30f-4dce-a737-97e0f4168ab2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:34.632123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7ae5c-6f7c-4ec1-9c83-a6682f0581c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:34.632739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7ae5c-6f7c-4ec1-9c83-a6682f0581c6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:34.633018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7ae5c-6f7c-4ec1-9c83-a6682f0581c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:34.633292 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7ae5c-6f7c-4ec1-9c83-a6682f0581c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:34.634024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7ae5c-6f7c-4ec1-9c83-a6682f0581c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:34.634330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7ae5c-6f7c-4ec1-9c83-a6682f0581c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:34.635737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7ae5c-6f7c-4ec1-9c83-a6682f0581c6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:34.654638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 382/755] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:34.655770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7ae5c-6f7c-4ec1-9c83-a6682f0581c6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:34.697778 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7498-065d-4a3a-b8ce-22dba490c685 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:34.724059 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:34.735469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff42bef-0889-4876-b544-fb235859f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:34.738512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff42bef-0889-4876-b544-fb235859f5ec None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:34.738512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff42bef-0889-4876-b544-fb235859f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:34.738512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff42bef-0889-4876-b544-fb235859f5ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:34.745543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff42bef-0889-4876-b544-fb235859f5ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:34.747154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff42bef-0889-4876-b544-fb235859f5ec None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-2ff42bef-0889-4876-b544-fb235859f5ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:34.759442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:34.760538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:34.761528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:34.761528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:34.761528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:34.761528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:34.761528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:34.761528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:34.761528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:34.761528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:34.761528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 374/756] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:34.762014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff42bef-0889-4876-b544-fb235859f5ec None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:34.768891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7ae5c-6f7c-4ec1-9c83-a6682f0581c6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:34.787133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:34.807824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9ec68-b524-43fa-bd05-e3077fbffdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:34.808618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9ec68-b524-43fa-bd05-e3077fbffdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:34.808901 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9ec68-b524-43fa-bd05-e3077fbffdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:34.809537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9ec68-b524-43fa-bd05-e3077fbffdf1 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:34.810274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9ec68-b524-43fa-bd05-e3077fbffdf1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:34.810580 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9ec68-b524-43fa-bd05-e3077fbffdf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:34.812012 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9ec68-b524-43fa-bd05-e3077fbffdf1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:34.829660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 383/757] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Oct 4 10:14:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:34.830942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae4c2d-04a7-4bda-9bc6-550346802b44 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:34.831225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae4c2d-04a7-4bda-9bc6-550346802b44 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:34.831493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae4c2d-04a7-4bda-9bc6-550346802b44 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:34.832885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 384/758] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:34.833510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae4c2d-04a7-4bda-9bc6-550346802b44 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:34.876131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff42bef-0889-4876-b544-fb235859f5ec None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:34.915262 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9eab5-8181-4601-a96c-335c7e019bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:34.915942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9eab5-8181-4601-a96c-335c7e019bc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:34.916268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9eab5-8181-4601-a96c-335c7e019bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:34.916527 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9eab5-8181-4601-a96c-335c7e019bc8 None admin] PATH_INFO: `/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/567188b7c4fe40c1a1623d2f60092d26/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:34.918456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9eab5-8181-4601-a96c-335c7e019bc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c41ae2f9d03c48be8017a1ca480bf7db, user_id=567188b7c4fe40c1a1623d2f60092d26, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:34.919916 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9eab5-8181-4601-a96c-335c7e019bc8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:34.944851 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae4c2d-04a7-4bda-9bc6-550346802b44 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:34.978443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68b0c7-1da4-4ae8-83ea-da300cfe6ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:34.979063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68b0c7-1da4-4ae8-83ea-da300cfe6ffc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:34.979338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68b0c7-1da4-4ae8-83ea-da300cfe6ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:34.979611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68b0c7-1da4-4ae8-83ea-da300cfe6ffc None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:34.980326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68b0c7-1da4-4ae8-83ea-da300cfe6ffc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:34.980632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68b0c7-1da4-4ae8-83ea-da300cfe6ffc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:34.982039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68b0c7-1da4-4ae8-83ea-da300cfe6ffc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:34.991116 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 375/759] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:14:34 2022] PUT /identity/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/567188b7c4fe40c1a1623d2f60092d26/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:14:34.991936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9eab5-8181-4601-a96c-335c7e019bc8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:35.007648 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 385/760] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:35.009707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0bac0-868a-4e85-b825-4560ac21c375 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:35.010256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0bac0-868a-4e85-b825-4560ac21c375 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:35.010713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0bac0-868a-4e85-b825-4560ac21c375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:35.039187 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f2f0bac0-868a-4e85-b825-4560ac21c375 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:35.041350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f2f0bac0-868a-4e85-b825-4560ac21c375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:35.076218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:35.126169 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 386/761] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:35.127515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0bac0-868a-4e85-b825-4560ac21c375 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:35.219040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:35.249455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0bac0-868a-4e85-b825-4560ac21c375 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:35.291781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9eab5-8181-4601-a96c-335c7e019bc8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:35.303374 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632725fc-7910-440d-b2c9-cedd1b09c41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:35.304556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632725fc-7910-440d-b2c9-cedd1b09c41f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:35.305380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632725fc-7910-440d-b2c9-cedd1b09c41f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:35.305922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632725fc-7910-440d-b2c9-cedd1b09c41f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:35.307483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632725fc-7910-440d-b2c9-cedd1b09c41f None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=fe9c03800bc6451aa9e5a39ca4ea0bf7) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:35.308022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632725fc-7910-440d-b2c9-cedd1b09c41f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:35.310216 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632725fc-7910-440d-b2c9-cedd1b09c41f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:35.317835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 387/762] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:35 2022] GET /identity/v3/role_assignments?user.id=fe9c03800bc6451aa9e5a39ca4ea0bf7&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:35.350017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e629d-6c25-4017-a433-4e055e01dd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:35.351101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e629d-6c25-4017-a433-4e055e01dd9f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:35.351577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e629d-6c25-4017-a433-4e055e01dd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:35.352074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e629d-6c25-4017-a433-4e055e01dd9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:35.433503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e629d-6c25-4017-a433-4e055e01dd9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:35.435328 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e629d-6c25-4017-a433-4e055e01dd9f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:35.456220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632725fc-7910-440d-b2c9-cedd1b09c41f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:35.512598 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:35.520233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:35.592135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 376/763] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:14:35.601283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e629d-6c25-4017-a433-4e055e01dd9f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:35.603654 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632725fc-7910-440d-b2c9-cedd1b09c41f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:35.649137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052544e1-c955-45c6-9b29-e16e4921d671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:35.650292 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052544e1-c955-45c6-9b29-e16e4921d671 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:35.657993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052544e1-c955-45c6-9b29-e16e4921d671 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:35.657993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052544e1-c955-45c6-9b29-e16e4921d671 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:35.657993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052544e1-c955-45c6-9b29-e16e4921d671 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:35.657993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052544e1-c955-45c6-9b29-e16e4921d671 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-052544e1-c955-45c6-9b29-e16e4921d671 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:35.668538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:35.669555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:35.670408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 388/764] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Oct 4 10:14:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:35.681113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052544e1-c955-45c6-9b29-e16e4921d671 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:35.798651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052544e1-c955-45c6-9b29-e16e4921d671 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:35.809920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:35.834131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e629d-6c25-4017-a433-4e055e01dd9f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:35.837965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93cc00-91a7-4c4f-8526-bd582ecb2ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:35.838856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93cc00-91a7-4c4f-8526-bd582ecb2ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:35.839333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93cc00-91a7-4c4f-8526-bd582ecb2ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:35.840112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93cc00-91a7-4c4f-8526-bd582ecb2ee6 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:35.842010 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93cc00-91a7-4c4f-8526-bd582ecb2ee6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:35.842584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93cc00-91a7-4c4f-8526-bd582ecb2ee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:35.844541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93cc00-91a7-4c4f-8526-bd582ecb2ee6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:35.856114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 389/765] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Oct 4 10:14:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:35.856114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a6a24-cfcd-4efa-832c-3b7e38073830 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:35.856114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a6a24-cfcd-4efa-832c-3b7e38073830 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:35.856114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a6a24-cfcd-4efa-832c-3b7e38073830 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:35.859198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 390/766] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:35.859924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a6a24-cfcd-4efa-832c-3b7e38073830 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:35.885467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a742ac-f8a0-4f4e-b65c-55a5fa42cc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:35.886226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a742ac-f8a0-4f4e-b65c-55a5fa42cc85 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:35.887014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a742ac-f8a0-4f4e-b65c-55a5fa42cc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:35.887295 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a742ac-f8a0-4f4e-b65c-55a5fa42cc85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:35.900877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a742ac-f8a0-4f4e-b65c-55a5fa42cc85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:35.903459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a742ac-f8a0-4f4e-b65c-55a5fa42cc85 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:35.906583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-58a742ac-f8a0-4f4e-b65c-55a5fa42cc85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:35.931715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:35.932950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:35.933921 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:35.933921 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:35.933921 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:35.936020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 377/767] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:35.937490 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3de8b7-a85c-4a26-b8e8-15cdbc7f4a78 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:35.938135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3de8b7-a85c-4a26-b8e8-15cdbc7f4a78 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:35.939819 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3de8b7-a85c-4a26-b8e8-15cdbc7f4a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:35.959995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5a3de8b7-a85c-4a26-b8e8-15cdbc7f4a78 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:35.961954 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5a3de8b7-a85c-4a26-b8e8-15cdbc7f4a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:35.996932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a6a24-cfcd-4efa-832c-3b7e38073830 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:36.031656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 378/768] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:36.032562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3de8b7-a85c-4a26-b8e8-15cdbc7f4a78 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:36.036471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199f9d5-f149-4848-bbf5-17d63d53a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:36.037350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199f9d5-f149-4848-bbf5-17d63d53a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:36.037891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199f9d5-f149-4848-bbf5-17d63d53a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:36.038360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199f9d5-f149-4848-bbf5-17d63d53a2f0 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:36.039254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199f9d5-f149-4848-bbf5-17d63d53a2f0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:36.039753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199f9d5-f149-4848-bbf5-17d63d53a2f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:36.041913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199f9d5-f149-4848-bbf5-17d63d53a2f0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:36.047939 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 391/769] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Oct 4 10:14:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:36.058255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199f9d5-f149-4848-bbf5-17d63d53a2f0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:36.106277 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:36.213149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3de8b7-a85c-4a26-b8e8-15cdbc7f4a78 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:36.226972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199f9d5-f149-4848-bbf5-17d63d53a2f0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:36.265883 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf7ae1-87e3-480f-bdca-d8416b913e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:36.266508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf7ae1-87e3-480f-bdca-d8416b913e2d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:36.266797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:36.267156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf7ae1-87e3-480f-bdca-d8416b913e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:36.267232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf7ae1-87e3-480f-bdca-d8416b913e2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:36.268209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf7ae1-87e3-480f-bdca-d8416b913e2d None admin] RBAC: Adding query filter params (interface=public, service_id=bdb9467a604243f78cf986b6d3b41e5c, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:36.268601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf7ae1-87e3-480f-bdca-d8416b913e2d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:36.270048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf7ae1-87e3-480f-bdca-d8416b913e2d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:36.290350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fe6b9-2b68-4ca5-a64f-d5b534a1dfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:36.290955 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fe6b9-2b68-4ca5-a64f-d5b534a1dfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:36.291229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fe6b9-2b68-4ca5-a64f-d5b534a1dfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:36.295858 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 392/770] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 10:14:36 2022] GET /identity/v3/endpoints?service_id=bdb9467a604243f78cf986b6d3b41e5c&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:36.295995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fe6b9-2b68-4ca5-a64f-d5b534a1dfc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:36.296607 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fe6b9-2b68-4ca5-a64f-d5b534a1dfc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:36.296919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fe6b9-2b68-4ca5-a64f-d5b534a1dfc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:36.298283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fe6b9-2b68-4ca5-a64f-d5b534a1dfc8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:36.300600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf7ae1-87e3-480f-bdca-d8416b913e2d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:36.321985 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 379/771] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:36.328105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fe6b9-2b68-4ca5-a64f-d5b534a1dfc8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:36.493802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fe6b9-2b68-4ca5-a64f-d5b534a1dfc8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:36.531041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f705c5-4890-42b4-a587-28376307be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:36.531624 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:36.532554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f705c5-4890-42b4-a587-28376307be2e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:36.533042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f705c5-4890-42b4-a587-28376307be2e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:36.533486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f705c5-4890-42b4-a587-28376307be2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:36.541664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f705c5-4890-42b4-a587-28376307be2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:36.545766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f705c5-4890-42b4-a587-28376307be2e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:36.554815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf7ae1-87e3-480f-bdca-d8416b913e2d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-13f705c5-4890-42b4-a587-28376307be2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:36.559660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:36.560629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:36.561537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:36.561537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:36.561537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:36.561537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:36.561537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:36.561537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:36.561537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:36.561537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:36.569048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 380/772] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:36.569048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f705c5-4890-42b4-a587-28376307be2e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:36.597721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9920fa-83dc-4f67-8831-b9a1584bda5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:36.598323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9920fa-83dc-4f67-8831-b9a1584bda5c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:36.598593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9920fa-83dc-4f67-8831-b9a1584bda5c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:36.598861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9920fa-83dc-4f67-8831-b9a1584bda5c None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:36.599725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9920fa-83dc-4f67-8831-b9a1584bda5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:36.601432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9920fa-83dc-4f67-8831-b9a1584bda5c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:36.616049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 393/773] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 10:14:36 2022] GET /identity/v3/services => generated 772 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:36.617087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9920fa-83dc-4f67-8831-b9a1584bda5c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:36.632446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:36.699515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f705c5-4890-42b4-a587-28376307be2e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:36.742106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a688540-5bbd-4c5e-bf1f-99ac5711b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:36.743352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a688540-5bbd-4c5e-bf1f-99ac5711b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:36.743895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a688540-5bbd-4c5e-bf1f-99ac5711b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:36.744416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a688540-5bbd-4c5e-bf1f-99ac5711b0c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:36.745213 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a688540-5bbd-4c5e-bf1f-99ac5711b0c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:36.746827 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a688540-5bbd-4c5e-bf1f-99ac5711b0c5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-9a688540-5bbd-4c5e-bf1f-99ac5711b0c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:36.758469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:36.760096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 10:14:36.760970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:36.763688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 381/774] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:36 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:36.771470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a688540-5bbd-4c5e-bf1f-99ac5711b0c5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:36.836773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9920fa-83dc-4f67-8831-b9a1584bda5c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:36.902405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca9d10-34e0-449c-b2fe-a289934fc17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:36.903119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9d10-34e0-449c-b2fe-a289934fc17e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:36.903396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9d10-34e0-449c-b2fe-a289934fc17e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:36.903661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9d10-34e0-449c-b2fe-a289934fc17e None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:36.904379 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca9d10-34e0-449c-b2fe-a289934fc17e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:36.904679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca9d10-34e0-449c-b2fe-a289934fc17e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:36.906079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca9d10-34e0-449c-b2fe-a289934fc17e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:36.927994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 394/775] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:36.934119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca9d10-34e0-449c-b2fe-a289934fc17e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:36.942271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a688540-5bbd-4c5e-bf1f-99ac5711b0c5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:36.945118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:36.956854 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:36.987303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d3c87-704b-4e90-867b-2b656dd56820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:36.988477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d3c87-704b-4e90-867b-2b656dd56820 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:36.988958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d3c87-704b-4e90-867b-2b656dd56820 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:36.989410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d3c87-704b-4e90-867b-2b656dd56820 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:36.990221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d3c87-704b-4e90-867b-2b656dd56820 None admin] RBAC: Adding query filter params (name=network) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:36.991118 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d3c87-704b-4e90-867b-2b656dd56820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:36.992946 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d3c87-704b-4e90-867b-2b656dd56820 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:37.000227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 382/776] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:14:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:37.005431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d3c87-704b-4e90-867b-2b656dd56820 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:37.057841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca9d10-34e0-449c-b2fe-a289934fc17e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:37.105284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3b90e-b33f-4e9b-a886-5affffd905ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:37.105284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3b90e-b33f-4e9b-a886-5affffd905ab None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:37.105556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3b90e-b33f-4e9b-a886-5affffd905ab None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:37.105852 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3b90e-b33f-4e9b-a886-5affffd905ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:37.106497 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3b90e-b33f-4e9b-a886-5affffd905ab None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=347ab0ce405c4deba9295d5395cb1d6e) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:37.106796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3b90e-b33f-4e9b-a886-5affffd905ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:37.108241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3b90e-b33f-4e9b-a886-5affffd905ab None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:37.128300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 395/777] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:36 2022] GET /identity/v3/role_assignments?user.id=347ab0ce405c4deba9295d5395cb1d6e&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:37.165061 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d3c87-704b-4e90-867b-2b656dd56820 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:37.223447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6a1e2-5fe3-43bb-bf74-09f109c54197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:37.224113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6a1e2-5fe3-43bb-bf74-09f109c54197 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:37.224390 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6a1e2-5fe3-43bb-bf74-09f109c54197 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:37.224665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6a1e2-5fe3-43bb-bf74-09f109c54197 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:37.225317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6a1e2-5fe3-43bb-bf74-09f109c54197 None admin] RBAC: Adding query filter params (type=network) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:37.225623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6a1e2-5fe3-43bb-bf74-09f109c54197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:37.227029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6a1e2-5fe3-43bb-bf74-09f109c54197 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:37.236804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 383/778] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:14:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:37.242592 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3b90e-b33f-4e9b-a886-5affffd905ab None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:37.337849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:37.389924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3b90e-b33f-4e9b-a886-5affffd905ab None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:37.429988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c64c78-3f7a-4d49-8064-100e11c179a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:37.431197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c64c78-3f7a-4d49-8064-100e11c179a9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:37.431482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c64c78-3f7a-4d49-8064-100e11c179a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:37.431750 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c64c78-3f7a-4d49-8064-100e11c179a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:37.432493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c64c78-3f7a-4d49-8064-100e11c179a9 None admin] RBAC: Adding query filter params (interface=public, service_id=cc4eb595b08341cf86a0ff166c9849d6, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:37.432800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c64c78-3f7a-4d49-8064-100e11c179a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:37.434177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c64c78-3f7a-4d49-8064-100e11c179a9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:37.440464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 396/779] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 10:14:37 2022] GET /identity/v3/endpoints?service_id=cc4eb595b08341cf86a0ff166c9849d6&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:37.446344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6a1e2-5fe3-43bb-bf74-09f109c54197 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:37.497329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:37.504665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406abd-dc51-4d21-a563-70e0b23f2b54 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:37.504956 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406abd-dc51-4d21-a563-70e0b23f2b54 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:37.505232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406abd-dc51-4d21-a563-70e0b23f2b54 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:37.506720 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 397/780] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:14:37.513592 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d954fb2-2c1b-4580-91af-0e443541bc2c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:37.513871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d954fb2-2c1b-4580-91af-0e443541bc2c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:37.514148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d954fb2-2c1b-4580-91af-0e443541bc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:37.535394 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1d954fb2-2c1b-4580-91af-0e443541bc2c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:37.537784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1d954fb2-2c1b-4580-91af-0e443541bc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:37.588454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6a1e2-5fe3-43bb-bf74-09f109c54197 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:37.664211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 398/781] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:14:37.669752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb72df-ff4d-4a8c-b884-5ba3addd409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:37.670386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb72df-ff4d-4a8c-b884-5ba3addd409d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:37.670661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb72df-ff4d-4a8c-b884-5ba3addd409d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:37.670929 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb72df-ff4d-4a8c-b884-5ba3addd409d None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:37.671546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb72df-ff4d-4a8c-b884-5ba3addd409d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:37.672971 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb72df-ff4d-4a8c-b884-5ba3addd409d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:37.680124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 384/782] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 10:14:37 2022] GET /identity/v3/services => generated 772 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:37.763768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4ba17-520f-4f0c-8216-5a04e210fcdf None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:37.764128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4ba17-520f-4f0c-8216-5a04e210fcdf None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:37.764349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4ba17-520f-4f0c-8216-5a04e210fcdf None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:37.766021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 399/783] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:37.771877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30443d-5e26-4434-beef-c5d21e12106f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:37.772533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30443d-5e26-4434-beef-c5d21e12106f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:37.773019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30443d-5e26-4434-beef-c5d21e12106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:37.801335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-be30443d-5e26-4434-beef-c5d21e12106f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:37.802947 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-be30443d-5e26-4434-beef-c5d21e12106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:37.895973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 385/784] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:38.008336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4ba17-520f-4f0c-8216-5a04e210fcdf None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:38.095102 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:38.148709 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4ba17-520f-4f0c-8216-5a04e210fcdf None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:38.191750 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76ed41-f878-4a1e-9248-b93d89abf083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:38.192396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76ed41-f878-4a1e-9248-b93d89abf083 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:38.192667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76ed41-f878-4a1e-9248-b93d89abf083 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:38.192931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76ed41-f878-4a1e-9248-b93d89abf083 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:38.208695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76ed41-f878-4a1e-9248-b93d89abf083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5e76ed41-f878-4a1e-9248-b93d89abf083 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:38.213678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:38.214617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:38.215741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 400/785] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:38.221093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30443d-5e26-4434-beef-c5d21e12106f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:38.234468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76ed41-f878-4a1e-9248-b93d89abf083 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:38.275208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:38.404416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76ed41-f878-4a1e-9248-b93d89abf083 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:38.418772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30443d-5e26-4434-beef-c5d21e12106f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:38.464373 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:38.480891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf68349-ea37-431f-8d09-e2015a6db390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:38.482245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68349-ea37-431f-8d09-e2015a6db390 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:38.483169 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68349-ea37-431f-8d09-e2015a6db390 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:38.484108 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68349-ea37-431f-8d09-e2015a6db390 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:38.487707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97eb5d-3ab4-449c-98d0-041611d84d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:38.488896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97eb5d-3ab4-449c-98d0-041611d84d58 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:38.490062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97eb5d-3ab4-449c-98d0-041611d84d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:38.490572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97eb5d-3ab4-449c-98d0-041611d84d58 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:38.493977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97eb5d-3ab4-449c-98d0-041611d84d58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:38.494477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97eb5d-3ab4-449c-98d0-041611d84d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:38.496059 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97eb5d-3ab4-449c-98d0-041611d84d58 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:38.508135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf68349-ea37-431f-8d09-e2015a6db390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:38.516287 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 386/786] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:14:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-daf68349-ea37-431f-8d09-e2015a6db390 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:38.517587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:38.520893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:38.521728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 401/787] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:38.522426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97eb5d-3ab4-449c-98d0-041611d84d58 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:38.525281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf68349-ea37-431f-8d09-e2015a6db390 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:38.675222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf68349-ea37-431f-8d09-e2015a6db390 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:38.685561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:38.693183 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97eb5d-3ab4-449c-98d0-041611d84d58 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:38.731062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f31c0-be8f-45b0-8ed4-270931542e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:38.732257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f31c0-be8f-45b0-8ed4-270931542e9c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:38.732749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f31c0-be8f-45b0-8ed4-270931542e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:38.733303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f31c0-be8f-45b0-8ed4-270931542e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:38.739772 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd22e40-3d99-4a28-b288-3f33eaa149d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:38.740750 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd22e40-3d99-4a28-b288-3f33eaa149d8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:38.740750 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd22e40-3d99-4a28-b288-3f33eaa149d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:38.740945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd22e40-3d99-4a28-b288-3f33eaa149d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:38.741568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd22e40-3d99-4a28-b288-3f33eaa149d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:38.741865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd22e40-3d99-4a28-b288-3f33eaa149d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:38.743752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd22e40-3d99-4a28-b288-3f33eaa149d8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:38.745842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f31c0-be8f-45b0-8ed4-270931542e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:38.747484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f31c0-be8f-45b0-8ed4-270931542e9c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-701f31c0-be8f-45b0-8ed4-270931542e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:38.764187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:38.765203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:38.766119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:38.766119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:38.766119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:38.768303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 387/788] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:38.770817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 402/789] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:14:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:38.776913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f31c0-be8f-45b0-8ed4-270931542e9c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:38.778480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd22e40-3d99-4a28-b288-3f33eaa149d8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:38.889736 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f31c0-be8f-45b0-8ed4-270931542e9c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:38.926644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18ed00-e964-4af6-bf70-6f98c46df0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:38.927594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18ed00-e964-4af6-bf70-6f98c46df0ff None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:38.928567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18ed00-e964-4af6-bf70-6f98c46df0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:38.929074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18ed00-e964-4af6-bf70-6f98c46df0ff None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:38.929919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18ed00-e964-4af6-bf70-6f98c46df0ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:38.930422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18ed00-e964-4af6-bf70-6f98c46df0ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:38.932134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18ed00-e964-4af6-bf70-6f98c46df0ff None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:38.945702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 388/790] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:38.951497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18ed00-e964-4af6-bf70-6f98c46df0ff None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:38.963315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:38.964266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:39.037404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd22e40-3d99-4a28-b288-3f33eaa149d8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:39.076517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c36e5-c1ed-4bff-a3c5-3029f003705b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:39.077318 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c36e5-c1ed-4bff-a3c5-3029f003705b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:39.077604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c36e5-c1ed-4bff-a3c5-3029f003705b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:39.078174 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c36e5-c1ed-4bff-a3c5-3029f003705b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:39.090484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c36e5-c1ed-4bff-a3c5-3029f003705b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:39.091914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c36e5-c1ed-4bff-a3c5-3029f003705b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-af6c36e5-c1ed-4bff-a3c5-3029f003705b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:39.108227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:39.109214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:39.110124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:39.110124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:39.110124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:39.110124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 403/791] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:39.115395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c36e5-c1ed-4bff-a3c5-3029f003705b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:39.227090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:39.228205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18ed00-e964-4af6-bf70-6f98c46df0ff None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:39.230845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c36e5-c1ed-4bff-a3c5-3029f003705b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:39.269375 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b19dcf-9964-49dc-ac6c-b830a1a7ee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:39.270290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19dcf-9964-49dc-ac6c-b830a1a7ee54 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:39.270577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19dcf-9964-49dc-ac6c-b830a1a7ee54 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:39.270912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19dcf-9964-49dc-ac6c-b830a1a7ee54 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:39.271567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b19dcf-9964-49dc-ac6c-b830a1a7ee54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:39.271875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b19dcf-9964-49dc-ac6c-b830a1a7ee54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:39.273347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b19dcf-9964-49dc-ac6c-b830a1a7ee54 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:39.287022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 404/792] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:39.293139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b19dcf-9964-49dc-ac6c-b830a1a7ee54 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:39.344654 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc0572-3c3f-4375-aa39-3c3e4817955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:39.345293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc0572-3c3f-4375-aa39-3c3e4817955e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:39.345562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc0572-3c3f-4375-aa39-3c3e4817955e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:39.345839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc0572-3c3f-4375-aa39-3c3e4817955e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:39.372723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc0572-3c3f-4375-aa39-3c3e4817955e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:39.374162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc0572-3c3f-4375-aa39-3c3e4817955e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-37bc0572-3c3f-4375-aa39-3c3e4817955e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:39.397022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:39.398018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:39.398957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:39.398957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:39.398957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:39.398957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:39.398957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:39.398957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:39.398957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:39.398957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:39.398957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:14:39.398957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:39.406984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 389/793] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 10:14:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:39.408133 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc0572-3c3f-4375-aa39-3c3e4817955e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:39.427638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b19dcf-9964-49dc-ac6c-b830a1a7ee54 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:39.488465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6bb80-1c98-47d0-b1fb-c858a564c024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:39.489031 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bb80-1c98-47d0-b1fb-c858a564c024 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:39.489307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bb80-1c98-47d0-b1fb-c858a564c024 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:39.489575 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bb80-1c98-47d0-b1fb-c858a564c024 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:39.502575 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6bb80-1c98-47d0-b1fb-c858a564c024 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:39.504172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6bb80-1c98-47d0-b1fb-c858a564c024 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:39.527197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-44d6bb80-1c98-47d0-b1fb-c858a564c024 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:39.532121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:39.533126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:39.534099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:39.534099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:39.534099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:39.534099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:39.534099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:39.534099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:39.534099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:39.534099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:39.534099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 10:14:39.534099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:39.534099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 405/794] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:14:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:39.544929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6bb80-1c98-47d0-b1fb-c858a564c024 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:39.587157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:39.591558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc0572-3c3f-4375-aa39-3c3e4817955e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:39.641342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc2819-31e2-4ea8-8a17-d9e700cc6589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:39.642213 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc2819-31e2-4ea8-8a17-d9e700cc6589 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:39.642495 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc2819-31e2-4ea8-8a17-d9e700cc6589 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:39.642766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc2819-31e2-4ea8-8a17-d9e700cc6589 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:39.643488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc2819-31e2-4ea8-8a17-d9e700cc6589 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:39.643791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc2819-31e2-4ea8-8a17-d9e700cc6589 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:39.645883 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc2819-31e2-4ea8-8a17-d9e700cc6589 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:39.672048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 390/795] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 10:14:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:39.674526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01605967-067b-44d1-ae12-2155e7b0e05b None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:39.674806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01605967-067b-44d1-ae12-2155e7b0e05b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:39.675070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01605967-067b-44d1-ae12-2155e7b0e05b None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:39.676676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 391/796] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:39.677389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01605967-067b-44d1-ae12-2155e7b0e05b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:39.696009 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6bb80-1c98-47d0-b1fb-c858a564c024 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:39.731932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096820e-37c7-48a1-a6da-a28c11b3fa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:39.732664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096820e-37c7-48a1-a6da-a28c11b3fa22 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:39.732937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096820e-37c7-48a1-a6da-a28c11b3fa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:39.733218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096820e-37c7-48a1-a6da-a28c11b3fa22 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:39.733925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096820e-37c7-48a1-a6da-a28c11b3fa22 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:39.734229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096820e-37c7-48a1-a6da-a28c11b3fa22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:39.735735 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096820e-37c7-48a1-a6da-a28c11b3fa22 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:39.754077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 406/797] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Oct 4 10:14:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:39.759809 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565d490-9d4e-4856-a75c-1f102679a276 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:39.760119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565d490-9d4e-4856-a75c-1f102679a276 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:39.760389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565d490-9d4e-4856-a75c-1f102679a276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:39.779126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5565d490-9d4e-4856-a75c-1f102679a276 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:39.780341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5565d490-9d4e-4856-a75c-1f102679a276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:39.789062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01605967-067b-44d1-ae12-2155e7b0e05b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:39.813381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:39.824482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac491d19-4a27-40d7-8e9a-e1236b413d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:39.825300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac491d19-4a27-40d7-8e9a-e1236b413d74 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:39.826660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac491d19-4a27-40d7-8e9a-e1236b413d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:39.826660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac491d19-4a27-40d7-8e9a-e1236b413d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:39.853898 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 407/798] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:39.862819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b81d0-d873-4b46-94bb-50252edda684 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:39.863209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b81d0-d873-4b46-94bb-50252edda684 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:39.863521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b81d0-d873-4b46-94bb-50252edda684 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:39.869008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 408/799] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:39.869008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b81d0-d873-4b46-94bb-50252edda684 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:39.881549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:39.900268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac491d19-4a27-40d7-8e9a-e1236b413d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:39.902084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac491d19-4a27-40d7-8e9a-e1236b413d74 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:39.997871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b81d0-d873-4b46-94bb-50252edda684 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:40.023922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 392/800] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:14:40.026585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d042f-f568-4a27-ac93-7f8c0440ce0f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.027020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d042f-f568-4a27-ac93-7f8c0440ce0f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.027521 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d042f-f568-4a27-ac93-7f8c0440ce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.035754 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02659d6b-1687-46ec-8287-d0859445aef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:40.037315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02659d6b-1687-46ec-8287-d0859445aef9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.037591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02659d6b-1687-46ec-8287-d0859445aef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.037862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02659d6b-1687-46ec-8287-d0859445aef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.049201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02659d6b-1687-46ec-8287-d0859445aef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:40.049485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-794d042f-f568-4a27-ac93-7f8c0440ce0f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:40.050614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02659d6b-1687-46ec-8287-d0859445aef9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:40.050878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-794d042f-f568-4a27-ac93-7f8c0440ce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-02659d6b-1687-46ec-8287-d0859445aef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:40.066838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:40.068178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:40.069183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:40.069183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:40.069183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:40.069183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 409/801] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:40.069878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02659d6b-1687-46ec-8287-d0859445aef9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:40.079810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:40.148912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:40.156074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 393/802] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:40.157299 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d042f-f568-4a27-ac93-7f8c0440ce0f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:40.201618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02659d6b-1687-46ec-8287-d0859445aef9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:40.242422 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644d94c-a851-4759-82de-b910b13a2936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:40.243568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644d94c-a851-4759-82de-b910b13a2936 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.244052 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644d94c-a851-4759-82de-b910b13a2936 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.244557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644d94c-a851-4759-82de-b910b13a2936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.256087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644d94c-a851-4759-82de-b910b13a2936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:40.257549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644d94c-a851-4759-82de-b910b13a2936 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:40.263940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d042f-f568-4a27-ac93-7f8c0440ce0f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9644d94c-a851-4759-82de-b910b13a2936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:40.272401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:40.273313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:40.274829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:40.274829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:40.274829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:40.274829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 410/803] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:40.275839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644d94c-a851-4759-82de-b910b13a2936 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:40.304255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295c159-7da2-4ca5-8c91-5c9badf4393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:40.304856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295c159-7da2-4ca5-8c91-5c9badf4393b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.305133 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295c159-7da2-4ca5-8c91-5c9badf4393b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.306146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295c159-7da2-4ca5-8c91-5c9badf4393b None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.306567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295c159-7da2-4ca5-8c91-5c9badf4393b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:40.306870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295c159-7da2-4ca5-8c91-5c9badf4393b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:40.308242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295c159-7da2-4ca5-8c91-5c9badf4393b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:40.320028 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 394/804] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:40.324713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b94da-f29d-4e22-9f17-ffaa40cfc71d None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.324713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b94da-f29d-4e22-9f17-ffaa40cfc71d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.324713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b94da-f29d-4e22-9f17-ffaa40cfc71d None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.324713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 395/805] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:40.324713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b94da-f29d-4e22-9f17-ffaa40cfc71d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:40.341245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:40.384604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644d94c-a851-4759-82de-b910b13a2936 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:40.398274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:40.419214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b41698-8b3e-4654-9daa-52dec08358dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:40.419847 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b41698-8b3e-4654-9daa-52dec08358dd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.420167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b41698-8b3e-4654-9daa-52dec08358dd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.420445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b41698-8b3e-4654-9daa-52dec08358dd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.421026 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b41698-8b3e-4654-9daa-52dec08358dd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:40.422379 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b41698-8b3e-4654-9daa-52dec08358dd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:40.431275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b94da-f29d-4e22-9f17-ffaa40cfc71d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-95b41698-8b3e-4654-9daa-52dec08358dd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:40.432629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:40.434013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:40.434922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 411/806] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Oct 4 10:14:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:40.435884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b41698-8b3e-4654-9daa-52dec08358dd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:40.470850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730ff88-8de9-4c35-8a7b-429982f6bf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:40.471444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730ff88-8de9-4c35-8a7b-429982f6bf50 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.471715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730ff88-8de9-4c35-8a7b-429982f6bf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.472003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730ff88-8de9-4c35-8a7b-429982f6bf50 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.472634 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730ff88-8de9-4c35-8a7b-429982f6bf50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:40.472927 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730ff88-8de9-4c35-8a7b-429982f6bf50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:40.474265 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730ff88-8de9-4c35-8a7b-429982f6bf50 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:40.486038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 396/807] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:40.487188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec96017-2d80-4dcc-b25b-3d0c00743362 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.487466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec96017-2d80-4dcc-b25b-3d0c00743362 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.487732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec96017-2d80-4dcc-b25b-3d0c00743362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.505688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-dec96017-2d80-4dcc-b25b-3d0c00743362 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:40.506868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dec96017-2d80-4dcc-b25b-3d0c00743362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:40.537349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b41698-8b3e-4654-9daa-52dec08358dd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:40.572561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb80d8-6616-4d25-afb6-42648a131feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:40.573015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 397/808] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:40.573469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb80d8-6616-4d25-afb6-42648a131feb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.573469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb80d8-6616-4d25-afb6-42648a131feb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.573736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb80d8-6616-4d25-afb6-42648a131feb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.573833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec96017-2d80-4dcc-b25b-3d0c00743362 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:40.577277 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:40.580395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb80d8-6616-4d25-afb6-42648a131feb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:40.581816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb80d8-6616-4d25-afb6-42648a131feb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-25eb80d8-6616-4d25-afb6-42648a131feb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:40.593132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:40.594018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:40.594920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:40.594920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:40.594920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:40.594920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:40.594920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:40.594920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:40.594920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:40.594920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:40.596282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 412/809] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:40.597289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb80d8-6616-4d25-afb6-42648a131feb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:40.636986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:40.681536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec96017-2d80-4dcc-b25b-3d0c00743362 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:40.706249 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb80d8-6616-4d25-afb6-42648a131feb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:40.715882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45b2b8-ae7f-406d-9bc9-d8194d3b6407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:40.716552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45b2b8-ae7f-406d-9bc9-d8194d3b6407 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.716827 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45b2b8-ae7f-406d-9bc9-d8194d3b6407 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.717092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45b2b8-ae7f-406d-9bc9-d8194d3b6407 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.727163 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45b2b8-ae7f-406d-9bc9-d8194d3b6407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-0e45b2b8-ae7f-406d-9bc9-d8194d3b6407 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:40.732017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:40.733140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:40.734188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 398/810] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:40.734995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45b2b8-ae7f-406d-9bc9-d8194d3b6407 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:40.747650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d3ef9-4a3d-4340-a3cd-5a3061d380e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:40.748697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d3ef9-4a3d-4340-a3cd-5a3061d380e0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.749090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d3ef9-4a3d-4340-a3cd-5a3061d380e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.749464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d3ef9-4a3d-4340-a3cd-5a3061d380e0 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.750190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d3ef9-4a3d-4340-a3cd-5a3061d380e0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:40.750593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d3ef9-4a3d-4340-a3cd-5a3061d380e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:40.752065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d3ef9-4a3d-4340-a3cd-5a3061d380e0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:40.757778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 413/811] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Oct 4 10:14:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:40.758782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d3ef9-4a3d-4340-a3cd-5a3061d380e0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:40.801708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:40.839602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45b2b8-ae7f-406d-9bc9-d8194d3b6407 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:40.862389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:40.865313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d3ef9-4a3d-4340-a3cd-5a3061d380e0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:40.874149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40451be-9e00-4ba4-b9dd-ef85cf10208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:40.874777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40451be-9e00-4ba4-b9dd-ef85cf10208c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.875049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40451be-9e00-4ba4-b9dd-ef85cf10208c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.875317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40451be-9e00-4ba4-b9dd-ef85cf10208c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.881734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40451be-9e00-4ba4-b9dd-ef85cf10208c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:40.883150 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40451be-9e00-4ba4-b9dd-ef85cf10208c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d40451be-9e00-4ba4-b9dd-ef85cf10208c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:40.894622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:40.895658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:40.896783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:40.896783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:40.896783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:40.896783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:40.896783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:40.896783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:40.896783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:40.896783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:40.896783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 399/812] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:40.897368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40451be-9e00-4ba4-b9dd-ef85cf10208c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:40.902447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aa557-3aa8-4129-b439-cfc76751aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:40.903048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aa557-3aa8-4129-b439-cfc76751aa21 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:40.903325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aa557-3aa8-4129-b439-cfc76751aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:40.903593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aa557-3aa8-4129-b439-cfc76751aa21 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:40.904307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61aa557-3aa8-4129-b439-cfc76751aa21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:40.904611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61aa557-3aa8-4129-b439-cfc76751aa21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:40.906010 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61aa557-3aa8-4129-b439-cfc76751aa21 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:40.917991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 414/813] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:40.918834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aa557-3aa8-4129-b439-cfc76751aa21 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:41.002037 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40451be-9e00-4ba4-b9dd-ef85cf10208c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:41.017357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aa557-3aa8-4129-b439-cfc76751aa21 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:41.024052 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:41.035040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbb91d-0ff6-4480-9edb-db4dfe1b85ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:41.035642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbb91d-0ff6-4480-9edb-db4dfe1b85ce None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:41.035966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbb91d-0ff6-4480-9edb-db4dfe1b85ce None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:41.036236 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbb91d-0ff6-4480-9edb-db4dfe1b85ce None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:41.042794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbb91d-0ff6-4480-9edb-db4dfe1b85ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:41.042794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbb91d-0ff6-4480-9edb-db4dfe1b85ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:41.042794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbb91d-0ff6-4480-9edb-db4dfe1b85ce None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:41.046692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 400/814] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:41.047470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbb91d-0ff6-4480-9edb-db4dfe1b85ce None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:41.050924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c1fc-17d4-4358-85bc-435f4489a904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:41.051488 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c1fc-17d4-4358-85bc-435f4489a904 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:41.051818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c1fc-17d4-4358-85bc-435f4489a904 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:41.052085 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c1fc-17d4-4358-85bc-435f4489a904 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:41.052746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641c1fc-17d4-4358-85bc-435f4489a904 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:41.053010 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641c1fc-17d4-4358-85bc-435f4489a904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:41.054341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641c1fc-17d4-4358-85bc-435f4489a904 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:41.059702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 415/815] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Oct 4 10:14:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:41.060521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c1fc-17d4-4358-85bc-435f4489a904 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:41.085773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:41.144283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbb91d-0ff6-4480-9edb-db4dfe1b85ce None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:41.157600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c1fc-17d4-4358-85bc-435f4489a904 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:41.177317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31b955-7d6e-4c32-b762-2fca70912aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:41.177940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b955-7d6e-4c32-b762-2fca70912aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:41.178218 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b955-7d6e-4c32-b762-2fca70912aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:41.178493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b955-7d6e-4c32-b762-2fca70912aa9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:41.179060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31b955-7d6e-4c32-b762-2fca70912aa9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:41.180444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31b955-7d6e-4c32-b762-2fca70912aa9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-3b31b955-7d6e-4c32-b762-2fca70912aa9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:41.189529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:41.190691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:41.191537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 401/816] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:41 2022] GET /identity/v3/services/network => generated 88 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:41.192367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa1d2d-5821-47bb-ac7e-accc0dd86040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:41.192454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31b955-7d6e-4c32-b762-2fca70912aa9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:41.192532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa1d2d-5821-47bb-ac7e-accc0dd86040 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:41.192532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa1d2d-5821-47bb-ac7e-accc0dd86040 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:41.192532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa1d2d-5821-47bb-ac7e-accc0dd86040 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:41.192707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa1d2d-5821-47bb-ac7e-accc0dd86040 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:41.193391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa1d2d-5821-47bb-ac7e-accc0dd86040 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:41.194336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa1d2d-5821-47bb-ac7e-accc0dd86040 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:41.206093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 416/817] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:41.206875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa1d2d-5821-47bb-ac7e-accc0dd86040 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:41.245000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:41.290145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:41.294285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31b955-7d6e-4c32-b762-2fca70912aa9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:41.304985 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa1d2d-5821-47bb-ac7e-accc0dd86040 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:41.326746 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81dd99-6c7e-4a7b-9ea3-dd202b4d799a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:41.327387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81dd99-6c7e-4a7b-9ea3-dd202b4d799a None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:41.327664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81dd99-6c7e-4a7b-9ea3-dd202b4d799a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:41.327934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81dd99-6c7e-4a7b-9ea3-dd202b4d799a None admin] PATH_INFO: `/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/fe9c03800bc6451aa9e5a39ca4ea0bf7/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:41.329839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81dd99-6c7e-4a7b-9ea3-dd202b4d799a None admin] RBAC: Authorizing `identity:create_grant(project_id=c41ae2f9d03c48be8017a1ca480bf7db, user_id=fe9c03800bc6451aa9e5a39ca4ea0bf7, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:41.331250 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81dd99-6c7e-4a7b-9ea3-dd202b4d799a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:41.338326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9bcdd-a572-4844-afb7-89c08414b2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:41.339066 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9bcdd-a572-4844-afb7-89c08414b2af None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:41.339348 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9bcdd-a572-4844-afb7-89c08414b2af None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:41.339620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9bcdd-a572-4844-afb7-89c08414b2af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:41.350000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9bcdd-a572-4844-afb7-89c08414b2af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:41.351397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9bcdd-a572-4844-afb7-89c08414b2af None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6de9bcdd-a572-4844-afb7-89c08414b2af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:41.365331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:41.371523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:41.372600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:41.372600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:41.372600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:41.372600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 417/818] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:41.372600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9bcdd-a572-4844-afb7-89c08414b2af None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:41.414198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 402/819] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:14:41 2022] PUT /identity/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/fe9c03800bc6451aa9e5a39ca4ea0bf7/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:14:41.421145 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81dd99-6c7e-4a7b-9ea3-dd202b4d799a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:41.471690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9bcdd-a572-4844-afb7-89c08414b2af None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:41.508146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e9e3f-4a7a-4d9e-82b2-11012cc5c197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:41.508860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e9e3f-4a7a-4d9e-82b2-11012cc5c197 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:41.509091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e9e3f-4a7a-4d9e-82b2-11012cc5c197 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:41.518141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e9e3f-4a7a-4d9e-82b2-11012cc5c197 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:41.518141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e9e3f-4a7a-4d9e-82b2-11012cc5c197 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:41.518141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e9e3f-4a7a-4d9e-82b2-11012cc5c197 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:41.518141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:41.539483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81dd99-6c7e-4a7b-9ea3-dd202b4d799a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:41.551578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:41.576097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e7872-1070-42ec-a8ce-0c9e9e64976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:41.576734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7872-1070-42ec-a8ce-0c9e9e64976c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:41.576896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7872-1070-42ec-a8ce-0c9e9e64976c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:41.577164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7872-1070-42ec-a8ce-0c9e9e64976c None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:41.577793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e7872-1070-42ec-a8ce-0c9e9e64976c None admin] RBAC: Adding query filter params (name=network) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:41.578093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e7872-1070-42ec-a8ce-0c9e9e64976c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:41.579520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e7872-1070-42ec-a8ce-0c9e9e64976c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:41.586117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 403/820] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:14:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:41.587595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e7872-1070-42ec-a8ce-0c9e9e64976c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:41.631458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 418/821] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:14:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:14:41.631458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e9e3f-4a7a-4d9e-82b2-11012cc5c197 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:41.699388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e7872-1070-42ec-a8ce-0c9e9e64976c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:41.746135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39f56a-b718-4f1b-a5c6-5b58f7335eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:41.746852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39f56a-b718-4f1b-a5c6-5b58f7335eba None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:41.747246 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39f56a-b718-4f1b-a5c6-5b58f7335eba None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:41.747588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39f56a-b718-4f1b-a5c6-5b58f7335eba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:41.748566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39f56a-b718-4f1b-a5c6-5b58f7335eba None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=567188b7c4fe40c1a1623d2f60092d26) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:41.748954 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39f56a-b718-4f1b-a5c6-5b58f7335eba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:41.750439 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39f56a-b718-4f1b-a5c6-5b58f7335eba None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:41.757532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 404/822] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:41 2022] GET /identity/v3/role_assignments?user.id=567188b7c4fe40c1a1623d2f60092d26&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:41.758400 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39f56a-b718-4f1b-a5c6-5b58f7335eba None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:41.776438 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e9e3f-4a7a-4d9e-82b2-11012cc5c197 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:41.835765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:41.863330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db4db-2b75-4039-936e-86c9adcd3fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:41.863974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db4db-2b75-4039-936e-86c9adcd3fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:41.864258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db4db-2b75-4039-936e-86c9adcd3fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:41.864531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db4db-2b75-4039-936e-86c9adcd3fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:41.865241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96db4db-2b75-4039-936e-86c9adcd3fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:41.865549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96db4db-2b75-4039-936e-86c9adcd3fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:41.866931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96db4db-2b75-4039-936e-86c9adcd3fe0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:41.886001 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 419/823] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:41.892746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db4db-2b75-4039-936e-86c9adcd3fe0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:41.954134 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:41.974944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39f56a-b718-4f1b-a5c6-5b58f7335eba None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:42.008156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db4db-2b75-4039-936e-86c9adcd3fe0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:42.026134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111999a-cd16-4cd2-bc82-dee70d5dc99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:42.026751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111999a-cd16-4cd2-bc82-dee70d5dc99e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:42.027029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111999a-cd16-4cd2-bc82-dee70d5dc99e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:42.027300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111999a-cd16-4cd2-bc82-dee70d5dc99e None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:42.029164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111999a-cd16-4cd2-bc82-dee70d5dc99e None admin] RBAC: Adding query filter params (type=network) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:42.029484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111999a-cd16-4cd2-bc82-dee70d5dc99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:42.030861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111999a-cd16-4cd2-bc82-dee70d5dc99e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:42.040369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 405/824] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:14:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:42.044930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111999a-cd16-4cd2-bc82-dee70d5dc99e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:42.053192 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299ae87-b1df-4c5a-baf6-1e0029780c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:42.054097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299ae87-b1df-4c5a-baf6-1e0029780c58 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:42.054555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299ae87-b1df-4c5a-baf6-1e0029780c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:42.055006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299ae87-b1df-4c5a-baf6-1e0029780c58 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:42.063639 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299ae87-b1df-4c5a-baf6-1e0029780c58 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:42.065534 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299ae87-b1df-4c5a-baf6-1e0029780c58 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6299ae87-b1df-4c5a-baf6-1e0029780c58 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:42.078633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:42.079658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:42.080652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:42.080652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:42.080652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:42.080652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:42.080652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:42.080652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:42.080652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:42.080652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:42.080652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 10:14:42.080652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:42.082589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 420/825] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 10:14:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:42.090512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299ae87-b1df-4c5a-baf6-1e0029780c58 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:42.182594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:42.188013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111999a-cd16-4cd2-bc82-dee70d5dc99e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:42.229529 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299ae87-b1df-4c5a-baf6-1e0029780c58 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:42.240381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a4a84-cc7a-4b5a-b00f-765a0f5140b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:42.241956 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4a84-cc7a-4b5a-b00f-765a0f5140b4 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:42.242436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4a84-cc7a-4b5a-b00f-765a0f5140b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:42.242926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4a84-cc7a-4b5a-b00f-765a0f5140b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:42.243982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a4a84-cc7a-4b5a-b00f-765a0f5140b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:42.244568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:42.247303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a4a84-cc7a-4b5a-b00f-765a0f5140b4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:42.268534 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f531e2-950b-4845-ba7f-58bd973bdd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:42.269258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f531e2-950b-4845-ba7f-58bd973bdd01 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:42.269599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f531e2-950b-4845-ba7f-58bd973bdd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:42.269931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f531e2-950b-4845-ba7f-58bd973bdd01 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:42.270725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f531e2-950b-4845-ba7f-58bd973bdd01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:42.271091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f531e2-950b-4845-ba7f-58bd973bdd01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:42.273076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f531e2-950b-4845-ba7f-58bd973bdd01 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:42.294199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 421/826] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Oct 4 10:14:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:42.300022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f531e2-950b-4845-ba7f-58bd973bdd01 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:42.363593 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 406/827] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:14:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:14:42.434083 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f531e2-950b-4845-ba7f-58bd973bdd01 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:42.499800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e18c-2bdd-43ea-886d-b056ecc9d649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:42.500503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e18c-2bdd-43ea-886d-b056ecc9d649 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:42.500959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e18c-2bdd-43ea-886d-b056ecc9d649 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:42.500959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e18c-2bdd-43ea-886d-b056ecc9d649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:42.514265 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924e18c-2bdd-43ea-886d-b056ecc9d649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:42.519314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924e18c-2bdd-43ea-886d-b056ecc9d649 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6924e18c-2bdd-43ea-886d-b056ecc9d649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:42.532352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:42.533370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:42.534276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:42.534276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:42.534276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:42.534276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 422/828] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:42.539876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a4a84-cc7a-4b5a-b00f-765a0f5140b4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:42.646348 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a4a84-cc7a-4b5a-b00f-765a0f5140b4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:42.683042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef3d5-10d9-4207-ab0a-682decf3fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:42.683658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef3d5-10d9-4207-ab0a-682decf3fe2c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:42.683932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef3d5-10d9-4207-ab0a-682decf3fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:42.684240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef3d5-10d9-4207-ab0a-682decf3fe2c None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:42.684936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ef3d5-10d9-4207-ab0a-682decf3fe2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:42.685237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ef3d5-10d9-4207-ab0a-682decf3fe2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:42.686595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ef3d5-10d9-4207-ab0a-682decf3fe2c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:42.700075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 407/829] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:42.705484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e18c-2bdd-43ea-886d-b056ecc9d649 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:42.726543 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:42.836456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e18c-2bdd-43ea-886d-b056ecc9d649 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:42.877758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42680e0d-f661-4f5e-9d83-e2889fe3286d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:42.878403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42680e0d-f661-4f5e-9d83-e2889fe3286d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:42.878681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42680e0d-f661-4f5e-9d83-e2889fe3286d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:42.878952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42680e0d-f661-4f5e-9d83-e2889fe3286d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:42.886230 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42680e0d-f661-4f5e-9d83-e2889fe3286d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:42.887668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42680e0d-f661-4f5e-9d83-e2889fe3286d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-42680e0d-f661-4f5e-9d83-e2889fe3286d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:42.899132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:42.901299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:42.903427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:42.903427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:42.903427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:42.903427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:42.903427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:42.903427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:42.903427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:42.903427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:42.903427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 423/830] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:42.912929 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef3d5-10d9-4207-ab0a-682decf3fe2c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:42.929889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:43.027796 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef3d5-10d9-4207-ab0a-682decf3fe2c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:43.064404 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d122e8-dca5-49ab-b1e6-d45d60394927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:43.065520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d122e8-dca5-49ab-b1e6-d45d60394927 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:43.069574 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d122e8-dca5-49ab-b1e6-d45d60394927 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:43.070045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d122e8-dca5-49ab-b1e6-d45d60394927 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:43.070925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d122e8-dca5-49ab-b1e6-d45d60394927 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:43.071435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d122e8-dca5-49ab-b1e6-d45d60394927 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:43.073189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d122e8-dca5-49ab-b1e6-d45d60394927 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:43.085923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 408/831] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:43.092833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42680e0d-f661-4f5e-9d83-e2889fe3286d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:43.182584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:43.205738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42680e0d-f661-4f5e-9d83-e2889fe3286d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:43.239656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb5015-0899-4531-a3d6-fa4fb6c8718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:43.240678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb5015-0899-4531-a3d6-fa4fb6c8718f None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:43.241190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb5015-0899-4531-a3d6-fa4fb6c8718f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:43.241923 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb5015-0899-4531-a3d6-fa4fb6c8718f None admin] PATH_INFO: `/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/347ab0ce405c4deba9295d5395cb1d6e/roles/f53f657a7b1f44a98ec5e754a93d8b3c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:43.258299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb5015-0899-4531-a3d6-fa4fb6c8718f None admin] RBAC: Authorizing `identity:create_grant(project_id=c41ae2f9d03c48be8017a1ca480bf7db, user_id=347ab0ce405c4deba9295d5395cb1d6e, role_id=f53f657a7b1f44a98ec5e754a93d8b3c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:43.260605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb5015-0899-4531-a3d6-fa4fb6c8718f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:43.334860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 424/832] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:14:43 2022] PUT /identity/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/347ab0ce405c4deba9295d5395cb1d6e/roles/f53f657a7b1f44a98ec5e754a93d8b3c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:14:43.677675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5717dab-fd3c-4633-8512-20c6e9cae48f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:43.678198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5717dab-fd3c-4633-8512-20c6e9cae48f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:43.678198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5717dab-fd3c-4633-8512-20c6e9cae48f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:43.679783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 409/833] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:43.685242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b177b-124c-46f7-808d-4a46d46e34d0 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:43.685663 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b177b-124c-46f7-808d-4a46d46e34d0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:43.685835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b177b-124c-46f7-808d-4a46d46e34d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:43.704480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-344b177b-124c-46f7-808d-4a46d46e34d0 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:43.705676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-344b177b-124c-46f7-808d-4a46d46e34d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:43.773216 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 425/834] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:14:44.041799 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5717dab-fd3c-4633-8512-20c6e9cae48f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:44.129991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:44.157724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5717dab-fd3c-4633-8512-20c6e9cae48f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:44.175556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966490ff-df18-48b7-b074-d0b8a5c34674 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:44.175856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966490ff-df18-48b7-b074-d0b8a5c34674 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:44.176157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966490ff-df18-48b7-b074-d0b8a5c34674 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:44.177661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 426/835] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:14:44.182936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f081fa4-109e-478a-aef1-c6db90f78005 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:44.183457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f081fa4-109e-478a-aef1-c6db90f78005 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:44.183933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f081fa4-109e-478a-aef1-c6db90f78005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:44.197984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afb6a0-a00b-400c-a7cf-7503255e15eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:44.198630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb6a0-a00b-400c-a7cf-7503255e15eb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:44.198907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb6a0-a00b-400c-a7cf-7503255e15eb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:44.199178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb6a0-a00b-400c-a7cf-7503255e15eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:44.204688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3f081fa4-109e-478a-aef1-c6db90f78005 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:44.206373 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3f081fa4-109e-478a-aef1-c6db90f78005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:44.209799 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afb6a0-a00b-400c-a7cf-7503255e15eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-65afb6a0-a00b-400c-a7cf-7503255e15eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:44.215408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:44.216595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:44.217684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 410/836] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:14:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:44.222453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afb6a0-a00b-400c-a7cf-7503255e15eb None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:44.275695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:44.296054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 427/837] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:14:44.348672 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afb6a0-a00b-400c-a7cf-7503255e15eb None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:44.383309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1979c0-7cb4-498e-b740-ce7b8b9c2656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:44.384472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1979c0-7cb4-498e-b740-ce7b8b9c2656 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:44.384747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1979c0-7cb4-498e-b740-ce7b8b9c2656 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:44.385018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1979c0-7cb4-498e-b740-ce7b8b9c2656 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:44.385667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1979c0-7cb4-498e-b740-ce7b8b9c2656 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:44.385965 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1979c0-7cb4-498e-b740-ce7b8b9c2656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:44.387320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1979c0-7cb4-498e-b740-ce7b8b9c2656 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:44.388653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:44.396768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 411/838] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:14:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:44.403323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f081fa4-109e-478a-aef1-c6db90f78005 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:44.518809 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f081fa4-109e-478a-aef1-c6db90f78005 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:44.534753 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16087a83-627e-4d16-b0f6-65fc88c3871a None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:44.535081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16087a83-627e-4d16-b0f6-65fc88c3871a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:44.535301 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16087a83-627e-4d16-b0f6-65fc88c3871a None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:44.536804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 412/839] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:44.542998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4382a6e-e60e-4efd-bd2f-07b50f7a3b22 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:44.542998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4382a6e-e60e-4efd-bd2f-07b50f7a3b22 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:44.542998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4382a6e-e60e-4efd-bd2f-07b50f7a3b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:44.556981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffe654-6447-4149-97c6-3fab61d3f847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:44.557541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe654-6447-4149-97c6-3fab61d3f847 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:44.557817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe654-6447-4149-97c6-3fab61d3f847 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:44.558086 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe654-6447-4149-97c6-3fab61d3f847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:44.564738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a4382a6e-e60e-4efd-bd2f-07b50f7a3b22 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:44.566236 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a4382a6e-e60e-4efd-bd2f-07b50f7a3b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:44.568724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffe654-6447-4149-97c6-3fab61d3f847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:44.571079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffe654-6447-4149-97c6-3fab61d3f847 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e5ffe654-6447-4149-97c6-3fab61d3f847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:44.589128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:44.590449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:44.591359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:44.591359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:44.591359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:44.591359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 428/840] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:44.596486 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffe654-6447-4149-97c6-3fab61d3f847 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:44.644077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:44.645572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 413/841] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:14:44.646423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4382a6e-e60e-4efd-bd2f-07b50f7a3b22 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:44.716564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffe654-6447-4149-97c6-3fab61d3f847 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:44.755527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879ad44-3840-4a0e-a431-69de6e134d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:44.756570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879ad44-3840-4a0e-a431-69de6e134d57 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:44.757113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879ad44-3840-4a0e-a431-69de6e134d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:44.757693 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879ad44-3840-4a0e-a431-69de6e134d57 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:44.758540 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879ad44-3840-4a0e-a431-69de6e134d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:44.759090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879ad44-3840-4a0e-a431-69de6e134d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:44.761410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879ad44-3840-4a0e-a431-69de6e134d57 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:44.769930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4382a6e-e60e-4efd-bd2f-07b50f7a3b22 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:44.777179 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 429/842] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:44.788005 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879ad44-3840-4a0e-a431-69de6e134d57 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:44.805038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:44.816409 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b702102-4ff2-4cb5-943f-380bb4a27953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:44.816922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b702102-4ff2-4cb5-943f-380bb4a27953 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:44.817677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b702102-4ff2-4cb5-943f-380bb4a27953 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:44.818059 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b702102-4ff2-4cb5-943f-380bb4a27953 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:44.819008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b702102-4ff2-4cb5-943f-380bb4a27953 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:44.820797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b702102-4ff2-4cb5-943f-380bb4a27953 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-3b702102-4ff2-4cb5-943f-380bb4a27953 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:44.832798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:44.839388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:44.840647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 414/843] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:14:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:44.842024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b702102-4ff2-4cb5-943f-380bb4a27953 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:44.917795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:44.922799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879ad44-3840-4a0e-a431-69de6e134d57 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:44.964014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b702102-4ff2-4cb5-943f-380bb4a27953 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:44.968500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e610b-eb82-4cfb-84bd-42421ed599b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:44.969330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e610b-eb82-4cfb-84bd-42421ed599b7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:44.969760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e610b-eb82-4cfb-84bd-42421ed599b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:44.970179 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e610b-eb82-4cfb-84bd-42421ed599b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:44.979063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e610b-eb82-4cfb-84bd-42421ed599b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:44.980870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e610b-eb82-4cfb-84bd-42421ed599b7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-a68e610b-eb82-4cfb-84bd-42421ed599b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:44.993565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:44.994747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:44.995895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:44.995895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:44.995895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:44.995895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:44.995895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:44.995895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:44.995895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:44.995895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:44.995895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 10:14:44.995895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:45.002489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f3bd-a051-47a4-a5f7-e18007cf6fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:45.002489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f3bd-a051-47a4-a5f7-e18007cf6fac None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:45.002489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f3bd-a051-47a4-a5f7-e18007cf6fac None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:45.002489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f3bd-a051-47a4-a5f7-e18007cf6fac None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:45.002855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f3bd-a051-47a4-a5f7-e18007cf6fac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:45.002855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f3bd-a051-47a4-a5f7-e18007cf6fac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:45.002991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 430/844] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:14:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:45.002991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e610b-eb82-4cfb-84bd-42421ed599b7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:45.003119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f3bd-a051-47a4-a5f7-e18007cf6fac None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:45.007553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 415/845] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:14:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:45.011622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f3bd-a051-47a4-a5f7-e18007cf6fac None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:45.067867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:45.105231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e610b-eb82-4cfb-84bd-42421ed599b7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:45.119199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f3bd-a051-47a4-a5f7-e18007cf6fac None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:45.141822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf6209-8e9a-4ee8-bc43-9504e7380578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:45.142452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf6209-8e9a-4ee8-bc43-9504e7380578 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:45.142732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf6209-8e9a-4ee8-bc43-9504e7380578 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:45.143008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf6209-8e9a-4ee8-bc43-9504e7380578 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:45.143595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf6209-8e9a-4ee8-bc43-9504e7380578 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:45.144981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf6209-8e9a-4ee8-bc43-9504e7380578 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9edf6209-8e9a-4ee8-bc43-9504e7380578 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:45.153798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:45.154942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:45.155885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 431/846] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Oct 4 10:14:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:45.156739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf6209-8e9a-4ee8-bc43-9504e7380578 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:45.162587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c9b9d-a32c-401e-b97a-507a8c59e740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:45.163202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c9b9d-a32c-401e-b97a-507a8c59e740 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:45.163477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c9b9d-a32c-401e-b97a-507a8c59e740 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:45.163750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c9b9d-a32c-401e-b97a-507a8c59e740 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:45.164507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c9b9d-a32c-401e-b97a-507a8c59e740 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:45.165324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c9b9d-a32c-401e-b97a-507a8c59e740 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:45.166752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c9b9d-a32c-401e-b97a-507a8c59e740 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:45.184599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 416/847] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Oct 4 10:14:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:45.185435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c9b9d-a32c-401e-b97a-507a8c59e740 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:45.193888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:45.272843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf6209-8e9a-4ee8-bc43-9504e7380578 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:45.288512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c9b9d-a32c-401e-b97a-507a8c59e740 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:45.301588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:45.311162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcfd00-c585-43c8-b77f-b5e20cbabaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:45.311797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcfd00-c585-43c8-b77f-b5e20cbabaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:45.312067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcfd00-c585-43c8-b77f-b5e20cbabaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:45.312345 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcfd00-c585-43c8-b77f-b5e20cbabaa7 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:45.312973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcfd00-c585-43c8-b77f-b5e20cbabaa7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:45.313277 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcfd00-c585-43c8-b77f-b5e20cbabaa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:45.314628 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcfd00-c585-43c8-b77f-b5e20cbabaa7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:45.328387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 432/848] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:14:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:45.328387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcfd00-c585-43c8-b77f-b5e20cbabaa7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:45.333457 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44a068-b2f8-42e3-b1b9-2b940af661d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:45.334086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44a068-b2f8-42e3-b1b9-2b940af661d9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:45.334364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44a068-b2f8-42e3-b1b9-2b940af661d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:45.334635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44a068-b2f8-42e3-b1b9-2b940af661d9 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:45.335271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44a068-b2f8-42e3-b1b9-2b940af661d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:45.335571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44a068-b2f8-42e3-b1b9-2b940af661d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:45.337288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44a068-b2f8-42e3-b1b9-2b940af661d9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:45.347710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 417/849] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 10:14:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:45.349469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44a068-b2f8-42e3-b1b9-2b940af661d9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:45.432763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:45.449745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcfd00-c585-43c8-b77f-b5e20cbabaa7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:45.493126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211da649-c688-4915-a60b-aeab73128161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:45.494002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211da649-c688-4915-a60b-aeab73128161 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:45.494382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211da649-c688-4915-a60b-aeab73128161 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:45.494812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211da649-c688-4915-a60b-aeab73128161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:45.497180 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44a068-b2f8-42e3-b1b9-2b940af661d9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:45.553242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81868627-3178-41cb-b0fe-95f73c35f588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:45.554162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81868627-3178-41cb-b0fe-95f73c35f588 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:45.554603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81868627-3178-41cb-b0fe-95f73c35f588 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:45.554878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81868627-3178-41cb-b0fe-95f73c35f588 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:45.555544 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81868627-3178-41cb-b0fe-95f73c35f588 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:45.555856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81868627-3178-41cb-b0fe-95f73c35f588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:45.557278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81868627-3178-41cb-b0fe-95f73c35f588 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:45.562525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 418/850] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 10:14:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:45.563720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5324-b243-4862-ba8e-68e6b72f41bd None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:45.564034 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5324-b243-4862-ba8e-68e6b72f41bd None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:45.564311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5324-b243-4862-ba8e-68e6b72f41bd None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:45.565547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 419/851] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:45.572385 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70827-07b1-4b49-a3c9-d7934f445544 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:45.572661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70827-07b1-4b49-a3c9-d7934f445544 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:45.572934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70827-07b1-4b49-a3c9-d7934f445544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:45.577401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211da649-c688-4915-a60b-aeab73128161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:45.580274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211da649-c688-4915-a60b-aeab73128161 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:45.599990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-12e70827-07b1-4b49-a3c9-d7934f445544 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:45.599990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-12e70827-07b1-4b49-a3c9-d7934f445544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:45.668403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:45.693979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 420/852] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:14:45.695633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:45.717946 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 433/853] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:45 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:14:45.723511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e70827-07b1-4b49-a3c9-d7934f445544 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:45.834676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e70827-07b1-4b49-a3c9-d7934f445544 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:45.871694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdde3df-498b-4a4c-a351-51db5491748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:45.872368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdde3df-498b-4a4c-a351-51db5491748f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:45.872646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdde3df-498b-4a4c-a351-51db5491748f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:45.872921 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdde3df-498b-4a4c-a351-51db5491748f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:45.884238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdde3df-498b-4a4c-a351-51db5491748f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:45.885758 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdde3df-498b-4a4c-a351-51db5491748f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-0fdde3df-498b-4a4c-a351-51db5491748f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:45.901196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:45.902166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:45.903071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:45.903071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:45.903071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:45.915406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 421/854] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:45.916860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211da649-c688-4915-a60b-aeab73128161 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:45.978487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdde3df-498b-4a4c-a351-51db5491748f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:46.006276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:46.026932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211da649-c688-4915-a60b-aeab73128161 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:46.065848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb339da1-9dcf-4d0b-92a5-125e7ab06adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:46.066807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb339da1-9dcf-4d0b-92a5-125e7ab06adb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:46.067280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb339da1-9dcf-4d0b-92a5-125e7ab06adb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:46.067766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb339da1-9dcf-4d0b-92a5-125e7ab06adb None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:46.068610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb339da1-9dcf-4d0b-92a5-125e7ab06adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:46.069105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb339da1-9dcf-4d0b-92a5-125e7ab06adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:46.070631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb339da1-9dcf-4d0b-92a5-125e7ab06adb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:46.083385 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 434/855] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:46.090730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb339da1-9dcf-4d0b-92a5-125e7ab06adb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:46.108152 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdde3df-498b-4a4c-a351-51db5491748f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:46.147647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b2c8e-633f-4bff-bf9a-63cc5274c6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:46.148407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b2c8e-633f-4bff-bf9a-63cc5274c6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:46.148690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b2c8e-633f-4bff-bf9a-63cc5274c6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:46.148965 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b2c8e-633f-4bff-bf9a-63cc5274c6e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:46.155809 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:46.160200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b2c8e-633f-4bff-bf9a-63cc5274c6e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-9b1b2c8e-633f-4bff-bf9a-63cc5274c6e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:46.165205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:46.166171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:46.166998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 422/856] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:14:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:46.173726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b2c8e-633f-4bff-bf9a-63cc5274c6e8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:46.211149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb339da1-9dcf-4d0b-92a5-125e7ab06adb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:46.251925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c1bbb-2bc0-494c-a031-60e425f5fd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:46.252625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c1bbb-2bc0-494c-a031-60e425f5fd7f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:46.252905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c1bbb-2bc0-494c-a031-60e425f5fd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:46.253178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c1bbb-2bc0-494c-a031-60e425f5fd7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:46.262513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c1bbb-2bc0-494c-a031-60e425f5fd7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:46.264174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:46.265253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c1bbb-2bc0-494c-a031-60e425f5fd7f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2e8c1bbb-2bc0-494c-a031-60e425f5fd7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:46.280175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:46.281862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:46.282992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:46.282992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:46.282992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:46.282992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:46.282992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:46.282992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:46.282992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:46.282992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:46.288401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b2c8e-633f-4bff-bf9a-63cc5274c6e8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:46.288554 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 435/857] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:46.293109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c1bbb-2bc0-494c-a031-60e425f5fd7f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:46.325768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475975d9-cb61-4bb0-81b5-fb80db2af588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:46.326421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475975d9-cb61-4bb0-81b5-fb80db2af588 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:46.326695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475975d9-cb61-4bb0-81b5-fb80db2af588 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:46.326969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475975d9-cb61-4bb0-81b5-fb80db2af588 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:46.327681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475975d9-cb61-4bb0-81b5-fb80db2af588 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:46.327981 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475975d9-cb61-4bb0-81b5-fb80db2af588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:46.330615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475975d9-cb61-4bb0-81b5-fb80db2af588 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:46.341428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 423/858] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:14:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:46.346707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475975d9-cb61-4bb0-81b5-fb80db2af588 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:46.440179 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c1bbb-2bc0-494c-a031-60e425f5fd7f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:46.452472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:46.471239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475975d9-cb61-4bb0-81b5-fb80db2af588 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:46.483690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce7b72-839d-4d78-a025-a3ab39e4ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:46.484643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce7b72-839d-4d78-a025-a3ab39e4ba9e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:46.485187 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce7b72-839d-4d78-a025-a3ab39e4ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:46.485754 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce7b72-839d-4d78-a025-a3ab39e4ba9e None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:46.486723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce7b72-839d-4d78-a025-a3ab39e4ba9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:46.487230 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce7b72-839d-4d78-a025-a3ab39e4ba9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:46.489027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce7b72-839d-4d78-a025-a3ab39e4ba9e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:46.510418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 436/859] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:46.512140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce7b72-839d-4d78-a025-a3ab39e4ba9e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:46.512364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb78cbf-7120-4db2-a3f0-8433723470e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:46.513023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb78cbf-7120-4db2-a3f0-8433723470e8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:46.515689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb78cbf-7120-4db2-a3f0-8433723470e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:46.515689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb78cbf-7120-4db2-a3f0-8433723470e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:46.526159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb78cbf-7120-4db2-a3f0-8433723470e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:46.527601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb78cbf-7120-4db2-a3f0-8433723470e8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:46.530276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-abb78cbf-7120-4db2-a3f0-8433723470e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:46.543841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:46.544848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:46.546374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:46.546374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:46.546374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:46.550026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 424/860] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:46.550867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb78cbf-7120-4db2-a3f0-8433723470e8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:46.630456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce7b72-839d-4d78-a025-a3ab39e4ba9e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:46.653880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb78cbf-7120-4db2-a3f0-8433723470e8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:46.668976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b4e1f-a46e-4e7b-8f94-ba81c7731cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:46.669906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b4e1f-a46e-4e7b-8f94-ba81c7731cee None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:46.670382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b4e1f-a46e-4e7b-8f94-ba81c7731cee None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:46.670852 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b4e1f-a46e-4e7b-8f94-ba81c7731cee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:46.671856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b4e1f-a46e-4e7b-8f94-ba81c7731cee None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=fe9c03800bc6451aa9e5a39ca4ea0bf7) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:46.672418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b4e1f-a46e-4e7b-8f94-ba81c7731cee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:46.674036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b4e1f-a46e-4e7b-8f94-ba81c7731cee None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:46.685353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 437/861] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:46 2022] GET /identity/v3/role_assignments?user.id=fe9c03800bc6451aa9e5a39ca4ea0bf7&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:46.688923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6dfcf-73e6-4149-bfba-1fc36c717aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:46.689556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6dfcf-73e6-4149-bfba-1fc36c717aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:46.689836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6dfcf-73e6-4149-bfba-1fc36c717aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:46.690106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6dfcf-73e6-4149-bfba-1fc36c717aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:46.690835 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6dfcf-73e6-4149-bfba-1fc36c717aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:46.691145 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6dfcf-73e6-4149-bfba-1fc36c717aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:46.692592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6dfcf-73e6-4149-bfba-1fc36c717aa8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:46.707298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 425/862] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:46.713213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b4e1f-a46e-4e7b-8f94-ba81c7731cee None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:46.752132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:46.828194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b4e1f-a46e-4e7b-8f94-ba81c7731cee None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:46.869638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b4207-0696-4453-808b-0668fe3395ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:46.870281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4207-0696-4453-808b-0668fe3395ef None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:46.870561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4207-0696-4453-808b-0668fe3395ef None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:46.870834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4207-0696-4453-808b-0668fe3395ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:46.879645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b4207-0696-4453-808b-0668fe3395ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:46.881208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b4207-0696-4453-808b-0668fe3395ef None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-772b4207-0696-4453-808b-0668fe3395ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:46.893955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:46.894971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:46.896572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:46.896572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:46.896572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:46.896572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:46.896572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:46.896572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:46.896572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:46.896572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:46.896572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 10:14:46.896572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:46.896572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 438/863] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 10:14:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:46.902194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6dfcf-73e6-4149-bfba-1fc36c717aa8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:46.968406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:47.013994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6dfcf-73e6-4149-bfba-1fc36c717aa8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:47.051915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543608d-94a1-40b2-87d2-692be410ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:47.052565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543608d-94a1-40b2-87d2-692be410ab8d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:47.052845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543608d-94a1-40b2-87d2-692be410ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:47.053118 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543608d-94a1-40b2-87d2-692be410ab8d None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:47.053849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543608d-94a1-40b2-87d2-692be410ab8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:47.054155 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543608d-94a1-40b2-87d2-692be410ab8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:47.056146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543608d-94a1-40b2-87d2-692be410ab8d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:47.074554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 426/864] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Oct 4 10:14:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:47.080137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b4207-0696-4453-808b-0668fe3395ef None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:47.174798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:47.184094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b4207-0696-4453-808b-0668fe3395ef None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:47.224755 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4ec1c-25f9-4300-8c32-b5985b0b44e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:47.225377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4ec1c-25f9-4300-8c32-b5985b0b44e4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:47.225657 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4ec1c-25f9-4300-8c32-b5985b0b44e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:47.225930 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4ec1c-25f9-4300-8c32-b5985b0b44e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:47.305764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4ec1c-25f9-4300-8c32-b5985b0b44e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:47.307205 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4ec1c-25f9-4300-8c32-b5985b0b44e4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:47.406357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:47.416482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 439/865] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:14:47.424989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543608d-94a1-40b2-87d2-692be410ab8d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:47.525118 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543608d-94a1-40b2-87d2-692be410ab8d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:47.539757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:47.560478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba967277-0c58-46e8-a76f-d70ce9bc7481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:47.561111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba967277-0c58-46e8-a76f-d70ce9bc7481 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:47.561413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba967277-0c58-46e8-a76f-d70ce9bc7481 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:47.561681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba967277-0c58-46e8-a76f-d70ce9bc7481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:47.571905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba967277-0c58-46e8-a76f-d70ce9bc7481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:47.573395 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba967277-0c58-46e8-a76f-d70ce9bc7481 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-ba967277-0c58-46e8-a76f-d70ce9bc7481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:47.591174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:47.592852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:47.594031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:47.594031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:47.594031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:47.594031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 427/866] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:47.598595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4ec1c-25f9-4300-8c32-b5985b0b44e4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:47.700824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4ec1c-25f9-4300-8c32-b5985b0b44e4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:47.707025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf826c9-f1aa-4f6d-9e90-5cebe2704383 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:47.707301 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf826c9-f1aa-4f6d-9e90-5cebe2704383 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:47.707569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf826c9-f1aa-4f6d-9e90-5cebe2704383 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:47.709217 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 428/867] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:47.716501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac056e75-7a3d-4fdf-9a83-c78a1b7309cb None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:47.717070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac056e75-7a3d-4fdf-9a83-c78a1b7309cb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:47.717535 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac056e75-7a3d-4fdf-9a83-c78a1b7309cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:47.736286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ac056e75-7a3d-4fdf-9a83-c78a1b7309cb None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:47.737856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ac056e75-7a3d-4fdf-9a83-c78a1b7309cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:47.743907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd11595-cea5-4f90-8fbf-c7ca75af5865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:47.744562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd11595-cea5-4f90-8fbf-c7ca75af5865 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:47.744834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd11595-cea5-4f90-8fbf-c7ca75af5865 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:47.745101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd11595-cea5-4f90-8fbf-c7ca75af5865 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:47.745752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd11595-cea5-4f90-8fbf-c7ca75af5865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:47.746051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd11595-cea5-4f90-8fbf-c7ca75af5865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:47.747436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd11595-cea5-4f90-8fbf-c7ca75af5865 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:47.766136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 440/868] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:47.771821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd11595-cea5-4f90-8fbf-c7ca75af5865 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:47.832357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:47.839037 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 429/869] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:14:47.873932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9ac63-d62f-47a7-ae34-1e2f0eb51958 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:47.874295 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9ac63-d62f-47a7-ae34-1e2f0eb51958 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:47.874495 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9ac63-d62f-47a7-ae34-1e2f0eb51958 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:47.876104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 430/870] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:14:47.881127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889b3a6-ba5b-4df2-bf43-9c572c530776 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:47.881413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889b3a6-ba5b-4df2-bf43-9c572c530776 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:47.881691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889b3a6-ba5b-4df2-bf43-9c572c530776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:47.885263 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd11595-cea5-4f90-8fbf-c7ca75af5865 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:47.900692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b889b3a6-ba5b-4df2-bf43-9c572c530776 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:47.901931 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b889b3a6-ba5b-4df2-bf43-9c572c530776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:47.926967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3c4af-88f0-45f2-9049-459e95768a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:47.927593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3c4af-88f0-45f2-9049-459e95768a1f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:47.927866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3c4af-88f0-45f2-9049-459e95768a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:47.928162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3c4af-88f0-45f2-9049-459e95768a1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:47.937912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3c4af-88f0-45f2-9049-459e95768a1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:47.940046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3c4af-88f0-45f2-9049-459e95768a1f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5ff3c4af-88f0-45f2-9049-459e95768a1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:47.954351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:47.955308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:47.956258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:47.956258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:47.956258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:47.956258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:47.956258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:47.956258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:47.956258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:47.956258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:47.956258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 441/871] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:47.961808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3c4af-88f0-45f2-9049-459e95768a1f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:47.986810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 431/872] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:48.063715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3c4af-88f0-45f2-9049-459e95768a1f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:48.076840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:48.097937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef183f1-727b-4d35-b766-c0e213a1c588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:48.098545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef183f1-727b-4d35-b766-c0e213a1c588 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:48.098824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef183f1-727b-4d35-b766-c0e213a1c588 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:48.099098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef183f1-727b-4d35-b766-c0e213a1c588 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:48.099781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef183f1-727b-4d35-b766-c0e213a1c588 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:48.100123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef183f1-727b-4d35-b766-c0e213a1c588 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:48.101526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef183f1-727b-4d35-b766-c0e213a1c588 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:48.118887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 442/873] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:48.120264 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889b3a6-ba5b-4df2-bf43-9c572c530776 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:48.132215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef183f1-727b-4d35-b766-c0e213a1c588 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:48.152708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:48.248759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef183f1-727b-4d35-b766-c0e213a1c588 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:48.250579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889b3a6-ba5b-4df2-bf43-9c572c530776 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:48.286586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0ab02-c7c1-4309-ae6e-540a27044679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:48.286793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb959dee-2b53-4cef-9f33-36f71b99fcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:48.287199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0ab02-c7c1-4309-ae6e-540a27044679 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:48.287305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb959dee-2b53-4cef-9f33-36f71b99fcfd None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:48.287474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0ab02-c7c1-4309-ae6e-540a27044679 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:48.287571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb959dee-2b53-4cef-9f33-36f71b99fcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:48.287742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0ab02-c7c1-4309-ae6e-540a27044679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:48.287848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb959dee-2b53-4cef-9f33-36f71b99fcfd None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:48.288460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb959dee-2b53-4cef-9f33-36f71b99fcfd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:48.288555 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0ab02-c7c1-4309-ae6e-540a27044679 None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=347ab0ce405c4deba9295d5395cb1d6e) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:48.288816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0ab02-c7c1-4309-ae6e-540a27044679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:48.289835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb959dee-2b53-4cef-9f33-36f71b99fcfd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:48.290282 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0ab02-c7c1-4309-ae6e-540a27044679 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:48.296446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 432/874] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:48 2022] GET /identity/v3/role_assignments?user.id=347ab0ce405c4deba9295d5395cb1d6e&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:48.296446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0ab02-c7c1-4309-ae6e-540a27044679 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:48.399275 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 443/875] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:14:48 2022] POST /identity/v3/services => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:14:48.414743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:48.427339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0ab02-c7c1-4309-ae6e-540a27044679 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:48.480053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312c77d-023b-4f1c-9612-92ef2a0e7b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:48.480824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312c77d-023b-4f1c-9612-92ef2a0e7b29 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:48.481103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312c77d-023b-4f1c-9612-92ef2a0e7b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:48.481376 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312c77d-023b-4f1c-9612-92ef2a0e7b29 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:48.482044 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312c77d-023b-4f1c-9612-92ef2a0e7b29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:48.483428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312c77d-023b-4f1c-9612-92ef2a0e7b29 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:48.593579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 433/876] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:14:48 2022] POST /identity/v3/services => generated 269 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:14:49.189625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7082356-9ea2-4027-919d-35b74f03adf6 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:49.190122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7082356-9ea2-4027-919d-35b74f03adf6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:49.190122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7082356-9ea2-4027-919d-35b74f03adf6 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:49.191614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 444/877] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:49.197347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2493a2-1460-4711-ad75-13e1bb43479b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:49.197753 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2493a2-1460-4711-ad75-13e1bb43479b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:49.197940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2493a2-1460-4711-ad75-13e1bb43479b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:49.216833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4e2493a2-1460-4711-ad75-13e1bb43479b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:49.218003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4e2493a2-1460-4711-ad75-13e1bb43479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:49.290763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 434/878] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:14:49.565876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7082356-9ea2-4027-919d-35b74f03adf6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:49.598143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:49.670976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7082356-9ea2-4027-919d-35b74f03adf6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:49.706537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3e64-a8c2-427a-872b-97ef21229622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:49.707171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3e64-a8c2-427a-872b-97ef21229622 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:49.707451 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3e64-a8c2-427a-872b-97ef21229622 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:49.707753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3e64-a8c2-427a-872b-97ef21229622 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:49.708366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f3e64-a8c2-427a-872b-97ef21229622 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:49.709712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f3e64-a8c2-427a-872b-97ef21229622 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-909f3e64-a8c2-427a-872b-97ef21229622 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:49.719602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:49.720887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:49.721730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 445/879] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 10:14:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:49.726738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2493a2-1460-4711-ad75-13e1bb43479b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:49.794988 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:49.824342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2493a2-1460-4711-ad75-13e1bb43479b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:49.859855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b17c84-c907-46ce-88ba-1faa48f05d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:49.860540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b17c84-c907-46ce-88ba-1faa48f05d89 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:49.860872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b17c84-c907-46ce-88ba-1faa48f05d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:49.861140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b17c84-c907-46ce-88ba-1faa48f05d89 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:49.861793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b17c84-c907-46ce-88ba-1faa48f05d89 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:49.862087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b17c84-c907-46ce-88ba-1faa48f05d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:49.863430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b17c84-c907-46ce-88ba-1faa48f05d89 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:49.869398 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 435/880] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 10:14:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:49.874970 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3e64-a8c2-427a-872b-97ef21229622 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:49.981806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:49.987655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3e64-a8c2-427a-872b-97ef21229622 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:50.022088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab093d5-04a5-4113-b423-613caa822f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:50.022699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab093d5-04a5-4113-b423-613caa822f11 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:50.022976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab093d5-04a5-4113-b423-613caa822f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:50.023253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab093d5-04a5-4113-b423-613caa822f11 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:50.023884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab093d5-04a5-4113-b423-613caa822f11 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:50.024744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab093d5-04a5-4113-b423-613caa822f11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:50.026094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab093d5-04a5-4113-b423-613caa822f11 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:50.030987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 446/881] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 10:14:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:50.623682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7a4ac-4e7f-4e67-9680-01b182adece1 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:50.624678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7a4ac-4e7f-4e67-9680-01b182adece1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:50.625185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7a4ac-4e7f-4e67-9680-01b182adece1 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:50.626984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 436/882] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:50.632390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c860cae-0ecc-4d7d-8cff-a24a51b5ec3d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:50.633192 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c860cae-0ecc-4d7d-8cff-a24a51b5ec3d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:50.633702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c860cae-0ecc-4d7d-8cff-a24a51b5ec3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:50.641420 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750f203-e7f9-4959-b560-a074cb6bc031 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:50.641710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750f203-e7f9-4959-b560-a074cb6bc031 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:50.641983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750f203-e7f9-4959-b560-a074cb6bc031 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:50.643516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 437/883] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:14:50.648335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e7302-93e0-419b-83bb-f62080648f95 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:50.648619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e7302-93e0-419b-83bb-f62080648f95 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:50.648892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e7302-93e0-419b-83bb-f62080648f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:50.654590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5c860cae-0ecc-4d7d-8cff-a24a51b5ec3d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:50.657125 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5c860cae-0ecc-4d7d-8cff-a24a51b5ec3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:50.667242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-575e7302-93e0-419b-83bb-f62080648f95 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:50.668444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-575e7302-93e0-419b-83bb-f62080648f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:50.739976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 447/884] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:50.746489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 438/885] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:14:50.888803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509c65e-aba4-4711-98bc-08c1a51a5515 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:50.889138 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509c65e-aba4-4711-98bc-08c1a51a5515 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:50.889259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509c65e-aba4-4711-98bc-08c1a51a5515 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:50.890849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 448/886] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:50.896041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c52f2-b073-46e8-85c4-88eff703a3cc None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:50.896333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c52f2-b073-46e8-85c4-88eff703a3cc None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:50.896609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c52f2-b073-46e8-85c4-88eff703a3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:50.927190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f26c52f2-b073-46e8-85c4-88eff703a3cc None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:50.928420 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f26c52f2-b073-46e8-85c4-88eff703a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:50.989098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:50.998556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 439/887] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:51.016893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509c65e-aba4-4711-98bc-08c1a51a5515 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:51.032149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c52f2-b073-46e8-85c4-88eff703a3cc None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:51.114131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:51.130737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509c65e-aba4-4711-98bc-08c1a51a5515 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:51.160522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c52f2-b073-46e8-85c4-88eff703a3cc None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:51.169367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe02a44-e2ed-480c-bed1-c2163fb83ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:51.170002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe02a44-e2ed-480c-bed1-c2163fb83ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:51.170281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe02a44-e2ed-480c-bed1-c2163fb83ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:51.170552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe02a44-e2ed-480c-bed1-c2163fb83ee7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:51.183764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe02a44-e2ed-480c-bed1-c2163fb83ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ffe02a44-e2ed-480c-bed1-c2163fb83ee7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:51.188636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:51.189629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:51.195536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 449/888] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Oct 4 10:14:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:51.198467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe02a44-e2ed-480c-bed1-c2163fb83ee7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:51.214049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435fa77-9ef6-40bb-b6cd-9e18df2b79ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:51.214504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435fa77-9ef6-40bb-b6cd-9e18df2b79ab None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:51.214785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435fa77-9ef6-40bb-b6cd-9e18df2b79ab None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:51.215115 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435fa77-9ef6-40bb-b6cd-9e18df2b79ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:51.216090 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435fa77-9ef6-40bb-b6cd-9e18df2b79ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:51.217412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435fa77-9ef6-40bb-b6cd-9e18df2b79ab None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-0435fa77-9ef6-40bb-b6cd-9e18df2b79ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:51.226966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:51.228179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:51.229405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 440/889] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:14:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:51.234239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435fa77-9ef6-40bb-b6cd-9e18df2b79ab None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:51.301772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:51.312993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe02a44-e2ed-480c-bed1-c2163fb83ee7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:51.349109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435fa77-9ef6-40bb-b6cd-9e18df2b79ab None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:51.350069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0710b10-a6f3-4545-9d22-5a450e77342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:51.350704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0710b10-a6f3-4545-9d22-5a450e77342c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:51.350948 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0710b10-a6f3-4545-9d22-5a450e77342c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:51.351217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0710b10-a6f3-4545-9d22-5a450e77342c None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:51.353060 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0710b10-a6f3-4545-9d22-5a450e77342c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:51.353060 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0710b10-a6f3-4545-9d22-5a450e77342c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:51.354191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0710b10-a6f3-4545-9d22-5a450e77342c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:51.363035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 450/890] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 10:14:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:51.365431 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0710b10-a6f3-4545-9d22-5a450e77342c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:51.382862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:51.385427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3f326-7611-4191-bc70-d8c5c30c2555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:51.386087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3f326-7611-4191-bc70-d8c5c30c2555 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:51.386368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3f326-7611-4191-bc70-d8c5c30c2555 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:51.386642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3f326-7611-4191-bc70-d8c5c30c2555 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:51.387313 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3f326-7611-4191-bc70-d8c5c30c2555 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:51.387619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3f326-7611-4191-bc70-d8c5c30c2555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:51.389018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3f326-7611-4191-bc70-d8c5c30c2555 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:51.398481 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 441/891] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:14:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:51.399710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3f326-7611-4191-bc70-d8c5c30c2555 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:51.473915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0710b10-a6f3-4545-9d22-5a450e77342c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:51.505299 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3f326-7611-4191-bc70-d8c5c30c2555 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:51.512696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f7489-fa3e-4ed9-9238-10fb8cabad39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:51.515557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f7489-fa3e-4ed9-9238-10fb8cabad39 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:51.515557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f7489-fa3e-4ed9-9238-10fb8cabad39 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:51.515557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f7489-fa3e-4ed9-9238-10fb8cabad39 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:51.515557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f7489-fa3e-4ed9-9238-10fb8cabad39 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:51.515860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f7489-fa3e-4ed9-9238-10fb8cabad39 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ef4f7489-fa3e-4ed9-9238-10fb8cabad39 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:51.524625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:51.528047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:51.529079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 451/892] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Oct 4 10:14:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:51.529913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f7489-fa3e-4ed9-9238-10fb8cabad39 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:51.537372 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:51.548434 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc02edf-9fde-43a4-8eec-f5787f6a2f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:51.563552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc02edf-9fde-43a4-8eec-f5787f6a2f6e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:51.563552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc02edf-9fde-43a4-8eec-f5787f6a2f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:51.563552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc02edf-9fde-43a4-8eec-f5787f6a2f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:51.563552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc02edf-9fde-43a4-8eec-f5787f6a2f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:51.563552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc02edf-9fde-43a4-8eec-f5787f6a2f6e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-6cc02edf-9fde-43a4-8eec-f5787f6a2f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:51.576538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:51.577556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:51.578498 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:51.578498 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:51.578498 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:51.578498 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 442/893] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:51.578498 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc02edf-9fde-43a4-8eec-f5787f6a2f6e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:51.616706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:51.640408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f7489-fa3e-4ed9-9238-10fb8cabad39 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:51.679201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe7a99-0cff-426c-98e0-5a1f407d90f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:51.679794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe7a99-0cff-426c-98e0-5a1f407d90f1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:51.680102 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe7a99-0cff-426c-98e0-5a1f407d90f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:51.680371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe7a99-0cff-426c-98e0-5a1f407d90f1 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:51.681561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe7a99-0cff-426c-98e0-5a1f407d90f1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:51.681869 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe7a99-0cff-426c-98e0-5a1f407d90f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:51.683209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe7a99-0cff-426c-98e0-5a1f407d90f1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:51.688120 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc02edf-9fde-43a4-8eec-f5787f6a2f6e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:51.688596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 452/894] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:14:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:51.692817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe7a99-0cff-426c-98e0-5a1f407d90f1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:51.722782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee12e6-1a9d-4f10-98ed-abdcec62dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:51.723391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee12e6-1a9d-4f10-98ed-abdcec62dd3f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:51.723674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee12e6-1a9d-4f10-98ed-abdcec62dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:51.724012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee12e6-1a9d-4f10-98ed-abdcec62dd3f None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:51.724599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee12e6-1a9d-4f10-98ed-abdcec62dd3f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:51.724898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee12e6-1a9d-4f10-98ed-abdcec62dd3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:51.726292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee12e6-1a9d-4f10-98ed-abdcec62dd3f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:51.732008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 443/895] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 10:14:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:51.732731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee12e6-1a9d-4f10-98ed-abdcec62dd3f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:51.776526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:51.808627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe7a99-0cff-426c-98e0-5a1f407d90f1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:51.838365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee12e6-1a9d-4f10-98ed-abdcec62dd3f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:51.844581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f785f98-cde7-4089-8966-49785b2d7e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:51.845186 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f785f98-cde7-4089-8966-49785b2d7e75 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:51.845464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f785f98-cde7-4089-8966-49785b2d7e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:51.845729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f785f98-cde7-4089-8966-49785b2d7e75 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:51.846364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f785f98-cde7-4089-8966-49785b2d7e75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:51.846665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f785f98-cde7-4089-8966-49785b2d7e75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:51.848161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f785f98-cde7-4089-8966-49785b2d7e75 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:51.857932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:51.861387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 453/896] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:51.862208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f785f98-cde7-4089-8966-49785b2d7e75 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:51.879237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7ac06-ff83-4e98-82fd-a268cac15b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:51.879848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7ac06-ff83-4e98-82fd-a268cac15b89 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:51.880154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7ac06-ff83-4e98-82fd-a268cac15b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:51.880440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7ac06-ff83-4e98-82fd-a268cac15b89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:51.881131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7ac06-ff83-4e98-82fd-a268cac15b89 None admin] RBAC: Adding query filter params (interface=public, service_id=7c510932b5b8447499d1f16c74346506, region_id=RegionOne) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:51.881503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7ac06-ff83-4e98-82fd-a268cac15b89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:51.882860 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7ac06-ff83-4e98-82fd-a268cac15b89 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:51.891083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 444/897] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 10:14:51 2022] GET /identity/v3/endpoints?service_id=7c510932b5b8447499d1f16c74346506&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:51.896291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7ac06-ff83-4e98-82fd-a268cac15b89 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:51.973834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f785f98-cde7-4089-8966-49785b2d7e75 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:52.002113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7ac06-ff83-4e98-82fd-a268cac15b89 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:52.005477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:52.010119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612e953-c85f-48e4-90a9-4fca95b1c178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:52.010731 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612e953-c85f-48e4-90a9-4fca95b1c178 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:52.011005 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612e953-c85f-48e4-90a9-4fca95b1c178 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:52.011274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612e953-c85f-48e4-90a9-4fca95b1c178 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:52.011906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612e953-c85f-48e4-90a9-4fca95b1c178 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:52.012235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612e953-c85f-48e4-90a9-4fca95b1c178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:52.013584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612e953-c85f-48e4-90a9-4fca95b1c178 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:52.018535 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 454/898] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 10:14:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:52.023884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612e953-c85f-48e4-90a9-4fca95b1c178 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:52.039539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99daee-e76a-4dc4-a61f-85cd437f0c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:52.040475 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99daee-e76a-4dc4-a61f-85cd437f0c66 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:52.040832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99daee-e76a-4dc4-a61f-85cd437f0c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:52.041165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99daee-e76a-4dc4-a61f-85cd437f0c66 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:52.049122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99daee-e76a-4dc4-a61f-85cd437f0c66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:52.050626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99daee-e76a-4dc4-a61f-85cd437f0c66 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-5f99daee-e76a-4dc4-a61f-85cd437f0c66 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:52.063212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:52.064566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:52.065912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:52.065912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:52.065912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:52.065912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:52.065912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:52.065912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:52.065912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:52.065912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:52.065912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 10:14:52.065912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:52.065912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 445/899] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 10:14:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:52.066692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99daee-e76a-4dc4-a61f-85cd437f0c66 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:52.094102 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:52.144403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612e953-c85f-48e4-90a9-4fca95b1c178 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:52.177492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99daee-e76a-4dc4-a61f-85cd437f0c66 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:52.183088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2886575-19ad-4566-a6ef-8f7ec621c117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:52.183693 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2886575-19ad-4566-a6ef-8f7ec621c117 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:52.183992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2886575-19ad-4566-a6ef-8f7ec621c117 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:52.184264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2886575-19ad-4566-a6ef-8f7ec621c117 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:52.184882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2886575-19ad-4566-a6ef-8f7ec621c117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:52.186224 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2886575-19ad-4566-a6ef-8f7ec621c117 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:52.192629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 455/900] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 10:14:52 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:14:52.197825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2886575-19ad-4566-a6ef-8f7ec621c117 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:52.219785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196454b1-4683-4d9c-aa9d-3308da74b8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:52.220600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196454b1-4683-4d9c-aa9d-3308da74b8cf None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:52.220976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196454b1-4683-4d9c-aa9d-3308da74b8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:52.221515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196454b1-4683-4d9c-aa9d-3308da74b8cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:52.222168 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196454b1-4683-4d9c-aa9d-3308da74b8cf None admin] RBAC: Adding query filter params (interface=public, service_id=d3889e1cf87a4aa2882176e3a435f697, region_id=RegionOne) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:52.222630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196454b1-4683-4d9c-aa9d-3308da74b8cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:52.224122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196454b1-4683-4d9c-aa9d-3308da74b8cf None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:52.232176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 446/901] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 10:14:52 2022] GET /identity/v3/endpoints?service_id=d3889e1cf87a4aa2882176e3a435f697&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:52.232176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529a9a7-d16a-4ed6-b4a6-25118a75f11d None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:52.232512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529a9a7-d16a-4ed6-b4a6-25118a75f11d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:52.232880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529a9a7-d16a-4ed6-b4a6-25118a75f11d None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:52.234650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 447/902] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:52.235852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529a9a7-d16a-4ed6-b4a6-25118a75f11d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:52.273093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:52.321896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2886575-19ad-4566-a6ef-8f7ec621c117 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:52.354806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:52.357266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529a9a7-d16a-4ed6-b4a6-25118a75f11d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:52.363744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca03e43-2d60-4fbf-9fbe-a3e4f1240bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:52.369940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03e43-2d60-4fbf-9fbe-a3e4f1240bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:52.369940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03e43-2d60-4fbf-9fbe-a3e4f1240bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:52.369940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03e43-2d60-4fbf-9fbe-a3e4f1240bf0 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:52.369940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca03e43-2d60-4fbf-9fbe-a3e4f1240bf0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:52.369940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca03e43-2d60-4fbf-9fbe-a3e4f1240bf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:52.369940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca03e43-2d60-4fbf-9fbe-a3e4f1240bf0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:52.391409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 456/903] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Oct 4 10:14:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:52.392784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b04b21-d27d-48d2-8cf6-9cbf421e3f8c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:52.392784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b04b21-d27d-48d2-8cf6-9cbf421e3f8c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:52.393000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b04b21-d27d-48d2-8cf6-9cbf421e3f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:52.397794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252321b-c084-48c1-abbc-0c2122b93ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:52.398509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252321b-c084-48c1-abbc-0c2122b93ecf None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:52.398893 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252321b-c084-48c1-abbc-0c2122b93ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:52.399282 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252321b-c084-48c1-abbc-0c2122b93ecf None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:52.400013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252321b-c084-48c1-abbc-0c2122b93ecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:52.401571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252321b-c084-48c1-abbc-0c2122b93ecf None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:52.409350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 448/904] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 10:14:52 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:14:52.409350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252321b-c084-48c1-abbc-0c2122b93ecf None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:52.411351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f5b04b21-d27d-48d2-8cf6-9cbf421e3f8c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:52.412595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f5b04b21-d27d-48d2-8cf6-9cbf421e3f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:52.522572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 457/905] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:52.541468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:52.551203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252321b-c084-48c1-abbc-0c2122b93ecf None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:52.590775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e717c55-63c5-42c7-ad53-7a7a0a03773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:52.591487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e717c55-63c5-42c7-ad53-7a7a0a03773f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:52.591845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e717c55-63c5-42c7-ad53-7a7a0a03773f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:52.592212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e717c55-63c5-42c7-ad53-7a7a0a03773f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:52.664425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e717c55-63c5-42c7-ad53-7a7a0a03773f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:52.665913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e717c55-63c5-42c7-ad53-7a7a0a03773f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:52.760537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:52.770298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 449/906] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:14:52 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:14:52.781063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b04b21-d27d-48d2-8cf6-9cbf421e3f8c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:52.819128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e717c55-63c5-42c7-ad53-7a7a0a03773f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:52.889257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b04b21-d27d-48d2-8cf6-9cbf421e3f8c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:52.920942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:52.941283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e717c55-63c5-42c7-ad53-7a7a0a03773f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:52.941600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d896730-dc24-4ef6-9012-133f906da1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:52.942182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d896730-dc24-4ef6-9012-133f906da1ef None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:52.942461 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d896730-dc24-4ef6-9012-133f906da1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:52.942730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d896730-dc24-4ef6-9012-133f906da1ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:52.955968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d896730-dc24-4ef6-9012-133f906da1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:52.957780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d896730-dc24-4ef6-9012-133f906da1ef None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3d896730-dc24-4ef6-9012-133f906da1ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:52.975282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:52.976541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:52.977744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:52.977744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:52.977744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:52.980130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 458/907] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:52.985527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d896730-dc24-4ef6-9012-133f906da1ef None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:52.990576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e3699-d877-43a8-86be-ab5f9e39ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:52.991403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3699-d877-43a8-86be-ab5f9e39ea43 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:52.991827 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3699-d877-43a8-86be-ab5f9e39ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:52.992269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3699-d877-43a8-86be-ab5f9e39ea43 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:52.993622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e3699-d877-43a8-86be-ab5f9e39ea43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:52.995128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e3699-d877-43a8-86be-ab5f9e39ea43 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:53.071919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 450/908] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:14:52 2022] POST /identity/v3/services => generated 241 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:14:53.098181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d896730-dc24-4ef6-9012-133f906da1ef None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:53.147838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706703ac-0474-421f-94fc-fbc0abd7fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:53.148960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706703ac-0474-421f-94fc-fbc0abd7fe6c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:53.149441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706703ac-0474-421f-94fc-fbc0abd7fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:53.149875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706703ac-0474-421f-94fc-fbc0abd7fe6c None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:53.150679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706703ac-0474-421f-94fc-fbc0abd7fe6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:53.151132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706703ac-0474-421f-94fc-fbc0abd7fe6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:53.152757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706703ac-0474-421f-94fc-fbc0abd7fe6c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:53.167669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 459/909] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:53.173542 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e3699-d877-43a8-86be-ab5f9e39ea43 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:53.239855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:53.290832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e3699-d877-43a8-86be-ab5f9e39ea43 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:53.326156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81f1d1-b365-4dde-9cf7-9119de0800fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:53.326713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81f1d1-b365-4dde-9cf7-9119de0800fa None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:53.326988 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81f1d1-b365-4dde-9cf7-9119de0800fa None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:53.327257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81f1d1-b365-4dde-9cf7-9119de0800fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:53.334297 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81f1d1-b365-4dde-9cf7-9119de0800fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:53.335757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81f1d1-b365-4dde-9cf7-9119de0800fa None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-3c81f1d1-b365-4dde-9cf7-9119de0800fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:53.348626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:53.349635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:53.350541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:53.350541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:53.350541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:53.350541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:53.350541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:53.350541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:53.350541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:53.350541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:53.354575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 451/910] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:53.356835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706703ac-0474-421f-94fc-fbc0abd7fe6c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:53.383459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:53.462350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706703ac-0474-421f-94fc-fbc0abd7fe6c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:53.498777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44aaf7-c1d7-4250-9660-363ae7fe0a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:53.499748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44aaf7-c1d7-4250-9660-363ae7fe0a00 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:53.500267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44aaf7-c1d7-4250-9660-363ae7fe0a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:53.500770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44aaf7-c1d7-4250-9660-363ae7fe0a00 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:53.501666 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44aaf7-c1d7-4250-9660-363ae7fe0a00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:53.502172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44aaf7-c1d7-4250-9660-363ae7fe0a00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:53.503772 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44aaf7-c1d7-4250-9660-363ae7fe0a00 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:53.516668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 460/911] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:53.522530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81f1d1-b365-4dde-9cf7-9119de0800fa None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:53.628832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81f1d1-b365-4dde-9cf7-9119de0800fa None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:53.641855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:53.666983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44725d48-7367-4c9f-ab50-3af481cbd59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:53.667596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44725d48-7367-4c9f-ab50-3af481cbd59d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:53.667870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44725d48-7367-4c9f-ab50-3af481cbd59d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:53.668202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44725d48-7367-4c9f-ab50-3af481cbd59d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:53.668926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44725d48-7367-4c9f-ab50-3af481cbd59d None admin] RBAC: Adding query filter params (role.id=cb1326f1ee04493da8934ae44875422d, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=347ab0ce405c4deba9295d5395cb1d6e) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:53.669226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44725d48-7367-4c9f-ab50-3af481cbd59d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:53.670637 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44725d48-7367-4c9f-ab50-3af481cbd59d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:53.676804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 452/912] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:14:53 2022] GET /identity/v3/role_assignments?user.id=347ab0ce405c4deba9295d5395cb1d6e&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=cb1326f1ee04493da8934ae44875422d => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:54.455317 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f8be9-8fbe-46dd-a764-761ca2ae7c08 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:54.456393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f8be9-8fbe-46dd-a764-761ca2ae7c08 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:54.456900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f8be9-8fbe-46dd-a764-761ca2ae7c08 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:54.458693 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 461/913] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:54.464646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bd1b2-ae8e-4f0e-af20-992b829626c3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:54.465729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bd1b2-ae8e-4f0e-af20-992b829626c3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:54.466219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bd1b2-ae8e-4f0e-af20-992b829626c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:54.485073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-313bd1b2-ae8e-4f0e-af20-992b829626c3 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:54.486568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-313bd1b2-ae8e-4f0e-af20-992b829626c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:54.570851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 453/914] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:54.625323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7857d-3a5b-4f71-8d8b-154de82fbf9c None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:54.625618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7857d-3a5b-4f71-8d8b-154de82fbf9c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:54.625866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7857d-3a5b-4f71-8d8b-154de82fbf9c None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:54.627436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 462/915] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:54.632536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a8f4b-5142-4daa-b8ac-de1fc7acc72a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:54.633036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a8f4b-5142-4daa-b8ac-de1fc7acc72a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:54.634065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a8f4b-5142-4daa-b8ac-de1fc7acc72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:54.652591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-583a8f4b-5142-4daa-b8ac-de1fc7acc72a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:54.654067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-583a8f4b-5142-4daa-b8ac-de1fc7acc72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:54.730488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 454/916] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:54.843728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7857d-3a5b-4f71-8d8b-154de82fbf9c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:54.939671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:54.957240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7857d-3a5b-4f71-8d8b-154de82fbf9c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:54.994202 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2144b-f0e0-4b4c-8bc8-ffdb73a3310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:54.994756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2144b-f0e0-4b4c-8bc8-ffdb73a3310c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:54.994865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a8f4b-5142-4daa-b8ac-de1fc7acc72a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:54.995089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2144b-f0e0-4b4c-8bc8-ffdb73a3310c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:54.995368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2144b-f0e0-4b4c-8bc8-ffdb73a3310c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:54.995977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2144b-f0e0-4b4c-8bc8-ffdb73a3310c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:54.997454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2144b-f0e0-4b4c-8bc8-ffdb73a3310c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-dcc2144b-f0e0-4b4c-8bc8-ffdb73a3310c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:55.006825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:55.008084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:55.009154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 463/917] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:14:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:55.014604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2144b-f0e0-4b4c-8bc8-ffdb73a3310c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:55.036124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:55.128386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a8f4b-5142-4daa-b8ac-de1fc7acc72a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:55.135844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2144b-f0e0-4b4c-8bc8-ffdb73a3310c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:55.174495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6981f6-39d1-40f9-982f-42411e969895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:55.175049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294210f-2171-468c-b5ac-4fab94a7dac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:55.175688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294210f-2171-468c-b5ac-4fab94a7dac8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:55.175929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6981f6-39d1-40f9-982f-42411e969895 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:55.176068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294210f-2171-468c-b5ac-4fab94a7dac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:55.176248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294210f-2171-468c-b5ac-4fab94a7dac8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:55.176705 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6981f6-39d1-40f9-982f-42411e969895 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:55.176807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294210f-2171-468c-b5ac-4fab94a7dac8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:55.177249 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6981f6-39d1-40f9-982f-42411e969895 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:55.178058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6981f6-39d1-40f9-982f-42411e969895 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:55.178161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294210f-2171-468c-b5ac-4fab94a7dac8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:55.178670 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6981f6-39d1-40f9-982f-42411e969895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:55.180212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6981f6-39d1-40f9-982f-42411e969895 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:55.185719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 464/918] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:14:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-3294210f-2171-468c-b5ac-4fab94a7dac8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:55.196079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:55.197100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:55.198204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 455/919] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Oct 4 10:14:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:55.199487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6981f6-39d1-40f9-982f-42411e969895 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:55.199576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294210f-2171-468c-b5ac-4fab94a7dac8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:55.218017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:55.311128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:55.314897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294210f-2171-468c-b5ac-4fab94a7dac8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:55.339219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6981f6-39d1-40f9-982f-42411e969895 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:55.360712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da4640-8186-4250-9143-2a7003a48120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:55.361692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da4640-8186-4250-9143-2a7003a48120 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:55.362033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da4640-8186-4250-9143-2a7003a48120 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:55.362307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da4640-8186-4250-9143-2a7003a48120 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:55.362942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da4640-8186-4250-9143-2a7003a48120 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:55.363241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da4640-8186-4250-9143-2a7003a48120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:55.364697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da4640-8186-4250-9143-2a7003a48120 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:55.375869 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 456/920] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 10:14:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:55.377191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931a6fd-ba70-4ad9-b8b6-78e6eae4c278 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:55.377511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931a6fd-ba70-4ad9-b8b6-78e6eae4c278 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:55.377766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931a6fd-ba70-4ad9-b8b6-78e6eae4c278 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:55.379004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 457/921] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:55.379665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931a6fd-ba70-4ad9-b8b6-78e6eae4c278 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:55.384944 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77800fd8-ede1-4ae3-906f-2cc6e120a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:55.385561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800fd8-ede1-4ae3-906f-2cc6e120a26a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:55.385836 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800fd8-ede1-4ae3-906f-2cc6e120a26a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:55.386107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800fd8-ede1-4ae3-906f-2cc6e120a26a None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:55.386745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77800fd8-ede1-4ae3-906f-2cc6e120a26a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:55.387046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77800fd8-ede1-4ae3-906f-2cc6e120a26a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:55.388416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77800fd8-ede1-4ae3-906f-2cc6e120a26a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:55.393716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 465/922] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 10:14:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:55.397338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5cc0a-2b07-4eda-8d28-9ff85f982431 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:55.397843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5cc0a-2b07-4eda-8d28-9ff85f982431 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:55.398356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5cc0a-2b07-4eda-8d28-9ff85f982431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:55.418916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-46c5cc0a-2b07-4eda-8d28-9ff85f982431 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:55.420113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-46c5cc0a-2b07-4eda-8d28-9ff85f982431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:55.487907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931a6fd-ba70-4ad9-b8b6-78e6eae4c278 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:55.490834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 466/923] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:55.491299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5cc0a-2b07-4eda-8d28-9ff85f982431 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:55.499611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:55.539677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62755b1-877e-4cee-ace5-e62b177ecfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:55.540898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62755b1-877e-4cee-ace5-e62b177ecfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:55.541172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62755b1-877e-4cee-ace5-e62b177ecfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:55.541435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62755b1-877e-4cee-ace5-e62b177ecfd7 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:55.542060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62755b1-877e-4cee-ace5-e62b177ecfd7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:55.542358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62755b1-877e-4cee-ace5-e62b177ecfd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:55.543707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62755b1-877e-4cee-ace5-e62b177ecfd7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:55.549477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 458/924] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 10:14:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:55.559736 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62755b1-877e-4cee-ace5-e62b177ecfd7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:55.596983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:55.622771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5cc0a-2b07-4eda-8d28-9ff85f982431 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:55.661904 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081b55d-66ae-49fc-ba57-703701cb0c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:55.662609 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081b55d-66ae-49fc-ba57-703701cb0c48 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:55.662966 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081b55d-66ae-49fc-ba57-703701cb0c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:55.663305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081b55d-66ae-49fc-ba57-703701cb0c48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:55.664065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081b55d-66ae-49fc-ba57-703701cb0c48 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:55.665985 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081b55d-66ae-49fc-ba57-703701cb0c48 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:55.689170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62755b1-877e-4cee-ace5-e62b177ecfd7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:55.725897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767625eb-8eda-4732-a4ba-5fb502861244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:55.726567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767625eb-8eda-4732-a4ba-5fb502861244 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:55.726771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767625eb-8eda-4732-a4ba-5fb502861244 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:55.727094 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767625eb-8eda-4732-a4ba-5fb502861244 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:55.727789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767625eb-8eda-4732-a4ba-5fb502861244 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:55.729300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767625eb-8eda-4732-a4ba-5fb502861244 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:55.736477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 467/925] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:14:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:14:55.771899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081b55d-66ae-49fc-ba57-703701cb0c48 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:55.815643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 459/926] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:14:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:14:55.852227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:55.863824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92a853-ff87-4684-a58d-3bf0f7769af4 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:55.870479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92a853-ff87-4684-a58d-3bf0f7769af4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:55.870479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92a853-ff87-4684-a58d-3bf0f7769af4 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:55.870479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 460/927] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:14:55.872728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5181d7-6500-417f-8a3c-277f8fddfeb3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:55.873012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5181d7-6500-417f-8a3c-277f8fddfeb3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:55.873286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5181d7-6500-417f-8a3c-277f8fddfeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:55.897238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6e5181d7-6500-417f-8a3c-277f8fddfeb3 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:55.902363 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6e5181d7-6500-417f-8a3c-277f8fddfeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:55.916657 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081b55d-66ae-49fc-ba57-703701cb0c48 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:55.976205 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebfd45-2230-4254-ac0f-73c7d0edeb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:55.976886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebfd45-2230-4254-ac0f-73c7d0edeb81 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:55.977239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebfd45-2230-4254-ac0f-73c7d0edeb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:55.978063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebfd45-2230-4254-ac0f-73c7d0edeb81 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:55.978664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebfd45-2230-4254-ac0f-73c7d0edeb81 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:55.980474 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebfd45-2230-4254-ac0f-73c7d0edeb81 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d1ebfd45-2230-4254-ac0f-73c7d0edeb81 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:55.991564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:55.992843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:55.994077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 468/928] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 10:14:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:55.998899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebfd45-2230-4254-ac0f-73c7d0edeb81 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:56.015992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 461/929] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:56.110260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebfd45-2230-4254-ac0f-73c7d0edeb81 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:56.127024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:56.143893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f284ff2-51a7-4319-8193-ac6f33849e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:56.144783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f284ff2-51a7-4319-8193-ac6f33849e8e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:56.144783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f284ff2-51a7-4319-8193-ac6f33849e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:56.145046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f284ff2-51a7-4319-8193-ac6f33849e8e None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:56.145683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f284ff2-51a7-4319-8193-ac6f33849e8e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:56.145981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f284ff2-51a7-4319-8193-ac6f33849e8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:56.147330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f284ff2-51a7-4319-8193-ac6f33849e8e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:56.152538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 469/930] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 10:14:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:56.158127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5181d7-6500-417f-8a3c-277f8fddfeb3 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:56.174521 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:56.263629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5181d7-6500-417f-8a3c-277f8fddfeb3 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:56.296481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f284ff2-51a7-4319-8193-ac6f33849e8e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:56.300022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3950bc7-98f3-43c3-b44c-be7452a838cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:56.300834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3950bc7-98f3-43c3-b44c-be7452a838cd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:56.301322 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3950bc7-98f3-43c3-b44c-be7452a838cd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:56.301739 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3950bc7-98f3-43c3-b44c-be7452a838cd None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:56.302530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3950bc7-98f3-43c3-b44c-be7452a838cd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:56.302976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3950bc7-98f3-43c3-b44c-be7452a838cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:56.304582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3950bc7-98f3-43c3-b44c-be7452a838cd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:56.310449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 462/931] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 10:14:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:56.316427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3950bc7-98f3-43c3-b44c-be7452a838cd None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:56.399514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:56.423216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3950bc7-98f3-43c3-b44c-be7452a838cd None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:56.423743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f284ff2-51a7-4319-8193-ac6f33849e8e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:56.465018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04990ca-395c-444f-a73f-50211fa06972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:56.465936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04990ca-395c-444f-a73f-50211fa06972 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:56.466214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04990ca-395c-444f-a73f-50211fa06972 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:56.466482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04990ca-395c-444f-a73f-50211fa06972 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:56.467033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5dc07-031e-47eb-a8a7-3d4b512d0a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:56.467167 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04990ca-395c-444f-a73f-50211fa06972 None admin] RBAC: Adding query filter params (interface=public, service_id=6efecd63fdf24a84864445e4874e3e4a, region_id=RegionOne) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:56.467539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04990ca-395c-444f-a73f-50211fa06972 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:56.467641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5dc07-031e-47eb-a8a7-3d4b512d0a52 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:56.467920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5dc07-031e-47eb-a8a7-3d4b512d0a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:56.468285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5dc07-031e-47eb-a8a7-3d4b512d0a52 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:56.469028 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04990ca-395c-444f-a73f-50211fa06972 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:56.475421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 463/932] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 10:14:56 2022] GET /identity/v3/endpoints?service_id=6efecd63fdf24a84864445e4874e3e4a&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:56.478919 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5dc07-031e-47eb-a8a7-3d4b512d0a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:14:56.480434 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04990ca-395c-444f-a73f-50211fa06972 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-43a5dc07-031e-47eb-a8a7-3d4b512d0a52 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:14:56.484865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:56.490839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:56.492517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 470/933] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Oct 4 10:14:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:56.494533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5dc07-031e-47eb-a8a7-3d4b512d0a52 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:56.549712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:56.597815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04990ca-395c-444f-a73f-50211fa06972 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:56.626285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5dc07-031e-47eb-a8a7-3d4b512d0a52 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:56.641147 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8547e-432c-43ba-a696-81088f8c1c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:56.642277 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8547e-432c-43ba-a696-81088f8c1c3b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:56.643781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8547e-432c-43ba-a696-81088f8c1c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:56.644366 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8547e-432c-43ba-a696-81088f8c1c3b None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:56.645186 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8547e-432c-43ba-a696-81088f8c1c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:56.646843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8547e-432c-43ba-a696-81088f8c1c3b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:56.655640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 464/934] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 10:14:56 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:14:56.670403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b573011-2f8c-4726-b4da-d5d65b770623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:56.671035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b573011-2f8c-4726-b4da-d5d65b770623 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:56.671308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b573011-2f8c-4726-b4da-d5d65b770623 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:56.671575 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b573011-2f8c-4726-b4da-d5d65b770623 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:56.672299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b573011-2f8c-4726-b4da-d5d65b770623 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:56.672600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b573011-2f8c-4726-b4da-d5d65b770623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:56.673999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b573011-2f8c-4726-b4da-d5d65b770623 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:56.684527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 471/935] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 10:14:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:56.690272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8547e-432c-43ba-a696-81088f8c1c3b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:56.701314 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:56.808819 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8547e-432c-43ba-a696-81088f8c1c3b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:56.845129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a86ef-30ae-436b-973e-71a991a43717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:56.845757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a86ef-30ae-436b-973e-71a991a43717 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:56.846031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a86ef-30ae-436b-973e-71a991a43717 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:56.846299 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a86ef-30ae-436b-973e-71a991a43717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:56.857903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a86ef-30ae-436b-973e-71a991a43717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:56.859352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a86ef-30ae-436b-973e-71a991a43717 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-117a86ef-30ae-436b-973e-71a991a43717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:56.874023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:56.875128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:56.876844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:56.876844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:56.876844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:56.876844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 465/936] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:56.881593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b573011-2f8c-4726-b4da-d5d65b770623 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:56.985060 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b573011-2f8c-4726-b4da-d5d65b770623 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:56.987327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:57.019585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66365948-5e80-4c86-b455-5ebde9e7e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:57.020223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66365948-5e80-4c86-b455-5ebde9e7e2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:57.020499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66365948-5e80-4c86-b455-5ebde9e7e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:57.020766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66365948-5e80-4c86-b455-5ebde9e7e2b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:57.021401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66365948-5e80-4c86-b455-5ebde9e7e2b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:57.021696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66365948-5e80-4c86-b455-5ebde9e7e2b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:57.023092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66365948-5e80-4c86-b455-5ebde9e7e2b1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:57.034754 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 472/937] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:57.040847 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a86ef-30ae-436b-973e-71a991a43717 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:57.100617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:57.143380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a86ef-30ae-436b-973e-71a991a43717 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:57.178314 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd61e29-a831-4f0c-9e08-342829cedfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:57.178863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd61e29-a831-4f0c-9e08-342829cedfdd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:57.179192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd61e29-a831-4f0c-9e08-342829cedfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:57.179465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd61e29-a831-4f0c-9e08-342829cedfdd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:57.187234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd61e29-a831-4f0c-9e08-342829cedfdd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:57.188770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd61e29-a831-4f0c-9e08-342829cedfdd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-1fd61e29-a831-4f0c-9e08-342829cedfdd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:14:57.200900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:57.201882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:57.202816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:57.202816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:57.202816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:14:57.202816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:14:57.202816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:14:57.202816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:14:57.202816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:14:57.202816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:14:57.202816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 10:14:57.202816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:57.202816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 466/938] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 10:14:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:57.207800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66365948-5e80-4c86-b455-5ebde9e7e2b1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:57.309412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66365948-5e80-4c86-b455-5ebde9e7e2b1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:57.343546 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45ceb8-77c1-4484-abdb-edde7c16edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:57.344178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45ceb8-77c1-4484-abdb-edde7c16edd5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:57.344453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45ceb8-77c1-4484-abdb-edde7c16edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:57.344723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45ceb8-77c1-4484-abdb-edde7c16edd5 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:57.345439 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45ceb8-77c1-4484-abdb-edde7c16edd5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:57.345740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45ceb8-77c1-4484-abdb-edde7c16edd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:57.347198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45ceb8-77c1-4484-abdb-edde7c16edd5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:57.364763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 473/939] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Oct 4 10:14:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:57.370943 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd61e29-a831-4f0c-9e08-342829cedfdd None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:57.474794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd61e29-a831-4f0c-9e08-342829cedfdd None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:57.491771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:57.509158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1921a-138c-4a0c-b318-2e43ac3af093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:57.518793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1921a-138c-4a0c-b318-2e43ac3af093 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:57.518793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1921a-138c-4a0c-b318-2e43ac3af093 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:57.518793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1921a-138c-4a0c-b318-2e43ac3af093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:57.521155 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1921a-138c-4a0c-b318-2e43ac3af093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:57.522595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1921a-138c-4a0c-b318-2e43ac3af093 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-71c1921a-138c-4a0c-b318-2e43ac3af093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:14:57.537547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:57.538745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:14:57.539888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:14:57.539888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:14:57.539888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:57.539888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 467/940] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:57.544298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45ceb8-77c1-4484-abdb-edde7c16edd5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:57.570199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:57.655873 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45ceb8-77c1-4484-abdb-edde7c16edd5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:57.691386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94475a-7963-411f-bf0b-50e33a58cf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:57.692082 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94475a-7963-411f-bf0b-50e33a58cf3a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:57.692361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94475a-7963-411f-bf0b-50e33a58cf3a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:57.692628 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94475a-7963-411f-bf0b-50e33a58cf3a None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:57.693262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94475a-7963-411f-bf0b-50e33a58cf3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:57.693559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94475a-7963-411f-bf0b-50e33a58cf3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:57.694895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94475a-7963-411f-bf0b-50e33a58cf3a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:57.707241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 474/941] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:14:57.712905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1921a-138c-4a0c-b318-2e43ac3af093 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:57.814229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1921a-138c-4a0c-b318-2e43ac3af093 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:57.848826 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e8ead-6da7-4796-8934-17e581589ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:57.849506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8ead-6da7-4796-8934-17e581589ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:57.849776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8ead-6da7-4796-8934-17e581589ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:57.850043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8ead-6da7-4796-8934-17e581589ec5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:57.856932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e8ead-6da7-4796-8934-17e581589ec5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:57.858366 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e8ead-6da7-4796-8934-17e581589ec5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-fc5e8ead-6da7-4796-8934-17e581589ec5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:57.869895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:57.870813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:57.871712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:57.871712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:57.871712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:57.871712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:57.871712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:57.871712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:57.871712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:57.871712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:57.871712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 468/942] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:57.877051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94475a-7963-411f-bf0b-50e33a58cf3a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:57.964345 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:57.985537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94475a-7963-411f-bf0b-50e33a58cf3a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:58.020563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecb3c0-fab1-4c13-af67-a16cab59af1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:58.021166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecb3c0-fab1-4c13-af67-a16cab59af1f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:58.021438 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecb3c0-fab1-4c13-af67-a16cab59af1f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:58.021704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecb3c0-fab1-4c13-af67-a16cab59af1f None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:58.022388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecb3c0-fab1-4c13-af67-a16cab59af1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:58.022744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecb3c0-fab1-4c13-af67-a16cab59af1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:58.024757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecb3c0-fab1-4c13-af67-a16cab59af1f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:58.037535 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 475/943] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:58.043450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e8ead-6da7-4796-8934-17e581589ec5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:58.075353 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:58.079229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008b417-1b24-4807-b7ab-1936780b357d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:58.079520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008b417-1b24-4807-b7ab-1936780b357d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:58.079800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008b417-1b24-4807-b7ab-1936780b357d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:58.082453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 476/944] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:14:58.086432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933ac0d-be9b-47d9-998e-96489a630aea None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:58.087242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933ac0d-be9b-47d9-998e-96489a630aea None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:58.087513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933ac0d-be9b-47d9-998e-96489a630aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:58.107233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f933ac0d-be9b-47d9-998e-96489a630aea None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:58.108463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f933ac0d-be9b-47d9-998e-96489a630aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:58.174048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e8ead-6da7-4796-8934-17e581589ec5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:58.192194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 477/945] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:14:58.212525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22f957-dff8-48fc-8c0d-3b27dcc04854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:58.213440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f957-dff8-48fc-8c0d-3b27dcc04854 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:58.213897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f957-dff8-48fc-8c0d-3b27dcc04854 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:58.214360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f957-dff8-48fc-8c0d-3b27dcc04854 None admin] PATH_INFO: `/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/347ab0ce405c4deba9295d5395cb1d6e/roles/cb1326f1ee04493da8934ae44875422d` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:58.216952 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22f957-dff8-48fc-8c0d-3b27dcc04854 None admin] RBAC: Authorizing `identity:create_grant(project_id=c41ae2f9d03c48be8017a1ca480bf7db, user_id=347ab0ce405c4deba9295d5395cb1d6e, role_id=cb1326f1ee04493da8934ae44875422d)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:58.218543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22f957-dff8-48fc-8c0d-3b27dcc04854 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:58.255284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27408a5-ec30-4754-9d1d-51b7146d6c29 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:58.255571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27408a5-ec30-4754-9d1d-51b7146d6c29 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:58.255845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27408a5-ec30-4754-9d1d-51b7146d6c29 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:58.257630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 478/946] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:14:58.262298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2c038-a5fd-4187-9ed2-007b228e8693 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:58.262582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2c038-a5fd-4187-9ed2-007b228e8693 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:58.262857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2c038-a5fd-4187-9ed2-007b228e8693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:58.281645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a0d2c038-a5fd-4187-9ed2-007b228e8693 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:58.282815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a0d2c038-a5fd-4187-9ed2-007b228e8693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:58.289503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 469/947] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:14:58 2022] PUT /identity/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/347ab0ce405c4deba9295d5395cb1d6e/roles/cb1326f1ee04493da8934ae44875422d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:14:58.368519 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 479/948] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:58.462879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22f957-dff8-48fc-8c0d-3b27dcc04854 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:58.560653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:58.570893 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22f957-dff8-48fc-8c0d-3b27dcc04854 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:58.608333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e0741-5e05-4ce6-bdc1-f81b295be901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:58.609003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0741-5e05-4ce6-bdc1-f81b295be901 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:58.609284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0741-5e05-4ce6-bdc1-f81b295be901 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:58.609554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0741-5e05-4ce6-bdc1-f81b295be901 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:58.610204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e0741-5e05-4ce6-bdc1-f81b295be901 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:58.611621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e0741-5e05-4ce6-bdc1-f81b295be901 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:58.614471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: WARNING keystone.server.flask.common [None req-7b5e0741-5e05-4ce6-bdc1-f81b295be901 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 10:14:58.641475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2c038-a5fd-4187-9ed2-007b228e8693 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:58.643641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:58.666488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.sql.core [None req-7b5e0741-5e05-4ce6-bdc1-f81b295be901 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 10:14:58.666488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 10:14:58.666488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [parameters: {'id': 'ae9842aa3ce4450ead6168be7720bc66', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 10:14:58.666488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81578) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-7b5e0741-5e05-4ce6-bdc1-f81b295be901 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ae9842aa3ce4450ead6168be7720bc66.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ae9842aa3ce4450ead6168be7720bc66. Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application conn.query(q) Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 10:14:58.677888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application result.read() Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 10:14:58.678731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application next(self.gen) Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application yield resource Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application next(self.gen) Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise self.value Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application session.commit() Oct 04 10:14:58.679751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.session.flush() Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application compat.raise_( Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 10:14:58.681307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 10:14:58.682977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application conn.query(q) Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application result.read() Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 10:14:58.685156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [parameters: {'id': 'ae9842aa3ce4450ead6168be7720bc66', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:58.687344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:58.689268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:58.692583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:58.692583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 04 10:14:58.692583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 04 10:14:58.692583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:58.692583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:58.692583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 10:14:58.692583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 10:14:58.692583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ae9842aa3ce4450ead6168be7720bc66. Oct 04 10:14:58.692583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:58.700560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 470/949] 10.222.0.33 () {60 vars in 1140 bytes} [Tue Oct 4 10:14:58 2022] POST /identity/v3/projects => generated 262 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:58.702501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e0741-5e05-4ce6-bdc1-f81b295be901 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:58.764567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2c038-a5fd-4187-9ed2-007b228e8693 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:58.817551 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81ad46-27c0-4d3a-9f7e-3b921db12002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:58.823410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ad46-27c0-4d3a-9f7e-3b921db12002 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:58.823972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ad46-27c0-4d3a-9f7e-3b921db12002 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:58.824448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ad46-27c0-4d3a-9f7e-3b921db12002 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:58.825226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81ad46-27c0-4d3a-9f7e-3b921db12002 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:58.826803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81ad46-27c0-4d3a-9f7e-3b921db12002 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:58.831305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e0741-5e05-4ce6-bdc1-f81b295be901 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7a81ad46-27c0-4d3a-9f7e-3b921db12002 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:58.837556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:58.838620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 10:14:58.839500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:14:58.842968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 480/950] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:58.847127 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81ad46-27c0-4d3a-9f7e-3b921db12002 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:58.870277 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f2ac7-66ab-4453-a873-97af10259be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:58.870939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f2ac7-66ab-4453-a873-97af10259be7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:58.871217 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f2ac7-66ab-4453-a873-97af10259be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:58.871487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f2ac7-66ab-4453-a873-97af10259be7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:58.878532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f2ac7-66ab-4453-a873-97af10259be7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:58.880202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f2ac7-66ab-4453-a873-97af10259be7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-564f2ac7-66ab-4453-a873-97af10259be7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:14:58.892378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:58.893431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:58.894403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:14:58.894403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:14:58.894403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:14:58.894403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:14:58.894403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:14:58.894403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:14:58.894403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:14:58.894403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:58.894403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 471/951] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:14:58.902780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f2ac7-66ab-4453-a873-97af10259be7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:58.916569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:58.939746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:58.974478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81ad46-27c0-4d3a-9f7e-3b921db12002 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:59.009958 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cb58e-2d9d-44d9-99d8-6cd8246b8167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:59.010557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cb58e-2d9d-44d9-99d8-6cd8246b8167 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:59.010837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cb58e-2d9d-44d9-99d8-6cd8246b8167 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:59.011103 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cb58e-2d9d-44d9-99d8-6cd8246b8167 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:59.011734 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cb58e-2d9d-44d9-99d8-6cd8246b8167 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:59.012066 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cb58e-2d9d-44d9-99d8-6cd8246b8167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:59.013380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cb58e-2d9d-44d9-99d8-6cd8246b8167 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:59.018514 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 481/952] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:14:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:59.019742 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d5214-21e5-413c-ae85-2d5369913fcf None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:59.020055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d5214-21e5-413c-ae85-2d5369913fcf None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:59.020354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d5214-21e5-413c-ae85-2d5369913fcf None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:59.020956 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f2ac7-66ab-4453-a873-97af10259be7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:59.026243 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 482/953] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:14:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:14:59.027018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d5214-21e5-413c-ae85-2d5369913fcf None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:59.059663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368156f6-c898-45ee-9a61-8c3327da0b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:59.060281 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368156f6-c898-45ee-9a61-8c3327da0b8c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:59.060557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368156f6-c898-45ee-9a61-8c3327da0b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:59.060825 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368156f6-c898-45ee-9a61-8c3327da0b8c None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:59.061478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368156f6-c898-45ee-9a61-8c3327da0b8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:59.061776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368156f6-c898-45ee-9a61-8c3327da0b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:59.063223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368156f6-c898-45ee-9a61-8c3327da0b8c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:59.091980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 472/954] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:14:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:59.091980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e6368-634b-4b6b-82f3-8df93b4c67c6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:59.091980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e6368-634b-4b6b-82f3-8df93b4c67c6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:59.091980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e6368-634b-4b6b-82f3-8df93b4c67c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:59.109423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0c0e6368-634b-4b6b-82f3-8df93b4c67c6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:14:59.110998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0c0e6368-634b-4b6b-82f3-8df93b4c67c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:14:59.160619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d5214-21e5-413c-ae85-2d5369913fcf None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:59.181676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:59.193089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:59.194008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 473/955] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:14:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:14:59.210002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8345553-8d65-499d-a805-36503a21a21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:59.210627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8345553-8d65-499d-a805-36503a21a21f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:59.210963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8345553-8d65-499d-a805-36503a21a21f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:59.211240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8345553-8d65-499d-a805-36503a21a21f None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:59.211930 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8345553-8d65-499d-a805-36503a21a21f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:59.212276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8345553-8d65-499d-a805-36503a21a21f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:59.213840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8345553-8d65-499d-a805-36503a21a21f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:59.220021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 483/956] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:14:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:59.480575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e6368-634b-4b6b-82f3-8df93b4c67c6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:59.588314 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e6368-634b-4b6b-82f3-8df93b4c67c6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:59.625440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b32ef6-85bb-4d87-8733-d6b043be2ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:59.626089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b32ef6-85bb-4d87-8733-d6b043be2ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:59.626371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b32ef6-85bb-4d87-8733-d6b043be2ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:59.626650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b32ef6-85bb-4d87-8733-d6b043be2ba4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:59.627238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b32ef6-85bb-4d87-8733-d6b043be2ba4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:59.628623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b32ef6-85bb-4d87-8733-d6b043be2ba4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-c8b32ef6-85bb-4d87-8733-d6b043be2ba4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:14:59.637820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:14:59.638951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:14:59.639886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 474/957] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 10:14:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:14:59.645099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8345553-8d65-499d-a805-36503a21a21f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:59.754592 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8345553-8d65-499d-a805-36503a21a21f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:59.789189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0fda6-d5ea-497d-9bd0-50578640ba7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:59.789860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0fda6-d5ea-497d-9bd0-50578640ba7d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:59.790147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0fda6-d5ea-497d-9bd0-50578640ba7d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:59.790421 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0fda6-d5ea-497d-9bd0-50578640ba7d None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:59.791051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0fda6-d5ea-497d-9bd0-50578640ba7d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:59.791354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0fda6-d5ea-497d-9bd0-50578640ba7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:59.792728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0fda6-d5ea-497d-9bd0-50578640ba7d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:59.797803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 484/958] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 10:14:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:59.803409 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b32ef6-85bb-4d87-8733-d6b043be2ba4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:14:59.867264 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:14:59.908991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b32ef6-85bb-4d87-8733-d6b043be2ba4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:14:59.944798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacefb90-8846-4a1d-b6f4-1bb2505fc1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:14:59.945417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacefb90-8846-4a1d-b6f4-1bb2505fc1aa None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:14:59.945706 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacefb90-8846-4a1d-b6f4-1bb2505fc1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:14:59.945973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacefb90-8846-4a1d-b6f4-1bb2505fc1aa None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:14:59.947126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacefb90-8846-4a1d-b6f4-1bb2505fc1aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:14:59.947431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacefb90-8846-4a1d-b6f4-1bb2505fc1aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:14:59.948846 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacefb90-8846-4a1d-b6f4-1bb2505fc1aa None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:14:59.954565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 475/959] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 10:14:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:14:59.960403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0fda6-d5ea-497d-9bd0-50578640ba7d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:00.025521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:00.072668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0fda6-d5ea-497d-9bd0-50578640ba7d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:00.109825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282a88b-21b8-4286-bd90-3aee6d8970fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:00.110433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282a88b-21b8-4286-bd90-3aee6d8970fe None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:00.110712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282a88b-21b8-4286-bd90-3aee6d8970fe None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:00.110991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282a88b-21b8-4286-bd90-3aee6d8970fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:00.111719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282a88b-21b8-4286-bd90-3aee6d8970fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:00.113114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282a88b-21b8-4286-bd90-3aee6d8970fe None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:00.193438 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 485/960] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:14:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:15:00.576210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fef84e-7b37-4764-99c8-0225032f0a5c None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:00.576596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fef84e-7b37-4764-99c8-0225032f0a5c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:00.576775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fef84e-7b37-4764-99c8-0225032f0a5c None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:00.585291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 476/961] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:00.591029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2f10d-c599-4504-9ab1-e6edfa9aca46 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:00.591563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2f10d-c599-4504-9ab1-e6edfa9aca46 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:00.592108 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2f10d-c599-4504-9ab1-e6edfa9aca46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:00.611095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-13e2f10d-c599-4504-9ab1-e6edfa9aca46 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:00.612604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-13e2f10d-c599-4504-9ab1-e6edfa9aca46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:00.685255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 486/962] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:15:00.955505 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fef84e-7b37-4764-99c8-0225032f0a5c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:01.068446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fef84e-7b37-4764-99c8-0225032f0a5c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:01.093197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:01.103979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c53c5f-fdba-4db5-ac22-1eff3f79b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:01.104625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c53c5f-fdba-4db5-ac22-1eff3f79b81d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:01.104892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c53c5f-fdba-4db5-ac22-1eff3f79b81d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:01.105164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c53c5f-fdba-4db5-ac22-1eff3f79b81d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:01.116380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c53c5f-fdba-4db5-ac22-1eff3f79b81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-66c53c5f-fdba-4db5-ac22-1eff3f79b81d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:15:01.121804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:01.122777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:01.123653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 477/963] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Oct 4 10:15:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:01.131112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2f10d-c599-4504-9ab1-e6edfa9aca46 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:01.175029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:01.235757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2f10d-c599-4504-9ab1-e6edfa9aca46 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:01.274819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a8436-26ed-4203-b858-ad8c4772a8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:01.275436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a8436-26ed-4203-b858-ad8c4772a8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:01.275712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a8436-26ed-4203-b858-ad8c4772a8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:01.275999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a8436-26ed-4203-b858-ad8c4772a8f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:01.276672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a8436-26ed-4203-b858-ad8c4772a8f7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:01.276974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a8436-26ed-4203-b858-ad8c4772a8f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:01.278325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a8436-26ed-4203-b858-ad8c4772a8f7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:01.287114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 487/964] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 10:15:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:01.293587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c53c5f-fdba-4db5-ac22-1eff3f79b81d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:01.364469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c51419-006b-493d-bd1a-5b954e5f33b1 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:01.364820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c51419-006b-493d-bd1a-5b954e5f33b1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:01.365021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c51419-006b-493d-bd1a-5b954e5f33b1 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:01.366676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 488/965] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:01.372418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82610645-c12f-4ab9-bc6a-378986a01232 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:01.372763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82610645-c12f-4ab9-bc6a-378986a01232 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:01.372958 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82610645-c12f-4ab9-bc6a-378986a01232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:01.392577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-82610645-c12f-4ab9-bc6a-378986a01232 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:01.393931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-82610645-c12f-4ab9-bc6a-378986a01232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:01.407482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c53c5f-fdba-4db5-ac22-1eff3f79b81d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:01.456086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e078b35-a21c-4926-9fd0-81568521ab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:01.457359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078b35-a21c-4926-9fd0-81568521ab56 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:01.458090 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078b35-a21c-4926-9fd0-81568521ab56 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:01.458979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078b35-a21c-4926-9fd0-81568521ab56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:01.472948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e078b35-a21c-4926-9fd0-81568521ab56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:01.474767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e078b35-a21c-4926-9fd0-81568521ab56 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:01.475120 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 489/966] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-8e078b35-a21c-4926-9fd0-81568521ab56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:15:01.490311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:01.491316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:15:01.492272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:15:01.492272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:01.492272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:01.494452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 478/967] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:01.500318 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82610645-c12f-4ab9-bc6a-378986a01232 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:01.506119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46317e8f-e615-4153-ab5f-85abc7c1a1f4 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:01.506400 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46317e8f-e615-4153-ab5f-85abc7c1a1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:01.506668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46317e8f-e615-4153-ab5f-85abc7c1a1f4 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:01.512261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 479/968] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:15:01.513658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d755cb0-c6f9-48f0-86c5-53b1e24d7acb None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:01.513938 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d755cb0-c6f9-48f0-86c5-53b1e24d7acb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:01.514207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d755cb0-c6f9-48f0-86c5-53b1e24d7acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:01.532868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-7d755cb0-c6f9-48f0-86c5-53b1e24d7acb None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:01.534058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7d755cb0-c6f9-48f0-86c5-53b1e24d7acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:01.537522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:01.565310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:01.615828 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82610645-c12f-4ab9-bc6a-378986a01232 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:01.620006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 480/969] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:15:01.659371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff1aba-fdab-4fce-b175-adae647c462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:01.660320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff1aba-fdab-4fce-b175-adae647c462b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:01.660786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff1aba-fdab-4fce-b175-adae647c462b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:01.661257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff1aba-fdab-4fce-b175-adae647c462b None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:01.662076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff1aba-fdab-4fce-b175-adae647c462b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:01.662558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff1aba-fdab-4fce-b175-adae647c462b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:01.664122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff1aba-fdab-4fce-b175-adae647c462b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:01.680065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 490/970] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:01.682077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d755cb0-c6f9-48f0-86c5-53b1e24d7acb None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:01.740434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff1aba-fdab-4fce-b175-adae647c462b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:01.802357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d755cb0-c6f9-48f0-86c5-53b1e24d7acb None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:01.846449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:01.856440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ffc63-a099-47c0-b209-8bd5e51e3c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:01.856440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ffc63-a099-47c0-b209-8bd5e51e3c75 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:01.856440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ffc63-a099-47c0-b209-8bd5e51e3c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:01.856440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ffc63-a099-47c0-b209-8bd5e51e3c75 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:01.856795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff1aba-fdab-4fce-b175-adae647c462b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:01.864762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ffc63-a099-47c0-b209-8bd5e51e3c75 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:01.866567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ffc63-a099-47c0-b209-8bd5e51e3c75 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-201ffc63-a099-47c0-b209-8bd5e51e3c75 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:15:01.887194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:01.888229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:01.889201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:01.889201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:01.889201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:15:01.889201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:15:01.889201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:15:01.889201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:15:01.889201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:15:01.889201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:15:01.889201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 10:15:01.889201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:01.889201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 481/971] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 10:15:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:01.895841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ffc63-a099-47c0-b209-8bd5e51e3c75 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:01.902745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ca609-968c-408b-b8b1-f42fa8aabd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:01.903352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ca609-968c-408b-b8b1-f42fa8aabd5f None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:01.903626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ca609-968c-408b-b8b1-f42fa8aabd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:01.903889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ca609-968c-408b-b8b1-f42fa8aabd5f None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:01.904565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ca609-968c-408b-b8b1-f42fa8aabd5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:01.906278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ca609-968c-408b-b8b1-f42fa8aabd5f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:01.909921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: WARNING keystone.server.flask.common [None req-0c2ca609-968c-408b-b8b1-f42fa8aabd5f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 10:15:01.930813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:01.957537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.sql.core [None req-0c2ca609-968c-408b-b8b1-f42fa8aabd5f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 10:15:01.957537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 10:15:01.957537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [parameters: {'user_id': 'e015504fd4564109899bb119a2b95dec', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 10:15:01.957537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81577) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-0c2ca609-968c-408b-b8b1-f42fa8aabd5f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application conn.query(q) Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application result.read() Oct 04 10:15:01.974832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 10:15:01.975771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application next(self.gen) Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application yield resource Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application next(self.gen) Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise self.value Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application session.commit() Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 10:15:01.976782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.session.flush() Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application compat.raise_( Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 10:15:01.979022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 10:15:01.981346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application conn.query(q) Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application result.read() Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 10:15:01.984475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e015504fd4564109899bb119a2b95dec', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:01.986827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 04 10:15:01.987817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 04 10:15:01.988994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 04 10:15:01.988994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 04 10:15:01.988994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 10:15:01.988994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 10:15:01.988994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 10:15:01.988994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:01.988994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 491/972] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Oct 4 10:15:01 2022] POST /identity/v3/users => generated 160 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:15:01.988994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ca609-968c-408b-b8b1-f42fa8aabd5f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:02.009703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ffc63-a099-47c0-b209-8bd5e51e3c75 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:02.045130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aa357-5c69-428d-8e96-516c22628c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:02.045792 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa357-5c69-428d-8e96-516c22628c6c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:02.046075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa357-5c69-428d-8e96-516c22628c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:02.046349 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa357-5c69-428d-8e96-516c22628c6c None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:02.047075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aa357-5c69-428d-8e96-516c22628c6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:02.047377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aa357-5c69-428d-8e96-516c22628c6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:02.048828 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aa357-5c69-428d-8e96-516c22628c6c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:02.070344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 482/973] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Oct 4 10:15:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:02.070344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aa357-5c69-428d-8e96-516c22628c6c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:02.098960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ca609-968c-408b-b8b1-f42fa8aabd5f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:02.132141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45227aea-10b9-48db-a156-fea260dd5be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:02.132738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45227aea-10b9-48db-a156-fea260dd5be4 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:02.133011 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45227aea-10b9-48db-a156-fea260dd5be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:02.133277 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45227aea-10b9-48db-a156-fea260dd5be4 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:02.135831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45227aea-10b9-48db-a156-fea260dd5be4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:02.137458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45227aea-10b9-48db-a156-fea260dd5be4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:02.158019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:02.172908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aa357-5c69-428d-8e96-516c22628c6c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:02.206660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c0b63-40d3-437e-84f8-b9289b54ca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:02.207459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c0b63-40d3-437e-84f8-b9289b54ca69 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:02.207738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c0b63-40d3-437e-84f8-b9289b54ca69 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:02.208037 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c0b63-40d3-437e-84f8-b9289b54ca69 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:02.215572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c0b63-40d3-437e-84f8-b9289b54ca69 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:02.217281 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c0b63-40d3-437e-84f8-b9289b54ca69 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:02.232004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 492/974] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:15:01 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-843c0b63-40d3-437e-84f8-b9289b54ca69 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:15:02.232228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:02.233095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:02.234081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:02.234081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:02.234081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:15:02.234081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:15:02.234081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:15:02.234081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:15:02.234081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:15:02.234081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:15:02.234081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 10:15:02.234081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:02.234719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45227aea-10b9-48db-a156-fea260dd5be4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:02.234792 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 483/975] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:15:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:02.236840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c0b63-40d3-437e-84f8-b9289b54ca69 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:02.257532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:02.374468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45227aea-10b9-48db-a156-fea260dd5be4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:02.384766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c0b63-40d3-437e-84f8-b9289b54ca69 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:02.418947 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b678761-3189-4420-9143-e58ffda4dd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:02.420090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b678761-3189-4420-9143-e58ffda4dd98 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:02.420591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b678761-3189-4420-9143-e58ffda4dd98 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:02.421104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b678761-3189-4420-9143-e58ffda4dd98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:02.431935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3749dc9-786d-400d-b534-a7259e2193b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:02.432709 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3749dc9-786d-400d-b534-a7259e2193b9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:02.433017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3749dc9-786d-400d-b534-a7259e2193b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:02.433290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3749dc9-786d-400d-b534-a7259e2193b9 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:02.433991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3749dc9-786d-400d-b534-a7259e2193b9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:02.434660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3749dc9-786d-400d-b534-a7259e2193b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:02.436467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3749dc9-786d-400d-b534-a7259e2193b9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:02.478331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 484/976] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 10:15:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:02.489032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea9fad-87fe-4a91-98ad-fe765a2640e9 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:02.489415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea9fad-87fe-4a91-98ad-fe765a2640e9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:02.489756 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea9fad-87fe-4a91-98ad-fe765a2640e9 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:02.491584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 485/977] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:15:02.497740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019c59b-2a1f-44db-84e9-20ebca0178cd None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:02.498030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019c59b-2a1f-44db-84e9-20ebca0178cd None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:02.498308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019c59b-2a1f-44db-84e9-20ebca0178cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:02.504915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:02.505104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b678761-3189-4420-9143-e58ffda4dd98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:02.506469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b678761-3189-4420-9143-e58ffda4dd98 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:02.520217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:02.521953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9019c59b-2a1f-44db-84e9-20ebca0178cd None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:02.523403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9019c59b-2a1f-44db-84e9-20ebca0178cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:02.623977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 486/978] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:15:02.633047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 493/979] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:15:02 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:15:02.639360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019c59b-2a1f-44db-84e9-20ebca0178cd None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:02.747093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019c59b-2a1f-44db-84e9-20ebca0178cd None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:02.779122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:02.784734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f7b12-734e-42ea-b3c0-0366411ad71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:02.785492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f7b12-734e-42ea-b3c0-0366411ad71f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:02.785872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f7b12-734e-42ea-b3c0-0366411ad71f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:02.786198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f7b12-734e-42ea-b3c0-0366411ad71f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:02.797693 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f7b12-734e-42ea-b3c0-0366411ad71f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:02.799151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f7b12-734e-42ea-b3c0-0366411ad71f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-4d6f7b12-734e-42ea-b3c0-0366411ad71f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:15:02.818486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:02.819674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:15:02.821703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:15:02.821703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:02.821703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:02.821703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 487/980] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:02.826643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b678761-3189-4420-9143-e58ffda4dd98 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:02.891831 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f7b12-734e-42ea-b3c0-0366411ad71f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:02.935488 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b678761-3189-4420-9143-e58ffda4dd98 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:02.947417 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:02.970890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffee925-e079-4cc7-9bf0-0f691a2191f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:02.971485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffee925-e079-4cc7-9bf0-0f691a2191f7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:02.971758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffee925-e079-4cc7-9bf0-0f691a2191f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:02.972053 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffee925-e079-4cc7-9bf0-0f691a2191f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:02.972813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffee925-e079-4cc7-9bf0-0f691a2191f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:02.973255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffee925-e079-4cc7-9bf0-0f691a2191f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:02.974597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffee925-e079-4cc7-9bf0-0f691a2191f7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:02.991535 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 494/981] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:02.992588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffee925-e079-4cc7-9bf0-0f691a2191f7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:03.003649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f7b12-734e-42ea-b3c0-0366411ad71f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:03.037524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517b286-3f4f-4fc8-9f20-37082ed73108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:03.038245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517b286-3f4f-4fc8-9f20-37082ed73108 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:03.038565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517b286-3f4f-4fc8-9f20-37082ed73108 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:03.038898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517b286-3f4f-4fc8-9f20-37082ed73108 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:03.039534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517b286-3f4f-4fc8-9f20-37082ed73108 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:03.042426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517b286-3f4f-4fc8-9f20-37082ed73108 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d517b286-3f4f-4fc8-9f20-37082ed73108 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:03.051748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:03.053013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:03.053871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 488/982] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 10:15:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:15:03.059232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517b286-3f4f-4fc8-9f20-37082ed73108 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:03.098990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffee925-e079-4cc7-9bf0-0f691a2191f7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:03.110987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:03.134400 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10cc63-2741-4237-8283-6478ece83b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:03.135064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10cc63-2741-4237-8283-6478ece83b13 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:03.135344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10cc63-2741-4237-8283-6478ece83b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:03.135615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10cc63-2741-4237-8283-6478ece83b13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:03.142544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10cc63-2741-4237-8283-6478ece83b13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:03.143898 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10cc63-2741-4237-8283-6478ece83b13 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ce10cc63-2741-4237-8283-6478ece83b13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:15:03.154982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:03.156087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:03.157157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:15:03.157157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:15:03.157157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:15:03.157157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:15:03.157157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:15:03.157157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:15:03.157157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:15:03.157157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:03.157157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 495/983] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:15:03.161718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10cc63-2741-4237-8283-6478ece83b13 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:03.167607 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517b286-3f4f-4fc8-9f20-37082ed73108 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:03.198115 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:03.207267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c36d4-a13b-40e6-b83f-a94705e83047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:03.208004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c36d4-a13b-40e6-b83f-a94705e83047 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:03.208811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c36d4-a13b-40e6-b83f-a94705e83047 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:03.208811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c36d4-a13b-40e6-b83f-a94705e83047 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:03.209369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c36d4-a13b-40e6-b83f-a94705e83047 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:03.209738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c36d4-a13b-40e6-b83f-a94705e83047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:03.211160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c36d4-a13b-40e6-b83f-a94705e83047 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:03.217345 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 489/984] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 10:15:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:03.223341 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c36d4-a13b-40e6-b83f-a94705e83047 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:03.273442 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10cc63-2741-4237-8283-6478ece83b13 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:03.308746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ec6bb-42d0-4a86-8d4f-02d7fd6aa42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:03.309434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ec6bb-42d0-4a86-8d4f-02d7fd6aa42c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:03.309786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ec6bb-42d0-4a86-8d4f-02d7fd6aa42c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:03.310164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ec6bb-42d0-4a86-8d4f-02d7fd6aa42c None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:03.310941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ec6bb-42d0-4a86-8d4f-02d7fd6aa42c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:03.311354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ec6bb-42d0-4a86-8d4f-02d7fd6aa42c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:03.312899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ec6bb-42d0-4a86-8d4f-02d7fd6aa42c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:03.325016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 496/985] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:15:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:03.330631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ec6bb-42d0-4a86-8d4f-02d7fd6aa42c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:03.335178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c36d4-a13b-40e6-b83f-a94705e83047 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:03.351517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:03.373175 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b5abe-4af7-4196-a76d-42eac896a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:03.373900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b5abe-4af7-4196-a76d-42eac896a6bb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:03.374283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b5abe-4af7-4196-a76d-42eac896a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:03.374635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b5abe-4af7-4196-a76d-42eac896a6bb None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:03.375361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b5abe-4af7-4196-a76d-42eac896a6bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:03.375763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b5abe-4af7-4196-a76d-42eac896a6bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:03.377285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b5abe-4af7-4196-a76d-42eac896a6bb None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:03.386893 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 490/986] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 10:15:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:03.387856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b5abe-4af7-4196-a76d-42eac896a6bb None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:03.428806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:03.438486 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ec6bb-42d0-4a86-8d4f-02d7fd6aa42c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:03.474924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56cf3e-4f53-46bc-9924-86f6f1302e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:03.475620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56cf3e-4f53-46bc-9924-86f6f1302e49 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:03.475996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56cf3e-4f53-46bc-9924-86f6f1302e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:03.476340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56cf3e-4f53-46bc-9924-86f6f1302e49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:03.477164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56cf3e-4f53-46bc-9924-86f6f1302e49 None admin] RBAC: Adding query filter params (role.id=cb1326f1ee04493da8934ae44875422d, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=347ab0ce405c4deba9295d5395cb1d6e) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:03.477603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56cf3e-4f53-46bc-9924-86f6f1302e49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:03.479076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56cf3e-4f53-46bc-9924-86f6f1302e49 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:03.485630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 497/987] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:15:03 2022] GET /identity/v3/role_assignments?user.id=347ab0ce405c4deba9295d5395cb1d6e&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=cb1326f1ee04493da8934ae44875422d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:03.495708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b5abe-4af7-4196-a76d-42eac896a6bb None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:03.534852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49951ca-7c96-46e4-b2f0-a21110be950e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:03.535732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49951ca-7c96-46e4-b2f0-a21110be950e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:03.536212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49951ca-7c96-46e4-b2f0-a21110be950e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:03.536666 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49951ca-7c96-46e4-b2f0-a21110be950e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:03.537621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49951ca-7c96-46e4-b2f0-a21110be950e None admin] RBAC: Adding query filter params (interface=admin, service_id=6efecd63fdf24a84864445e4874e3e4a, region_id=RegionOne) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:03.538081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49951ca-7c96-46e4-b2f0-a21110be950e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:03.539643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49951ca-7c96-46e4-b2f0-a21110be950e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:03.547078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 491/988] 10.222.0.33 () {56 vars in 1249 bytes} [Tue Oct 4 10:15:03 2022] GET /identity/v3/endpoints?service_id=6efecd63fdf24a84864445e4874e3e4a&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:03.553206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56cf3e-4f53-46bc-9924-86f6f1302e49 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:03.660598 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56cf3e-4f53-46bc-9924-86f6f1302e49 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:03.696888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11f486-87c4-4faf-9050-46593bc615c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:03.697506 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11f486-87c4-4faf-9050-46593bc615c1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:03.697844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11f486-87c4-4faf-9050-46593bc615c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:03.698112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11f486-87c4-4faf-9050-46593bc615c1 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:03.698702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11f486-87c4-4faf-9050-46593bc615c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:03.700064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11f486-87c4-4faf-9050-46593bc615c1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:03.706324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 498/989] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 10:15:03 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:15:04.517101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f392e5e-9739-4d95-a104-9ab1d805dc28 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:04.517907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f392e5e-9739-4d95-a104-9ab1d805dc28 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:04.517907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f392e5e-9739-4d95-a104-9ab1d805dc28 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:04.519133 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 492/990] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:04.524260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffb340-130f-47a8-816c-3f9358000157 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:04.524644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffb340-130f-47a8-816c-3f9358000157 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:04.524823 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffb340-130f-47a8-816c-3f9358000157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:04.543434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6bffb340-130f-47a8-816c-3f9358000157 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:04.544976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6bffb340-130f-47a8-816c-3f9358000157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:04.558798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:04.615333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 499/991] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:04.880570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f392e5e-9739-4d95-a104-9ab1d805dc28 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:04.933720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:04.993584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f392e5e-9739-4d95-a104-9ab1d805dc28 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:05.026355 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c3d65-1684-4d4e-8b34-53142e98d947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:05.026979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c3d65-1684-4d4e-8b34-53142e98d947 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:05.027259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c3d65-1684-4d4e-8b34-53142e98d947 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:05.027529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c3d65-1684-4d4e-8b34-53142e98d947 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:05.028129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c3d65-1684-4d4e-8b34-53142e98d947 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:05.029475 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c3d65-1684-4d4e-8b34-53142e98d947 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-396c3d65-1684-4d4e-8b34-53142e98d947 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:05.038049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:05.039024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:05.040049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 493/992] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:15:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:05.045234 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffb340-130f-47a8-816c-3f9358000157 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:05.143689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffb340-130f-47a8-816c-3f9358000157 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:05.177309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853381d9-fcc9-414d-9e5e-afa93fadfbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:05.177969 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853381d9-fcc9-414d-9e5e-afa93fadfbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:05.178252 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853381d9-fcc9-414d-9e5e-afa93fadfbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:05.178527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853381d9-fcc9-414d-9e5e-afa93fadfbf6 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:05.179152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853381d9-fcc9-414d-9e5e-afa93fadfbf6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:05.179455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853381d9-fcc9-414d-9e5e-afa93fadfbf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:05.180906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853381d9-fcc9-414d-9e5e-afa93fadfbf6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:05.191983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 500/993] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:15:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:05.192149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c3d65-1684-4d4e-8b34-53142e98d947 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:05.293767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c3d65-1684-4d4e-8b34-53142e98d947 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:05.296135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:05.328268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fc190-5192-4f5e-9b59-0497ff7e6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:05.328872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fc190-5192-4f5e-9b59-0497ff7e6076 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:05.329144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fc190-5192-4f5e-9b59-0497ff7e6076 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:05.329411 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fc190-5192-4f5e-9b59-0497ff7e6076 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:05.330027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fc190-5192-4f5e-9b59-0497ff7e6076 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:05.330381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fc190-5192-4f5e-9b59-0497ff7e6076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:05.331801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fc190-5192-4f5e-9b59-0497ff7e6076 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:05.341766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 494/994] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:15:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:05.342911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853381d9-fcc9-414d-9e5e-afa93fadfbf6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:05.358794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:05.445749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853381d9-fcc9-414d-9e5e-afa93fadfbf6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:05.483981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363402a-afd1-4622-a0bb-651db29a41c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:05.484867 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363402a-afd1-4622-a0bb-651db29a41c6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:05.485309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363402a-afd1-4622-a0bb-651db29a41c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:05.485740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363402a-afd1-4622-a0bb-651db29a41c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:05.486610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363402a-afd1-4622-a0bb-651db29a41c6 None admin] RBAC: Adding query filter params (interface=public, service_id=fb87335d97a34f87ab50fc18a68027dc, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:05.487130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363402a-afd1-4622-a0bb-651db29a41c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:05.488751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363402a-afd1-4622-a0bb-651db29a41c6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:05.494098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 501/995] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 10:15:05 2022] GET /identity/v3/endpoints?service_id=fb87335d97a34f87ab50fc18a68027dc&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:05.500387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fc190-5192-4f5e-9b59-0497ff7e6076 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:05.606304 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fc190-5192-4f5e-9b59-0497ff7e6076 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:05.640924 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af46c98-a329-4884-b091-6ac843af099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:05.641536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af46c98-a329-4884-b091-6ac843af099d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:05.641815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af46c98-a329-4884-b091-6ac843af099d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:05.642086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af46c98-a329-4884-b091-6ac843af099d None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:05.642683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af46c98-a329-4884-b091-6ac843af099d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:05.644066 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af46c98-a329-4884-b091-6ac843af099d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:05.656196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 495/996] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 10:15:05 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:15:05.678154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a9b62-5d68-4794-927c-facbd2a5dc9d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:05.678692 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a9b62-5d68-4794-927c-facbd2a5dc9d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:05.678692 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a9b62-5d68-4794-927c-facbd2a5dc9d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:05.680207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 502/997] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:05.686703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4e8e0-9e13-4558-95bc-e37899988e80 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:05.687060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4e8e0-9e13-4558-95bc-e37899988e80 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:05.687249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4e8e0-9e13-4558-95bc-e37899988e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:05.706738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-aed4e8e0-9e13-4558-95bc-e37899988e80 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:05.707894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-aed4e8e0-9e13-4558-95bc-e37899988e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:05.738157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:05.786323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 496/998] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:05.863555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f8391-0b51-4c61-8eb8-2facb8b3bbf7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:05.863838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f8391-0b51-4c61-8eb8-2facb8b3bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:05.864154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f8391-0b51-4c61-8eb8-2facb8b3bbf7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:05.865503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 503/999] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:05.871687 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ffa52-a9a8-44e2-878c-4dd3aae77aaf None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:05.872079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ffa52-a9a8-44e2-878c-4dd3aae77aaf None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:05.872358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ffa52-a9a8-44e2-878c-4dd3aae77aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:05.890982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c72ffa52-a9a8-44e2-878c-4dd3aae77aaf None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:05.892217 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c72ffa52-a9a8-44e2-878c-4dd3aae77aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:05.964832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 497/1000] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:06.057210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f8391-0b51-4c61-8eb8-2facb8b3bbf7 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:06.137156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:06.161777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f8391-0b51-4c61-8eb8-2facb8b3bbf7 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:06.197296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0f3f0-1a21-44f9-9a3b-782af4693138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:06.197919 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0f3f0-1a21-44f9-9a3b-782af4693138 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:06.198191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0f3f0-1a21-44f9-9a3b-782af4693138 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:06.198457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0f3f0-1a21-44f9-9a3b-782af4693138 None admin] PATH_INFO: `/v3/services/image` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:06.199033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0f3f0-1a21-44f9-9a3b-782af4693138 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:06.200408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0f3f0-1a21-44f9-9a3b-782af4693138 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f2e0f3f0-1a21-44f9-9a3b-782af4693138 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:06.209039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:06.210024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:06.213279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 504/1001] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Oct 4 10:15:06 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:06.216919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ffa52-a9a8-44e2-878c-4dd3aae77aaf None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:06.243906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0f3f0-1a21-44f9-9a3b-782af4693138 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:06.310871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:06.319303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ffa52-a9a8-44e2-878c-4dd3aae77aaf None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:06.354403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0f3f0-1a21-44f9-9a3b-782af4693138 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:06.354875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a2607-32c1-4c3c-9c17-c75b72d91b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:06.355492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a2607-32c1-4c3c-9c17-c75b72d91b97 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:06.355826 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a2607-32c1-4c3c-9c17-c75b72d91b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:06.356200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a2607-32c1-4c3c-9c17-c75b72d91b97 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:06.356833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a2607-32c1-4c3c-9c17-c75b72d91b97 None admin] RBAC: Adding query filter params (name=image) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:06.357133 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a2607-32c1-4c3c-9c17-c75b72d91b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:06.358499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a2607-32c1-4c3c-9c17-c75b72d91b97 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:06.363773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 498/1002] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:06.369233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a2607-32c1-4c3c-9c17-c75b72d91b97 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:06.391908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d51ad-6c34-4ed1-ab43-2da5919e7293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:06.392571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d51ad-6c34-4ed1-ab43-2da5919e7293 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:06.392848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d51ad-6c34-4ed1-ab43-2da5919e7293 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:06.393124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d51ad-6c34-4ed1-ab43-2da5919e7293 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:06.393711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d51ad-6c34-4ed1-ab43-2da5919e7293 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:06.395059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d51ad-6c34-4ed1-ab43-2da5919e7293 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1b4d51ad-6c34-4ed1-ab43-2da5919e7293 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:06.404878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:06.405871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 10:15:06.406736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:06.410821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 505/1003] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 10:15:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:15:06.412559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d51ad-6c34-4ed1-ab43-2da5919e7293 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:06.417558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:06.475724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a2607-32c1-4c3c-9c17-c75b72d91b97 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:06.513866 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794056c-4707-4f95-a357-c0601a73b5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:06.514618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794056c-4707-4f95-a357-c0601a73b5ce None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:06.514823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794056c-4707-4f95-a357-c0601a73b5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:06.515336 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794056c-4707-4f95-a357-c0601a73b5ce None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:06.515978 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794056c-4707-4f95-a357-c0601a73b5ce None admin] RBAC: Adding query filter params (type=image) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:06.516344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794056c-4707-4f95-a357-c0601a73b5ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:06.517963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794056c-4707-4f95-a357-c0601a73b5ce None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:06.521537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d51ad-6c34-4ed1-ab43-2da5919e7293 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:06.522513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 499/1004] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:06.562945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694a7f-cb60-497e-8b70-9ff67918ae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:06.563587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694a7f-cb60-497e-8b70-9ff67918ae8e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:06.563865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694a7f-cb60-497e-8b70-9ff67918ae8e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:06.564171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694a7f-cb60-497e-8b70-9ff67918ae8e None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:06.564827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694a7f-cb60-497e-8b70-9ff67918ae8e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:06.565131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694a7f-cb60-497e-8b70-9ff67918ae8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:06.566532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694a7f-cb60-497e-8b70-9ff67918ae8e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:06.572555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 506/1005] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 10:15:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:06.580450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794056c-4707-4f95-a357-c0601a73b5ce None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:06.605099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:06.688400 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794056c-4707-4f95-a357-c0601a73b5ce None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:06.724205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713197cf-142e-436b-8b53-0f7cb2aaa07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:06.724816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713197cf-142e-436b-8b53-0f7cb2aaa07a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:06.725092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713197cf-142e-436b-8b53-0f7cb2aaa07a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:06.725361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713197cf-142e-436b-8b53-0f7cb2aaa07a None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:06.726033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713197cf-142e-436b-8b53-0f7cb2aaa07a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:06.726279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713197cf-142e-436b-8b53-0f7cb2aaa07a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:06.728207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713197cf-142e-436b-8b53-0f7cb2aaa07a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:06.733230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 500/1006] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 10:15:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:06.738617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694a7f-cb60-497e-8b70-9ff67918ae8e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:06.804344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:06.836983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694a7f-cb60-497e-8b70-9ff67918ae8e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:06.870846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975073bb-d05b-4176-b860-51d66a570b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:06.871455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975073bb-d05b-4176-b860-51d66a570b46 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:06.871732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975073bb-d05b-4176-b860-51d66a570b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:06.872025 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975073bb-d05b-4176-b860-51d66a570b46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:06.872701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975073bb-d05b-4176-b860-51d66a570b46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:06.874037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975073bb-d05b-4176-b860-51d66a570b46 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:06.945767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 507/1007] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:15:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:15:07.828788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019ee9a-820d-4a5c-915e-82ad1939f31d None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:07.829325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019ee9a-820d-4a5c-915e-82ad1939f31d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:07.829325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019ee9a-820d-4a5c-915e-82ad1939f31d None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:07.830782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 501/1008] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:07.836442 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85da2b-43d6-45cb-a693-64a77b57f2b0 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:07.837383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85da2b-43d6-45cb-a693-64a77b57f2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:07.837555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85da2b-43d6-45cb-a693-64a77b57f2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:07.856671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1f85da2b-43d6-45cb-a693-64a77b57f2b0 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:07.857839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1f85da2b-43d6-45cb-a693-64a77b57f2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:07.941077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 508/1009] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:07 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:08.204951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019ee9a-820d-4a5c-915e-82ad1939f31d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:08.294102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:08.311842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019ee9a-820d-4a5c-915e-82ad1939f31d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:08.347552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0ba93-108a-4f4b-811e-a769e3601283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:08.348220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0ba93-108a-4f4b-811e-a769e3601283 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:08.348501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0ba93-108a-4f4b-811e-a769e3601283 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:08.348771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0ba93-108a-4f4b-811e-a769e3601283 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:08.349343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0ba93-108a-4f4b-811e-a769e3601283 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:08.350687 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0ba93-108a-4f4b-811e-a769e3601283 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-e9e0ba93-108a-4f4b-811e-a769e3601283 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:08.359386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:08.360603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 10:15:08.361471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:08.362847 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 502/1010] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:15:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:08.366537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85da2b-43d6-45cb-a693-64a77b57f2b0 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:08.422298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:08.467181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85da2b-43d6-45cb-a693-64a77b57f2b0 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:08.501606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c709b-7bcb-455e-a9f4-467e07e5e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:08.502214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c709b-7bcb-455e-a9f4-467e07e5e53f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:08.502490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c709b-7bcb-455e-a9f4-467e07e5e53f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:08.502760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c709b-7bcb-455e-a9f4-467e07e5e53f None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:08.503583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c709b-7bcb-455e-a9f4-467e07e5e53f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:08.503922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c709b-7bcb-455e-a9f4-467e07e5e53f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:08.505327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c709b-7bcb-455e-a9f4-467e07e5e53f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:08.515168 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 509/1011] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:15:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:08.516896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0ba93-108a-4f4b-811e-a769e3601283 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:08.660967 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0ba93-108a-4f4b-811e-a769e3601283 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:08.694659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042b30b-6ff5-4237-b642-bd874614fc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:08.695549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042b30b-6ff5-4237-b642-bd874614fc05 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:08.696098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042b30b-6ff5-4237-b642-bd874614fc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:08.696575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042b30b-6ff5-4237-b642-bd874614fc05 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:08.697429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042b30b-6ff5-4237-b642-bd874614fc05 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:08.697902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042b30b-6ff5-4237-b642-bd874614fc05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:08.699433 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042b30b-6ff5-4237-b642-bd874614fc05 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:08.704695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 503/1012] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 10:15:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:08.710266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c709b-7bcb-455e-a9f4-467e07e5e53f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:08.713025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ebcba-355c-43e3-9321-1a55604e1f70 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:08.713427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ebcba-355c-43e3-9321-1a55604e1f70 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:08.713876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ebcba-355c-43e3-9321-1a55604e1f70 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:08.716489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 504/1013] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:15:08.722751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57e3c2-ac38-4599-b15b-876dd63e2c00 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:08.722964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57e3c2-ac38-4599-b15b-876dd63e2c00 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:08.723232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57e3c2-ac38-4599-b15b-876dd63e2c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:08.741946 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4d57e3c2-ac38-4599-b15b-876dd63e2c00 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:08.743172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4d57e3c2-ac38-4599-b15b-876dd63e2c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:08.751527 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:08.813834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 505/1014] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:15:08.818829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c709b-7bcb-455e-a9f4-467e07e5e53f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:08.836780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:08.854022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0cdc3-8c30-4189-b91b-743c9bcd0662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:08.854622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0cdc3-8c30-4189-b91b-743c9bcd0662 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:08.854900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0cdc3-8c30-4189-b91b-743c9bcd0662 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:08.855171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0cdc3-8c30-4189-b91b-743c9bcd0662 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:08.855844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0cdc3-8c30-4189-b91b-743c9bcd0662 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:08.857219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0cdc3-8c30-4189-b91b-743c9bcd0662 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:08.936248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 510/1015] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:15:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:15:09.095613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0cdc3-8c30-4189-b91b-743c9bcd0662 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:09.095925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa36618-7bbb-4ff8-a024-8e9a6121c32e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:09.096387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa36618-7bbb-4ff8-a024-8e9a6121c32e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:09.096486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa36618-7bbb-4ff8-a024-8e9a6121c32e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:09.097950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 506/1016] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:09.103719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba7cbb-09de-4faa-a3e8-33ac409b1662 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:09.104031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba7cbb-09de-4faa-a3e8-33ac409b1662 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:09.104313 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba7cbb-09de-4faa-a3e8-33ac409b1662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:09.122514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6dba7cbb-09de-4faa-a3e8-33ac409b1662 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:09.123716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6dba7cbb-09de-4faa-a3e8-33ac409b1662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:09.207774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 507/1017] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:09 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:15:09.219805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0cdc3-8c30-4189-b91b-743c9bcd0662 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:09.254376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f92d3b-098f-4bce-ad29-06f0f4803254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:09.254981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f92d3b-098f-4bce-ad29-06f0f4803254 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:09.255259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f92d3b-098f-4bce-ad29-06f0f4803254 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:09.255529 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f92d3b-098f-4bce-ad29-06f0f4803254 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:09.256217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f92d3b-098f-4bce-ad29-06f0f4803254 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:09.257560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f92d3b-098f-4bce-ad29-06f0f4803254 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:09.352762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 511/1018] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:15:09 2022] POST /identity/v3/services => generated 242 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:15:09.489797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba7cbb-09de-4faa-a3e8-33ac409b1662 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:09.559789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:09.592834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba7cbb-09de-4faa-a3e8-33ac409b1662 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:09.634156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34945fd2-bf60-4662-ad14-500d4b9db1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:09.634797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34945fd2-bf60-4662-ad14-500d4b9db1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:09.635078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34945fd2-bf60-4662-ad14-500d4b9db1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:09.635350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34945fd2-bf60-4662-ad14-500d4b9db1f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:09.636482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34945fd2-bf60-4662-ad14-500d4b9db1f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:09.637908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34945fd2-bf60-4662-ad14-500d4b9db1f4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:09.639619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 508/1019] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:09.645490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f92d3b-098f-4bce-ad29-06f0f4803254 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:09.681837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:09.748549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f92d3b-098f-4bce-ad29-06f0f4803254 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:09.782997 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6476da0-396b-41d4-ad3d-ab71d6df8554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:09.783602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6476da0-396b-41d4-ad3d-ab71d6df8554 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:09.783881 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6476da0-396b-41d4-ad3d-ab71d6df8554 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:09.784209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6476da0-396b-41d4-ad3d-ab71d6df8554 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:09.784833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6476da0-396b-41d4-ad3d-ab71d6df8554 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:09.786253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6476da0-396b-41d4-ad3d-ab71d6df8554 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:09.891907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 512/1020] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:15:09 2022] POST /identity/v3/projects => generated 311 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:15:11.181547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d77eab-3504-4f5e-a58a-99630f950713 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:11.182061 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d77eab-3504-4f5e-a58a-99630f950713 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:11.182061 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d77eab-3504-4f5e-a58a-99630f950713 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:11.184039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 509/1021] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:11.188805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec94ea-3310-4685-a4b6-4bee90dc1f3d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:11.189211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec94ea-3310-4685-a4b6-4bee90dc1f3d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:11.189393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec94ea-3310-4685-a4b6-4bee90dc1f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:11.206943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3fec94ea-3310-4685-a4b6-4bee90dc1f3d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:11.208139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3fec94ea-3310-4685-a4b6-4bee90dc1f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:11.275235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 513/1022] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:11.538971 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d77eab-3504-4f5e-a58a-99630f950713 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:11.543346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a5d7-e8c4-4565-9548-f8ab730ce3bb None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:11.543700 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a5d7-e8c4-4565-9548-f8ab730ce3bb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:11.543999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a5d7-e8c4-4565-9548-f8ab730ce3bb None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:11.545383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 514/1023] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:11.550769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78009d86-6e97-4bd4-8941-3c5df7101f15 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:11.551055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78009d86-6e97-4bd4-8941-3c5df7101f15 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:11.551336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78009d86-6e97-4bd4-8941-3c5df7101f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:11.569859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-78009d86-6e97-4bd4-8941-3c5df7101f15 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:11.571088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-78009d86-6e97-4bd4-8941-3c5df7101f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:11.583911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:11.641878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d77eab-3504-4f5e-a58a-99630f950713 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:11.644116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 515/1024] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:15:11.673273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:11.678222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63856b93-c365-4988-afb1-dfcd6070e135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:11.678859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856b93-c365-4988-afb1-dfcd6070e135 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:11.679130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856b93-c365-4988-afb1-dfcd6070e135 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:11.682563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856b93-c365-4988-afb1-dfcd6070e135 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:11.690082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63856b93-c365-4988-afb1-dfcd6070e135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-63856b93-c365-4988-afb1-dfcd6070e135 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:15:11.694757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:11.695700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:11.700940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 510/1025] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Oct 4 10:15:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:11.702757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78009d86-6e97-4bd4-8941-3c5df7101f15 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:11.802271 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78009d86-6e97-4bd4-8941-3c5df7101f15 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:11.836733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0021-a736-4a92-b084-9cd061c35466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:11.837564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0021-a736-4a92-b084-9cd061c35466 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:11.837985 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0021-a736-4a92-b084-9cd061c35466 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:11.838413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0021-a736-4a92-b084-9cd061c35466 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:11.839208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa0021-a736-4a92-b084-9cd061c35466 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:11.839651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa0021-a736-4a92-b084-9cd061c35466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:11.841439 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa0021-a736-4a92-b084-9cd061c35466 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:11.849545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 516/1026] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 10:15:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:11.855863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63856b93-c365-4988-afb1-dfcd6070e135 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:11.914426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0021-a736-4a92-b084-9cd061c35466 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:11.926801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:11.970684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63856b93-c365-4988-afb1-dfcd6070e135 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:12.009230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03e5f7-3caf-4f76-9505-aa351ee9c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:12.009870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03e5f7-3caf-4f76-9505-aa351ee9c3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.010144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03e5f7-3caf-4f76-9505-aa351ee9c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.010422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03e5f7-3caf-4f76-9505-aa351ee9c3f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.020558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03e5f7-3caf-4f76-9505-aa351ee9c3f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:12.022033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03e5f7-3caf-4f76-9505-aa351ee9c3f4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:12.027974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0021-a736-4a92-b084-9cd061c35466 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-bc03e5f7-3caf-4f76-9505-aa351ee9c3f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:15:12.037407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:12.038364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:15:12.039308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:15:12.039308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:12.039308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:12.039308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 511/1027] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:12.044120 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03e5f7-3caf-4f76-9505-aa351ee9c3f4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:12.068239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c011a0-c509-4c43-8367-6697683a59b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:12.068778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c011a0-c509-4c43-8367-6697683a59b4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.069050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c011a0-c509-4c43-8367-6697683a59b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.069321 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c011a0-c509-4c43-8367-6697683a59b4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.069933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c011a0-c509-4c43-8367-6697683a59b4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:12.071805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c011a0-c509-4c43-8367-6697683a59b4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-02c011a0-c509-4c43-8367-6697683a59b4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:12.081220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:12.084391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:12.085241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 517/1028] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Oct 4 10:15:11 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:12.088825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202e219-3515-483e-ab1a-a9c6804b3334 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.089106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202e219-3515-483e-ab1a-a9c6804b3334 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.089379 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202e219-3515-483e-ab1a-a9c6804b3334 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.090618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 518/1029] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:12.091559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202e219-3515-483e-ab1a-a9c6804b3334 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:12.102335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:12.157448 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03e5f7-3caf-4f76-9505-aa351ee9c3f4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:12.164140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:12.190440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9570f-7e37-42bc-933e-29ea262010a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:12.191039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9570f-7e37-42bc-933e-29ea262010a8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.191320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9570f-7e37-42bc-933e-29ea262010a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.191579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9570f-7e37-42bc-933e-29ea262010a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.192239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9570f-7e37-42bc-933e-29ea262010a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:12.192537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9570f-7e37-42bc-933e-29ea262010a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:12.193871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9570f-7e37-42bc-933e-29ea262010a8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:12.195123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202e219-3515-483e-ab1a-a9c6804b3334 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:12.205912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 512/1030] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:12.207203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2df3d-6154-4aac-9aa6-c755a2304eab None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.207486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2df3d-6154-4aac-9aa6-c755a2304eab None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.207760 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2df3d-6154-4aac-9aa6-c755a2304eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.225642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-94c2df3d-6154-4aac-9aa6-c755a2304eab None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:12.226772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-94c2df3d-6154-4aac-9aa6-c755a2304eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:12.229408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d92b7-cc0c-4e53-9346-8a5a504f18e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:12.230003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d92b7-cc0c-4e53-9346-8a5a504f18e7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.230282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d92b7-cc0c-4e53-9346-8a5a504f18e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.230550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d92b7-cc0c-4e53-9346-8a5a504f18e7 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.231160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d92b7-cc0c-4e53-9346-8a5a504f18e7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:12.231458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d92b7-cc0c-4e53-9346-8a5a504f18e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:12.232809 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d92b7-cc0c-4e53-9346-8a5a504f18e7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:12.237756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 519/1031] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:12.238512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d92b7-cc0c-4e53-9346-8a5a504f18e7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:12.295733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 513/1032] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:12.296684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2df3d-6154-4aac-9aa6-c755a2304eab None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:12.330213 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:12.344800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d92b7-cc0c-4e53-9346-8a5a504f18e7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:12.381328 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c520d75-b9f3-48ba-9347-692520ec5b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:12.381949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c520d75-b9f3-48ba-9347-692520ec5b9c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.382227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c520d75-b9f3-48ba-9347-692520ec5b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.382499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c520d75-b9f3-48ba-9347-692520ec5b9c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.386210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:12.391735 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c520d75-b9f3-48ba-9347-692520ec5b9c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:12.393196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c520d75-b9f3-48ba-9347-692520ec5b9c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:12.401241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2df3d-6154-4aac-9aa6-c755a2304eab None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-8c520d75-b9f3-48ba-9347-692520ec5b9c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:15:12.404101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:12.408916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:12.409889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:12.409889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:12.409889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:15:12.409889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:15:12.409889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:15:12.409889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:15:12.409889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:15:12.409889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:15:12.409889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:15:12.409889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:12.409889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 520/1033] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 10:15:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:12.410840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c520d75-b9f3-48ba-9347-692520ec5b9c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:12.441041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041c007-15b4-4b50-b2e7-be2cec21bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:12.441676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041c007-15b4-4b50-b2e7-be2cec21bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.441953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041c007-15b4-4b50-b2e7-be2cec21bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.442391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041c007-15b4-4b50-b2e7-be2cec21bcd5 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.442839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041c007-15b4-4b50-b2e7-be2cec21bcd5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:12.443138 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041c007-15b4-4b50-b2e7-be2cec21bcd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:12.444521 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041c007-15b4-4b50-b2e7-be2cec21bcd5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:12.451234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 514/1034] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:12.456043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041c007-15b4-4b50-b2e7-be2cec21bcd5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:12.520455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c520d75-b9f3-48ba-9347-692520ec5b9c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:12.556567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:12.559227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d9b67-8b53-4b3f-8502-358429288201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:12.559835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d9b67-8b53-4b3f-8502-358429288201 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.560141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d9b67-8b53-4b3f-8502-358429288201 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.560414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d9b67-8b53-4b3f-8502-358429288201 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.560732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041c007-15b4-4b50-b2e7-be2cec21bcd5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:12.561139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d9b67-8b53-4b3f-8502-358429288201 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:12.561675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d9b67-8b53-4b3f-8502-358429288201 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:12.562864 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d9b67-8b53-4b3f-8502-358429288201 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:12.580728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 521/1035] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 10:15:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:12.581469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d9b67-8b53-4b3f-8502-358429288201 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:12.596130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a15dc1-a4c4-4b94-8826-7f1d3abcb304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:12.596729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15dc1-a4c4-4b94-8826-7f1d3abcb304 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.597004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15dc1-a4c4-4b94-8826-7f1d3abcb304 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.597270 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15dc1-a4c4-4b94-8826-7f1d3abcb304 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.597953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a15dc1-a4c4-4b94-8826-7f1d3abcb304 None admin] RBAC: Adding query filter params (interface=public, service_id=ddfcd2b94cae4902bd51a0dc7a398f1c, region_id=RegionOne) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:12.598253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a15dc1-a4c4-4b94-8826-7f1d3abcb304 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:12.599588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a15dc1-a4c4-4b94-8826-7f1d3abcb304 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:12.605061 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 515/1036] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 10:15:12 2022] GET /identity/v3/endpoints?service_id=ddfcd2b94cae4902bd51a0dc7a398f1c&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:12.605810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a15dc1-a4c4-4b94-8826-7f1d3abcb304 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:12.640325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:12.683193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d9b67-8b53-4b3f-8502-358429288201 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:12.700749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a15dc1-a4c4-4b94-8826-7f1d3abcb304 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:12.715518 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696d07-854e-4ff8-ae59-b298c9ab122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:12.716414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696d07-854e-4ff8-ae59-b298c9ab122d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.716688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696d07-854e-4ff8-ae59-b298c9ab122d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.716956 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696d07-854e-4ff8-ae59-b298c9ab122d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.718055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25696d07-854e-4ff8-ae59-b298c9ab122d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:12.719452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25696d07-854e-4ff8-ae59-b298c9ab122d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:12.721182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 522/1037] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:12.721774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696d07-854e-4ff8-ae59-b298c9ab122d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:12.737475 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201ca19-9d71-43fd-b6eb-bfef175d0107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:12.738079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201ca19-9d71-43fd-b6eb-bfef175d0107 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.738360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201ca19-9d71-43fd-b6eb-bfef175d0107 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.738633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201ca19-9d71-43fd-b6eb-bfef175d0107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.768101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:12.806032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201ca19-9d71-43fd-b6eb-bfef175d0107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:12.807472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201ca19-9d71-43fd-b6eb-bfef175d0107 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:12.817576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696d07-854e-4ff8-ae59-b298c9ab122d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:12.840441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:12.851817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a419b44-959f-4448-81cc-5c5a8b38d122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:12.852464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a419b44-959f-4448-81cc-5c5a8b38d122 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:12.852743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a419b44-959f-4448-81cc-5c5a8b38d122 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:12.853018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a419b44-959f-4448-81cc-5c5a8b38d122 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:12.853618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a419b44-959f-4448-81cc-5c5a8b38d122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:12.854956 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a419b44-959f-4448-81cc-5c5a8b38d122 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:12.861395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 523/1038] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 10:15:12 2022] GET /identity/v3/services => generated 1957 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:15:12.862152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a419b44-959f-4448-81cc-5c5a8b38d122 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:12.909705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 516/1039] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:15:12 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:15:12.916516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201ca19-9d71-43fd-b6eb-bfef175d0107 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:12.982153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a419b44-959f-4448-81cc-5c5a8b38d122 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:12.988235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:13.020460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f49a3d-591e-40c4-bc8d-4e7bba92bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:13.021376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f49a3d-591e-40c4-bc8d-4e7bba92bfab None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:13.021777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f49a3d-591e-40c4-bc8d-4e7bba92bfab None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:13.021912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f49a3d-591e-40c4-bc8d-4e7bba92bfab None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:13.022568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f49a3d-591e-40c4-bc8d-4e7bba92bfab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:13.024533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f49a3d-591e-40c4-bc8d-4e7bba92bfab None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:13.035060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201ca19-9d71-43fd-b6eb-bfef175d0107 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:13.070244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf916e4d-5f0c-4432-8eab-ce8decf931f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:13.070887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf916e4d-5f0c-4432-8eab-ce8decf931f9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:13.071164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf916e4d-5f0c-4432-8eab-ce8decf931f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:13.071437 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf916e4d-5f0c-4432-8eab-ce8decf931f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:13.082269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf916e4d-5f0c-4432-8eab-ce8decf931f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:13.083700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf916e4d-5f0c-4432-8eab-ce8decf931f9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-bf916e4d-5f0c-4432-8eab-ce8decf931f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:15:13.098510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:13.099508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:15:13.100461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:15:13.100461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:13.100461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:13.100461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 517/1040] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:13.105808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf916e4d-5f0c-4432-8eab-ce8decf931f9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:13.147979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 524/1041] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:15:12 2022] POST /identity/v3/users => generated 285 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:15:13.226702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf916e4d-5f0c-4432-8eab-ce8decf931f9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:13.242830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:13.265020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b249945-e055-4a60-bbfd-a7dd1663ef2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:13.265650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249945-e055-4a60-bbfd-a7dd1663ef2f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:13.265936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249945-e055-4a60-bbfd-a7dd1663ef2f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:13.266226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249945-e055-4a60-bbfd-a7dd1663ef2f None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:13.266868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b249945-e055-4a60-bbfd-a7dd1663ef2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:13.267171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b249945-e055-4a60-bbfd-a7dd1663ef2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:13.268720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b249945-e055-4a60-bbfd-a7dd1663ef2f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:13.287520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 518/1042] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:13.289251 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f49a3d-591e-40c4-bc8d-4e7bba92bfab None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:13.338235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:13.396400 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f49a3d-591e-40c4-bc8d-4e7bba92bfab None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:13.431893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fd927-b4e6-44e3-9a37-6e3c3272d5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:13.432540 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fd927-b4e6-44e3-9a37-6e3c3272d5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:13.432813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fd927-b4e6-44e3-9a37-6e3c3272d5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:13.433079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fd927-b4e6-44e3-9a37-6e3c3272d5e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:13.439694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fd927-b4e6-44e3-9a37-6e3c3272d5e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:13.441194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fd927-b4e6-44e3-9a37-6e3c3272d5e5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-cb1fd927-b4e6-44e3-9a37-6e3c3272d5e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:15:13.452298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:13.453245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:13.454172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:15:13.454172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:15:13.454172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:15:13.454172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:15:13.454172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:15:13.454172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:15:13.454172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:15:13.454172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:13.454172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 525/1043] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:13.459094 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b249945-e055-4a60-bbfd-a7dd1663ef2f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:13.561936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b249945-e055-4a60-bbfd-a7dd1663ef2f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:13.595929 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792307cd-f809-487c-b2db-6d7054f0b125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:13.596560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792307cd-f809-487c-b2db-6d7054f0b125 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:13.596834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792307cd-f809-487c-b2db-6d7054f0b125 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:13.597104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792307cd-f809-487c-b2db-6d7054f0b125 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:13.597789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792307cd-f809-487c-b2db-6d7054f0b125 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:13.598091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792307cd-f809-487c-b2db-6d7054f0b125 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:13.599510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792307cd-f809-487c-b2db-6d7054f0b125 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:13.611736 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 519/1044] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:13.617871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fd927-b4e6-44e3-9a37-6e3c3272d5e5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:13.720431 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fd927-b4e6-44e3-9a37-6e3c3272d5e5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:13.721892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:13.755942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1bbcd-40b8-49da-8805-8b05b675de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:13.756597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1bbcd-40b8-49da-8805-8b05b675de6b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:13.756874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1bbcd-40b8-49da-8805-8b05b675de6b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:13.757145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1bbcd-40b8-49da-8805-8b05b675de6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:13.757887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1bbcd-40b8-49da-8805-8b05b675de6b None admin] RBAC: Adding query filter params (role.id=cb1326f1ee04493da8934ae44875422d, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=567188b7c4fe40c1a1623d2f60092d26) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:13.758193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1bbcd-40b8-49da-8805-8b05b675de6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:13.760225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1bbcd-40b8-49da-8805-8b05b675de6b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:13.771983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 526/1045] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:15:13 2022] GET /identity/v3/role_assignments?user.id=567188b7c4fe40c1a1623d2f60092d26&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=cb1326f1ee04493da8934ae44875422d => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:15.016026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da77c46-d125-494f-ae33-2932b5a16611 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:15.016536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da77c46-d125-494f-ae33-2932b5a16611 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:15.016647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da77c46-d125-494f-ae33-2932b5a16611 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:15.018056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 520/1046] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:15.023117 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f8c1-2925-46b0-a11c-5ca3ce693e7f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:15.023524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f8c1-2925-46b0-a11c-5ca3ce693e7f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:15.023698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f8c1-2925-46b0-a11c-5ca3ce693e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:15.042151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-35d3f8c1-2925-46b0-a11c-5ca3ce693e7f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:15.043319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-35d3f8c1-2925-46b0-a11c-5ca3ce693e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:15.109459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 527/1047] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:15.374137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da77c46-d125-494f-ae33-2932b5a16611 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:15.399973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7434cc2-ffa7-4772-8dc4-c532e7e8a924 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:15.400294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7434cc2-ffa7-4772-8dc4-c532e7e8a924 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:15.400570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7434cc2-ffa7-4772-8dc4-c532e7e8a924 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:15.401912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 528/1048] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:15.407038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34480202-c2ed-4889-96a8-a25322200af8 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:15.407329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34480202-c2ed-4889-96a8-a25322200af8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:15.407605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34480202-c2ed-4889-96a8-a25322200af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:15.413062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:15.426604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-34480202-c2ed-4889-96a8-a25322200af8 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:15.430546 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-34480202-c2ed-4889-96a8-a25322200af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:15.481900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da77c46-d125-494f-ae33-2932b5a16611 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:15.504510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 529/1049] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:15:15.517394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29165ac-1b77-4bf4-8aa8-f591f47e53a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:15.518036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29165ac-1b77-4bf4-8aa8-f591f47e53a2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:15.518310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29165ac-1b77-4bf4-8aa8-f591f47e53a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:15.521721 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29165ac-1b77-4bf4-8aa8-f591f47e53a2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:15.521721 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29165ac-1b77-4bf4-8aa8-f591f47e53a2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:15.521721 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29165ac-1b77-4bf4-8aa8-f591f47e53a2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-b29165ac-1b77-4bf4-8aa8-f591f47e53a2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:15.529917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:15.530911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 10:15:15.531791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:15.535840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 521/1050] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Oct 4 10:15:15 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:15.537181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34480202-c2ed-4889-96a8-a25322200af8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:15.564354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:15.635356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34480202-c2ed-4889-96a8-a25322200af8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:15.668268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08207547-e4c8-487f-a155-ef03bb5672f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:15.668866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08207547-e4c8-487f-a155-ef03bb5672f3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:15.669140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08207547-e4c8-487f-a155-ef03bb5672f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:15.669407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08207547-e4c8-487f-a155-ef03bb5672f3 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:15.670022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08207547-e4c8-487f-a155-ef03bb5672f3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:15.670319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08207547-e4c8-487f-a155-ef03bb5672f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:15.671659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08207547-e4c8-487f-a155-ef03bb5672f3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:15.681811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 530/1051] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:15.682746 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29165ac-1b77-4bf4-8aa8-f591f47e53a2 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:15.776617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08207547-e4c8-487f-a155-ef03bb5672f3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:15.781012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:15.786610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29165ac-1b77-4bf4-8aa8-f591f47e53a2 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:15.825316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca314c45-01cc-4b00-9914-a56c1e4bd3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:15.826096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca314c45-01cc-4b00-9914-a56c1e4bd3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:15.826374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca314c45-01cc-4b00-9914-a56c1e4bd3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:15.826730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca314c45-01cc-4b00-9914-a56c1e4bd3b8 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:15.828314 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca314c45-01cc-4b00-9914-a56c1e4bd3b8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:15.828621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca314c45-01cc-4b00-9914-a56c1e4bd3b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:15.829983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca314c45-01cc-4b00-9914-a56c1e4bd3b8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:15.838918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 522/1052] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:15.844687 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca314c45-01cc-4b00-9914-a56c1e4bd3b8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:15.880385 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:15.893752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08207547-e4c8-487f-a155-ef03bb5672f3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:15.925299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5090f9-32e9-4e3c-9f8f-d76348b98ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:15.925925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5090f9-32e9-4e3c-9f8f-d76348b98ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:15.926201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5090f9-32e9-4e3c-9f8f-d76348b98ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:15.926470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5090f9-32e9-4e3c-9f8f-d76348b98ce3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:15.937166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5090f9-32e9-4e3c-9f8f-d76348b98ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2b5090f9-32e9-4e3c-9f8f-d76348b98ce3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:15:15.941861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:15.942813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:15.943681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 531/1053] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:15:15.944730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b3e06-ca6b-496f-9587-b46804fc7b79 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:15.944730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b3e06-ca6b-496f-9587-b46804fc7b79 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:15.944974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b3e06-ca6b-496f-9587-b46804fc7b79 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:15.949298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca314c45-01cc-4b00-9914-a56c1e4bd3b8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:15.950247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 532/1054] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:15.950851 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b3e06-ca6b-496f-9587-b46804fc7b79 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:15.984083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc75ac-3736-4be7-adc6-e726e9608f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:15.984690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc75ac-3736-4be7-adc6-e726e9608f36 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:15.984968 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc75ac-3736-4be7-adc6-e726e9608f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:15.985238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc75ac-3736-4be7-adc6-e726e9608f36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:15.985899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc75ac-3736-4be7-adc6-e726e9608f36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:15.987252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc75ac-3736-4be7-adc6-e726e9608f36 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:16.049689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b3e06-ca6b-496f-9587-b46804fc7b79 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:16.079990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 523/1055] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:15:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:15:16.079990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13842d1c-cb47-452a-ab62-4a6e34ad7cb9 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:16.079990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13842d1c-cb47-452a-ab62-4a6e34ad7cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:16.079990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13842d1c-cb47-452a-ab62-4a6e34ad7cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:16.090305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-13842d1c-cb47-452a-ab62-4a6e34ad7cb9 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:16.091816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-13842d1c-cb47-452a-ab62-4a6e34ad7cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:16.106194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578e033-fde3-4813-b462-bf755ccb102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:16.106806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578e033-fde3-4813-b462-bf755ccb102b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:16.107080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578e033-fde3-4813-b462-bf755ccb102b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:16.107347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578e033-fde3-4813-b462-bf755ccb102b None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:16.108014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:16.108149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578e033-fde3-4813-b462-bf755ccb102b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:16.108336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578e033-fde3-4813-b462-bf755ccb102b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:16.109708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578e033-fde3-4813-b462-bf755ccb102b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:16.124129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 533/1056] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:16.125457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578e033-fde3-4813-b462-bf755ccb102b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:16.137933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:16.170696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 524/1057] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:16.236358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578e033-fde3-4813-b462-bf755ccb102b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:16.273782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2e935-8ab8-4918-a785-8b6901c81f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:16.274968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2e935-8ab8-4918-a785-8b6901c81f91 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:16.275247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2e935-8ab8-4918-a785-8b6901c81f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:16.275527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2e935-8ab8-4918-a785-8b6901c81f91 None admin] PATH_INFO: `/v3/users/358c0752bf5245e49b2d006f836d3d80` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:16.288987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2e935-8ab8-4918-a785-8b6901c81f91 None admin] RBAC: Authorizing `identity:get_user(user_id=358c0752bf5245e49b2d006f836d3d80)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:16.290504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2e935-8ab8-4918-a785-8b6901c81f91 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:16.292510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 534/1058] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:15:16 2022] GET /identity/v3/users/358c0752bf5245e49b2d006f836d3d80 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:16.297930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13842d1c-cb47-452a-ab62-4a6e34ad7cb9 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:16.402317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13842d1c-cb47-452a-ab62-4a6e34ad7cb9 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:16.436008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b64be-beac-4a2f-ace2-8751cb76b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:16.436543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b64be-beac-4a2f-ace2-8751cb76b8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:16.436819 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b64be-beac-4a2f-ace2-8751cb76b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:16.437088 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b64be-beac-4a2f-ace2-8751cb76b8d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:16.439177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2e935-8ab8-4918-a785-8b6901c81f91 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:16.457728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:16.508077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:16.520427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b64be-beac-4a2f-ace2-8751cb76b8d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:16.521890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b64be-beac-4a2f-ace2-8751cb76b8d5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:16.547260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2e935-8ab8-4918-a785-8b6901c81f91 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:16.587250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d424e6-6e33-4a3f-95c3-2f0e96a4a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:16.587877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d424e6-6e33-4a3f-95c3-2f0e96a4a828 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:16.588181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d424e6-6e33-4a3f-95c3-2f0e96a4a828 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:16.588447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d424e6-6e33-4a3f-95c3-2f0e96a4a828 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:16.599222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d424e6-6e33-4a3f-95c3-2f0e96a4a828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-67d424e6-6e33-4a3f-95c3-2f0e96a4a828 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:15:16.604645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:16.605578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:16.606425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 535/1059] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Oct 4 10:15:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:15:16.611614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d424e6-6e33-4a3f-95c3-2f0e96a4a828 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:16.627681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 525/1060] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:15:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:15:16.633202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b64be-beac-4a2f-ace2-8751cb76b8d5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:16.685063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:16.725649 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d424e6-6e33-4a3f-95c3-2f0e96a4a828 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:16.735653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b64be-beac-4a2f-ace2-8751cb76b8d5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:16.753577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:16.763344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb1ec-0f70-4f12-a56e-01186c613645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:16.763967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb1ec-0f70-4f12-a56e-01186c613645 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:16.764250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb1ec-0f70-4f12-a56e-01186c613645 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:16.765243 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb1ec-0f70-4f12-a56e-01186c613645 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:16.765448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeeb1ec-0f70-4f12-a56e-01186c613645 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:16.766054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeeb1ec-0f70-4f12-a56e-01186c613645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:16.767893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeeb1ec-0f70-4f12-a56e-01186c613645 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:16.770235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180b244-80cb-4ac6-87a9-6966bad75a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:16.770861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180b244-80cb-4ac6-87a9-6966bad75a70 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:16.771137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180b244-80cb-4ac6-87a9-6966bad75a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:16.771406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180b244-80cb-4ac6-87a9-6966bad75a70 None admin] PATH_INFO: `/v3/projects/8514ce584a8e46e0893e98a20c6c2180` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:16.772591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180b244-80cb-4ac6-87a9-6966bad75a70 None admin] RBAC: Authorizing `identity:get_project(project_id=8514ce584a8e46e0893e98a20c6c2180)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:16.773987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180b244-80cb-4ac6-87a9-6966bad75a70 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:16.781339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 526/1061] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:15:16 2022] GET /identity/v3/projects/8514ce584a8e46e0893e98a20c6c2180 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:16.781479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 536/1062] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 10:15:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:16.782232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180b244-80cb-4ac6-87a9-6966bad75a70 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:16.783404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb1ec-0f70-4f12-a56e-01186c613645 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:16.888407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180b244-80cb-4ac6-87a9-6966bad75a70 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:16.893154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb1ec-0f70-4f12-a56e-01186c613645 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:16.905636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:16.925745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e869ce-2044-43ad-8586-b3bb508996fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:16.926353 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e869ce-2044-43ad-8586-b3bb508996fd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:16.926629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e869ce-2044-43ad-8586-b3bb508996fd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:16.926898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e869ce-2044-43ad-8586-b3bb508996fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:16.927703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e869ce-2044-43ad-8586-b3bb508996fd None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=8514ce584a8e46e0893e98a20c6c2180, user.id=358c0752bf5245e49b2d006f836d3d80) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:16.927962 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e869ce-2044-43ad-8586-b3bb508996fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:16.929382 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e869ce-2044-43ad-8586-b3bb508996fd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:16.935004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e97e02-9569-4813-bae0-9de7ad8f3247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:16.935998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 527/1063] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:15:16 2022] GET /identity/v3/role_assignments?user.id=358c0752bf5245e49b2d006f836d3d80&scope.project.id=8514ce584a8e46e0893e98a20c6c2180&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:16.944916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97e02-9569-4813-bae0-9de7ad8f3247 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:16.945197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97e02-9569-4813-bae0-9de7ad8f3247 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:16.945615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97e02-9569-4813-bae0-9de7ad8f3247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:16.958295 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e97e02-9569-4813-bae0-9de7ad8f3247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:16.959876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e97e02-9569-4813-bae0-9de7ad8f3247 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-85e97e02-9569-4813-bae0-9de7ad8f3247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:15:16.976848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:16.978503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:15:16.984841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:15:16.984841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:16.984841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:16.984841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 537/1064] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:16.986690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e869ce-2044-43ad-8586-b3bb508996fd None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:17.096313 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e869ce-2044-43ad-8586-b3bb508996fd None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:17.131082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680aa867-a2d7-47fa-998e-9cd4893fe837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:17.131698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680aa867-a2d7-47fa-998e-9cd4893fe837 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:17.131997 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680aa867-a2d7-47fa-998e-9cd4893fe837 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:17.132272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680aa867-a2d7-47fa-998e-9cd4893fe837 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:17.132905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680aa867-a2d7-47fa-998e-9cd4893fe837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:17.133206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680aa867-a2d7-47fa-998e-9cd4893fe837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:17.135079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680aa867-a2d7-47fa-998e-9cd4893fe837 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:17.146837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 528/1065] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:17.152944 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e97e02-9569-4813-bae0-9de7ad8f3247 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:17.194356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:17.252745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e97e02-9569-4813-bae0-9de7ad8f3247 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:17.286194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b99e27-6579-4e70-b84c-fb144812ff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:17.286816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b99e27-6579-4e70-b84c-fb144812ff6d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:17.287095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b99e27-6579-4e70-b84c-fb144812ff6d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:17.287372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b99e27-6579-4e70-b84c-fb144812ff6d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:17.295329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b99e27-6579-4e70-b84c-fb144812ff6d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:17.296766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b99e27-6579-4e70-b84c-fb144812ff6d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f1b99e27-6579-4e70-b84c-fb144812ff6d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:15:17.307727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:17.308726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:17.309695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:17.309695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:17.309695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:15:17.309695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:15:17.309695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:15:17.309695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:15:17.309695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:15:17.309695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:15:17.309695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:15:17.309695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:17.314017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 538/1066] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 10:15:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:17.315303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680aa867-a2d7-47fa-998e-9cd4893fe837 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:17.366412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:17.426027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680aa867-a2d7-47fa-998e-9cd4893fe837 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:17.459795 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29453269-dfac-41a7-87c0-5a9c4b8a381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:17.460422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29453269-dfac-41a7-87c0-5a9c4b8a381c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:17.460704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29453269-dfac-41a7-87c0-5a9c4b8a381c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:17.460970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29453269-dfac-41a7-87c0-5a9c4b8a381c None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:17.462286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29453269-dfac-41a7-87c0-5a9c4b8a381c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:17.462588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29453269-dfac-41a7-87c0-5a9c4b8a381c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:17.464003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29453269-dfac-41a7-87c0-5a9c4b8a381c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:17.485735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 529/1067] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 10:15:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:17.487317 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b99e27-6579-4e70-b84c-fb144812ff6d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:17.589187 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:17.593188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b99e27-6579-4e70-b84c-fb144812ff6d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:17.627644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c3dd2-5062-4fe6-aefa-abe92d5d7c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:17.628314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c3dd2-5062-4fe6-aefa-abe92d5d7c0b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:17.628595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c3dd2-5062-4fe6-aefa-abe92d5d7c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:17.628868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c3dd2-5062-4fe6-aefa-abe92d5d7c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:17.639733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c3dd2-5062-4fe6-aefa-abe92d5d7c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:17.641200 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c3dd2-5062-4fe6-aefa-abe92d5d7c0b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-af1c3dd2-5062-4fe6-aefa-abe92d5d7c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:15:17.655870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:17.656940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:15:17.657865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:15:17.657865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:17.657865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:17.660016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 539/1068] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:17.663022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29453269-dfac-41a7-87c0-5a9c4b8a381c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:17.759144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:17.763350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29453269-dfac-41a7-87c0-5a9c4b8a381c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:17.798237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90869ba1-9c07-478b-ae6f-f15c76e8f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:17.799020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90869ba1-9c07-478b-ae6f-f15c76e8f395 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:17.799394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90869ba1-9c07-478b-ae6f-f15c76e8f395 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:17.799760 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90869ba1-9c07-478b-ae6f-f15c76e8f395 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:17.800558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90869ba1-9c07-478b-ae6f-f15c76e8f395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:17.800955 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90869ba1-9c07-478b-ae6f-f15c76e8f395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:17.802699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90869ba1-9c07-478b-ae6f-f15c76e8f395 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:17.815207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 530/1069] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:17.820686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c3dd2-5062-4fe6-aefa-abe92d5d7c0b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:17.925773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c3dd2-5062-4fe6-aefa-abe92d5d7c0b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:17.958745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caf04b-3f31-41d4-9ce4-29d4001fbd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:17.959355 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caf04b-3f31-41d4-9ce4-29d4001fbd08 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:17.959626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caf04b-3f31-41d4-9ce4-29d4001fbd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:17.959891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caf04b-3f31-41d4-9ce4-29d4001fbd08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:17.966594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caf04b-3f31-41d4-9ce4-29d4001fbd08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:17.968016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caf04b-3f31-41d4-9ce4-29d4001fbd08 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d0caf04b-3f31-41d4-9ce4-29d4001fbd08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:15:17.979981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:17.980862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:17.981792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:15:17.981792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:15:17.981792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:15:17.981792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:15:17.981792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:15:17.981792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:15:17.981792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:15:17.981792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:17.984028 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 540/1070] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:15:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:17.986858 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90869ba1-9c07-478b-ae6f-f15c76e8f395 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:18.086163 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90869ba1-9c07-478b-ae6f-f15c76e8f395 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:18.119936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cb46d-b096-4548-946c-325b2bd1a680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:18.120554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb46d-b096-4548-946c-325b2bd1a680 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:18.120823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb46d-b096-4548-946c-325b2bd1a680 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:18.121089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb46d-b096-4548-946c-325b2bd1a680 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:18.121762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cb46d-b096-4548-946c-325b2bd1a680 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:18.122063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cb46d-b096-4548-946c-325b2bd1a680 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:18.123464 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cb46d-b096-4548-946c-325b2bd1a680 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:18.136485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 531/1071] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:18.142263 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caf04b-3f31-41d4-9ce4-29d4001fbd08 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:18.159459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:18.247545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caf04b-3f31-41d4-9ce4-29d4001fbd08 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:18.276646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13385205-7dfc-4b1e-8a98-b11fcd5e1d45 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:18.276937 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13385205-7dfc-4b1e-8a98-b11fcd5e1d45 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:18.277210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13385205-7dfc-4b1e-8a98-b11fcd5e1d45 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:18.278546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 532/1072] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:15:18.282142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df0a36-d097-4d55-8d5b-64932aac3213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:18.282799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df0a36-d097-4d55-8d5b-64932aac3213 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:18.283073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df0a36-d097-4d55-8d5b-64932aac3213 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:18.283342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df0a36-d097-4d55-8d5b-64932aac3213 None admin] PATH_INFO: `/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/567188b7c4fe40c1a1623d2f60092d26/roles/cb1326f1ee04493da8934ae44875422d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:18.284405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47f4d8-2435-485d-9681-2d6bfcaa5a69 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:18.284863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47f4d8-2435-485d-9681-2d6bfcaa5a69 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:18.285308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47f4d8-2435-485d-9681-2d6bfcaa5a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:18.285526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df0a36-d097-4d55-8d5b-64932aac3213 None admin] RBAC: Authorizing `identity:create_grant(project_id=c41ae2f9d03c48be8017a1ca480bf7db, user_id=567188b7c4fe40c1a1623d2f60092d26, role_id=cb1326f1ee04493da8934ae44875422d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:18.286931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df0a36-d097-4d55-8d5b-64932aac3213 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:18.303671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-bc47f4d8-2435-485d-9681-2d6bfcaa5a69 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:18.304890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bc47f4d8-2435-485d-9681-2d6bfcaa5a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:18.318413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:18.370107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 541/1073] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:15:18 2022] PUT /identity/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/567188b7c4fe40c1a1623d2f60092d26/roles/cb1326f1ee04493da8934ae44875422d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:15:18.380234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 533/1074] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:18.636418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47f4d8-2435-485d-9681-2d6bfcaa5a69 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:18.736800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47f4d8-2435-485d-9681-2d6bfcaa5a69 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:18.771185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3644df3-9bae-43c7-b0a2-7eae1115384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:18.771795 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644df3-9bae-43c7-b0a2-7eae1115384e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:18.772108 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644df3-9bae-43c7-b0a2-7eae1115384e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:18.772381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644df3-9bae-43c7-b0a2-7eae1115384e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:18.791289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:18.843204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3644df3-9bae-43c7-b0a2-7eae1115384e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:18.844707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3644df3-9bae-43c7-b0a2-7eae1115384e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:18.951998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 534/1075] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:15:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:15:18.957489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df0a36-d097-4d55-8d5b-64932aac3213 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:19.030221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:19.060390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df0a36-d097-4d55-8d5b-64932aac3213 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:19.074505 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ca6fd-d9b6-4049-afc1-27ecc38fdc9f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:19.074843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ca6fd-d9b6-4049-afc1-27ecc38fdc9f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:19.075121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ca6fd-d9b6-4049-afc1-27ecc38fdc9f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:19.076513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 535/1076] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:15:19.081641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e78ddb-7143-4b4c-9a62-50f2d2dd17b2 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:19.081922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e78ddb-7143-4b4c-9a62-50f2d2dd17b2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:19.084079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e78ddb-7143-4b4c-9a62-50f2d2dd17b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:19.095985 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35f62b-fa5f-464a-997a-7a213a216cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:19.096630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35f62b-fa5f-464a-997a-7a213a216cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:19.096910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35f62b-fa5f-464a-997a-7a213a216cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:19.097183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35f62b-fa5f-464a-997a-7a213a216cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:19.100861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-23e78ddb-7143-4b4c-9a62-50f2d2dd17b2 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:19.102170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-23e78ddb-7143-4b4c-9a62-50f2d2dd17b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:19.108444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35f62b-fa5f-464a-997a-7a213a216cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:19.109878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35f62b-fa5f-464a-997a-7a213a216cc2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3c35f62b-fa5f-464a-997a-7a213a216cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:15:19.124615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:19.125607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:15:19.126533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:15:19.126533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:19.126533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:19.126533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 542/1077] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:15:19.131523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35f62b-fa5f-464a-997a-7a213a216cc2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:19.153745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:19.185065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 536/1078] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:15:19.237030 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35f62b-fa5f-464a-997a-7a213a216cc2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:19.261921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:19.272797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f548c-6bc6-490e-be74-6485f1a0e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:19.273403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f548c-6bc6-490e-be74-6485f1a0e425 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:19.273677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f548c-6bc6-490e-be74-6485f1a0e425 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:19.273943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f548c-6bc6-490e-be74-6485f1a0e425 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:19.274602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f548c-6bc6-490e-be74-6485f1a0e425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:19.274904 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f548c-6bc6-490e-be74-6485f1a0e425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:19.276267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f548c-6bc6-490e-be74-6485f1a0e425 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:19.296228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 543/1079] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:19.458772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e78ddb-7143-4b4c-9a62-50f2d2dd17b2 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:19.560988 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e78ddb-7143-4b4c-9a62-50f2d2dd17b2 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:19.597176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8728bc-434a-47e5-a7c1-1c94a1095c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:19.597822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8728bc-434a-47e5-a7c1-1c94a1095c24 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:19.598101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8728bc-434a-47e5-a7c1-1c94a1095c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:19.598374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8728bc-434a-47e5-a7c1-1c94a1095c24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:19.609636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8728bc-434a-47e5-a7c1-1c94a1095c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-7a8728bc-434a-47e5-a7c1-1c94a1095c24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:15:19.614526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:19.615508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:19.616800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 537/1080] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:19.621704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f548c-6bc6-490e-be74-6485f1a0e425 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:19.721758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f548c-6bc6-490e-be74-6485f1a0e425 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:19.754120 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79664dda-27b3-4383-9b0d-a58bf4329369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:19.754716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79664dda-27b3-4383-9b0d-a58bf4329369 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:19.754998 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79664dda-27b3-4383-9b0d-a58bf4329369 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:19.755272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79664dda-27b3-4383-9b0d-a58bf4329369 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:19.755927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79664dda-27b3-4383-9b0d-a58bf4329369 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:19.756256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79664dda-27b3-4383-9b0d-a58bf4329369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:19.757599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79664dda-27b3-4383-9b0d-a58bf4329369 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:19.765950 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 544/1081] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:15:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:19.771793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8728bc-434a-47e5-a7c1-1c94a1095c24 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:19.814198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:19.872563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8728bc-434a-47e5-a7c1-1c94a1095c24 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:19.905435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de7f10-eeae-4776-9a36-035471f25bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:19.906059 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de7f10-eeae-4776-9a36-035471f25bbd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:19.906334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de7f10-eeae-4776-9a36-035471f25bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:19.906604 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de7f10-eeae-4776-9a36-035471f25bbd None admin] PATH_INFO: `/v3/users/358c0752bf5245e49b2d006f836d3d80` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:19.912236 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de7f10-eeae-4776-9a36-035471f25bbd None admin] RBAC: Authorizing `identity:get_user(user_id=358c0752bf5245e49b2d006f836d3d80)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:19.913682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de7f10-eeae-4776-9a36-035471f25bbd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:19.915312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 538/1082] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:15:19 2022] GET /identity/v3/users/358c0752bf5245e49b2d006f836d3d80 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:19.921033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79664dda-27b3-4383-9b0d-a58bf4329369 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:19.966378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:20.018942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79664dda-27b3-4383-9b0d-a58bf4329369 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:20.050453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3af7f-8070-489c-9369-8b795e6e5d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:20.051070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3af7f-8070-489c-9369-8b795e6e5d48 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:20.051347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3af7f-8070-489c-9369-8b795e6e5d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:20.051619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3af7f-8070-489c-9369-8b795e6e5d48 None admin] PATH_INFO: `/v3/projects/8514ce584a8e46e0893e98a20c6c2180` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:20.052761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3af7f-8070-489c-9369-8b795e6e5d48 None admin] RBAC: Authorizing `identity:get_project(project_id=8514ce584a8e46e0893e98a20c6c2180)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:20.054162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3af7f-8070-489c-9369-8b795e6e5d48 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:20.056309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 545/1083] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:15:19 2022] GET /identity/v3/projects/8514ce584a8e46e0893e98a20c6c2180 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:20.062196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de7f10-eeae-4776-9a36-035471f25bbd None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:20.159025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de7f10-eeae-4776-9a36-035471f25bbd None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:20.166843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:20.193407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2f563-3e22-41d9-9705-5ddeae7322c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:20.194064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2f563-3e22-41d9-9705-5ddeae7322c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:20.194340 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2f563-3e22-41d9-9705-5ddeae7322c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:20.194609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2f563-3e22-41d9-9705-5ddeae7322c4 None admin] PATH_INFO: `/v3/projects/8514ce584a8e46e0893e98a20c6c2180/users/358c0752bf5245e49b2d006f836d3d80/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:20.196532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2f563-3e22-41d9-9705-5ddeae7322c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8514ce584a8e46e0893e98a20c6c2180, user_id=358c0752bf5245e49b2d006f836d3d80, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:20.197941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2f563-3e22-41d9-9705-5ddeae7322c4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:20.312802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 539/1084] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:15:20 2022] PUT /identity/v3/projects/8514ce584a8e46e0893e98a20c6c2180/users/358c0752bf5245e49b2d006f836d3d80/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:15:20.520633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3afa10-b31c-48e6-8c37-64f8adad8541 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:20.521148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3afa10-b31c-48e6-8c37-64f8adad8541 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:20.521258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3afa10-b31c-48e6-8c37-64f8adad8541 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:20.522630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 546/1085] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:20.528518 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3357b-0a57-40aa-8023-10ce31713850 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:20.528805 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3357b-0a57-40aa-8023-10ce31713850 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:20.529078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3357b-0a57-40aa-8023-10ce31713850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:20.548270 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3eb3357b-0a57-40aa-8023-10ce31713850 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:20.549463 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3eb3357b-0a57-40aa-8023-10ce31713850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:20.614515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 540/1086] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:20.880688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3afa10-b31c-48e6-8c37-64f8adad8541 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:20.984751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3afa10-b31c-48e6-8c37-64f8adad8541 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:20.998566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:21.018899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1157e-826a-4313-8b91-f02a06487384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:21.019559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1157e-826a-4313-8b91-f02a06487384 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:21.019834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1157e-826a-4313-8b91-f02a06487384 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:21.020139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1157e-826a-4313-8b91-f02a06487384 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:21.030965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1157e-826a-4313-8b91-f02a06487384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-afd1157e-826a-4313-8b91-f02a06487384 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:15:21.036100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:21.037229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:21.038118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 547/1087] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Oct 4 10:15:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:21.043911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3357b-0a57-40aa-8023-10ce31713850 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:21.134428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:21.140065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3357b-0a57-40aa-8023-10ce31713850 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:21.173178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6d945-22e3-4702-b1d8-1e41ed0cdc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:21.173903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6d945-22e3-4702-b1d8-1e41ed0cdc40 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:21.174084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6d945-22e3-4702-b1d8-1e41ed0cdc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:21.174680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6d945-22e3-4702-b1d8-1e41ed0cdc40 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:21.175575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6d945-22e3-4702-b1d8-1e41ed0cdc40 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:21.176343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6d945-22e3-4702-b1d8-1e41ed0cdc40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:21.177806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6d945-22e3-4702-b1d8-1e41ed0cdc40 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:21.186651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 541/1088] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 10:15:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:21.192516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1157e-826a-4313-8b91-f02a06487384 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:21.288235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1157e-826a-4313-8b91-f02a06487384 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:21.319745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a677268-a5b5-4f73-bd9f-68b81b18fd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:21.320370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a677268-a5b5-4f73-bd9f-68b81b18fd87 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:21.320646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a677268-a5b5-4f73-bd9f-68b81b18fd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:21.321537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a677268-a5b5-4f73-bd9f-68b81b18fd87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:21.332572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a677268-a5b5-4f73-bd9f-68b81b18fd87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:21.333981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a677268-a5b5-4f73-bd9f-68b81b18fd87 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6a677268-a5b5-4f73-bd9f-68b81b18fd87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:15:21.347589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:21.348762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:15:21.354437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:15:21.354437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:21.354437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:21.354437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 548/1089] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:21.354721 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6d945-22e3-4702-b1d8-1e41ed0cdc40 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:21.450776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6d945-22e3-4702-b1d8-1e41ed0cdc40 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:21.482885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeae856-7a58-4bb2-b8da-e3c3ad61cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:21.483476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeae856-7a58-4bb2-b8da-e3c3ad61cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:21.483749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeae856-7a58-4bb2-b8da-e3c3ad61cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:21.484056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeae856-7a58-4bb2-b8da-e3c3ad61cdb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:21.484691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeae856-7a58-4bb2-b8da-e3c3ad61cdb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:21.484988 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeae856-7a58-4bb2-b8da-e3c3ad61cdb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:21.486320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeae856-7a58-4bb2-b8da-e3c3ad61cdb4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:21.498230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 542/1090] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:21.503805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a677268-a5b5-4f73-bd9f-68b81b18fd87 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:21.531350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:21.601676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a677268-a5b5-4f73-bd9f-68b81b18fd87 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:21.633933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a027acd-460b-4f6e-8464-0243206f758f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:21.634545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a027acd-460b-4f6e-8464-0243206f758f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:21.634818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a027acd-460b-4f6e-8464-0243206f758f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:21.635084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a027acd-460b-4f6e-8464-0243206f758f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:21.642098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a027acd-460b-4f6e-8464-0243206f758f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:21.643490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a027acd-460b-4f6e-8464-0243206f758f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9a027acd-460b-4f6e-8464-0243206f758f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:15:21.654766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:21.660416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:21.661436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:21.661436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:21.661436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:15:21.661436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:15:21.661436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:15:21.661436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:15:21.661436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:15:21.661436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:15:21.661436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 10:15:21.661436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:21.661436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 549/1091] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 10:15:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:15:21.662034 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeae856-7a58-4bb2-b8da-e3c3ad61cdb4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:21.680007 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:21.763732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeae856-7a58-4bb2-b8da-e3c3ad61cdb4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:21.797088 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc97f94-72d0-4ba5-af15-84683d592087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:21.797691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc97f94-72d0-4ba5-af15-84683d592087 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:21.797975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc97f94-72d0-4ba5-af15-84683d592087 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:21.798245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc97f94-72d0-4ba5-af15-84683d592087 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:21.798962 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc97f94-72d0-4ba5-af15-84683d592087 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:21.799262 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc97f94-72d0-4ba5-af15-84683d592087 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:21.800693 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc97f94-72d0-4ba5-af15-84683d592087 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:21.817176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 543/1092] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 10:15:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:15:21.823298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a027acd-460b-4f6e-8464-0243206f758f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:21.905384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:21.922289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a027acd-460b-4f6e-8464-0243206f758f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:21.955691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658ba2c-0991-4a16-a116-7c6e99f61d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:21.956316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658ba2c-0991-4a16-a116-7c6e99f61d05 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:21.956595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658ba2c-0991-4a16-a116-7c6e99f61d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:21.956864 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658ba2c-0991-4a16-a116-7c6e99f61d05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:22.022050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658ba2c-0991-4a16-a116-7c6e99f61d05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:22.023404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658ba2c-0991-4a16-a116-7c6e99f61d05 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:22.103052 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:22.117654 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 550/1093] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:15:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 10:15:22.123926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc97f94-72d0-4ba5-af15-84683d592087 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:22.199339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:22.221174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc97f94-72d0-4ba5-af15-84683d592087 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:22.255204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654743f-e484-4dcc-8915-7a7b3b5cdc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:22.255826 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654743f-e484-4dcc-8915-7a7b3b5cdc76 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:22.256135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654743f-e484-4dcc-8915-7a7b3b5cdc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:22.256406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654743f-e484-4dcc-8915-7a7b3b5cdc76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:22.266705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654743f-e484-4dcc-8915-7a7b3b5cdc76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:22.268167 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654743f-e484-4dcc-8915-7a7b3b5cdc76 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-a654743f-e484-4dcc-8915-7a7b3b5cdc76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:15:22.283532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:22.284725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:15:22.285710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:15:22.285710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:15:22.285710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:22.285710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 544/1094] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:22.290461 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658ba2c-0991-4a16-a116-7c6e99f61d05 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:22.391021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658ba2c-0991-4a16-a116-7c6e99f61d05 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:22.424235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f61fe-14d4-45e0-9bc0-ddcee51469a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:22.424837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f61fe-14d4-45e0-9bc0-ddcee51469a6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:22.425114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f61fe-14d4-45e0-9bc0-ddcee51469a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:22.425384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f61fe-14d4-45e0-9bc0-ddcee51469a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:22.426019 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f61fe-14d4-45e0-9bc0-ddcee51469a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:22.426319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f61fe-14d4-45e0-9bc0-ddcee51469a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:22.427662 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f61fe-14d4-45e0-9bc0-ddcee51469a6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:22.438695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 551/1095] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:22.444339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654743f-e484-4dcc-8915-7a7b3b5cdc76 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:22.454938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee5a99-be92-478d-b5c3-2b35617c8516 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:22.455217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee5a99-be92-478d-b5c3-2b35617c8516 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:22.455489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee5a99-be92-478d-b5c3-2b35617c8516 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:22.456818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 552/1096] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:15:22.462511 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845ddcd-54c5-4150-9685-46595ffdad28 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:22.462792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845ddcd-54c5-4150-9685-46595ffdad28 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:22.463063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845ddcd-54c5-4150-9685-46595ffdad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:22.480788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0845ddcd-54c5-4150-9685-46595ffdad28 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:22.481973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0845ddcd-54c5-4150-9685-46595ffdad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:22.523406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:22.546854 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654743f-e484-4dcc-8915-7a7b3b5cdc76 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:22.552021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 553/1097] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:15:22.572611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:22.580165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820dca1-aefe-4160-add8-ecdc74db4fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:22.580788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820dca1-aefe-4160-add8-ecdc74db4fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:22.581062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820dca1-aefe-4160-add8-ecdc74db4fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:22.581328 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820dca1-aefe-4160-add8-ecdc74db4fe4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:22.588323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820dca1-aefe-4160-add8-ecdc74db4fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:22.589802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820dca1-aefe-4160-add8-ecdc74db4fe4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-4820dca1-aefe-4160-add8-ecdc74db4fe4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:15:22.600833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:22.606785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:22.607821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:15:22.607821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:15:22.607821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:15:22.607821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:15:22.607821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:15:22.607821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:15:22.607821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:15:22.607821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:22.607821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 545/1098] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:15:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:22.608431 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845ddcd-54c5-4150-9685-46595ffdad28 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:22.701871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845ddcd-54c5-4150-9685-46595ffdad28 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:22.734206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86b023-e2b3-49e6-87d2-d058dea944a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:22.734803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86b023-e2b3-49e6-87d2-d058dea944a8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:22.735082 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86b023-e2b3-49e6-87d2-d058dea944a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:22.735351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86b023-e2b3-49e6-87d2-d058dea944a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:22.736085 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86b023-e2b3-49e6-87d2-d058dea944a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:22.736390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86b023-e2b3-49e6-87d2-d058dea944a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:22.737789 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86b023-e2b3-49e6-87d2-d058dea944a8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:22.749289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 554/1099] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:22.755242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820dca1-aefe-4160-add8-ecdc74db4fe4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:22.814307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86b023-e2b3-49e6-87d2-d058dea944a8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:22.851601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:22.853797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820dca1-aefe-4160-add8-ecdc74db4fe4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:22.886484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2402523-a792-40ca-8b5f-af6c68381496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:22.887128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2402523-a792-40ca-8b5f-af6c68381496 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:22.887400 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2402523-a792-40ca-8b5f-af6c68381496 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:22.887667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2402523-a792-40ca-8b5f-af6c68381496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:22.888414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2402523-a792-40ca-8b5f-af6c68381496 None admin] RBAC: Adding query filter params (role.id=cb1326f1ee04493da8934ae44875422d, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=567188b7c4fe40c1a1623d2f60092d26) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:22.888718 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2402523-a792-40ca-8b5f-af6c68381496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:22.890124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2402523-a792-40ca-8b5f-af6c68381496 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:22.895784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 546/1100] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:15:22 2022] GET /identity/v3/role_assignments?user.id=567188b7c4fe40c1a1623d2f60092d26&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=cb1326f1ee04493da8934ae44875422d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:22.919893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86b023-e2b3-49e6-87d2-d058dea944a8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:22.955123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ba338-278f-4ea6-8227-03b57123c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:22.955768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ba338-278f-4ea6-8227-03b57123c387 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:22.956082 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ba338-278f-4ea6-8227-03b57123c387 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:22.956352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ba338-278f-4ea6-8227-03b57123c387 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:22.968777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ba338-278f-4ea6-8227-03b57123c387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-894ba338-278f-4ea6-8227-03b57123c387 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:15:22.973613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:22.974807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:22.975723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:22.975723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:22.975723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:22.975723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:22.975723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:15:22.975723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:15:22.975723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:15:22.975723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:15:22.975723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:15:22.975723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:15:22.975723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:15:22.975723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:22.980130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 555/1101] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:15:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:15:22.981565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2402523-a792-40ca-8b5f-af6c68381496 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:23.037012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:23.088288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2402523-a792-40ca-8b5f-af6c68381496 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:23.126022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9224-6b77-45c9-a86f-86e275c8e4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:23.126624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9224-6b77-45c9-a86f-86e275c8e4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:23.126897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9224-6b77-45c9-a86f-86e275c8e4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:23.127169 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9224-6b77-45c9-a86f-86e275c8e4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:23.127848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9224-6b77-45c9-a86f-86e275c8e4d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:23.128173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9224-6b77-45c9-a86f-86e275c8e4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:23.129549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9224-6b77-45c9-a86f-86e275c8e4d8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:23.139417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 547/1102] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:15:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:23.145404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ba338-278f-4ea6-8227-03b57123c387 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:23.245783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:23.251372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ba338-278f-4ea6-8227-03b57123c387 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:23.284200 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294398b6-425d-4d3c-952c-6343fc97a1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:23.284825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294398b6-425d-4d3c-952c-6343fc97a1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:23.285095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294398b6-425d-4d3c-952c-6343fc97a1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:23.285359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294398b6-425d-4d3c-952c-6343fc97a1c4 None admin] PATH_INFO: `/v3/users/358c0752bf5245e49b2d006f836d3d80` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:23.286471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294398b6-425d-4d3c-952c-6343fc97a1c4 None admin] RBAC: Authorizing `identity:get_user(user_id=358c0752bf5245e49b2d006f836d3d80)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:23.287864 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294398b6-425d-4d3c-952c-6343fc97a1c4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:23.289456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 556/1103] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:15:23 2022] GET /identity/v3/users/358c0752bf5245e49b2d006f836d3d80 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:23.295779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9224-6b77-45c9-a86f-86e275c8e4d8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:23.397811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9224-6b77-45c9-a86f-86e275c8e4d8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:23.412671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:23.433261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e728e-0d0e-4ae9-b40a-d606ee76e477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:23.433865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e728e-0d0e-4ae9-b40a-d606ee76e477 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:23.434137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e728e-0d0e-4ae9-b40a-d606ee76e477 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:23.434408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e728e-0d0e-4ae9-b40a-d606ee76e477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:23.507239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e728e-0d0e-4ae9-b40a-d606ee76e477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:23.509350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e728e-0d0e-4ae9-b40a-d606ee76e477 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:23.609543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 548/1104] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:15:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:15:23.615697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294398b6-425d-4d3c-952c-6343fc97a1c4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:23.715443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294398b6-425d-4d3c-952c-6343fc97a1c4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:23.748785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f884ff-1b9c-40cf-836a-884ed84682f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:23.749413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f884ff-1b9c-40cf-836a-884ed84682f6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:23.749690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f884ff-1b9c-40cf-836a-884ed84682f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:23.749964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f884ff-1b9c-40cf-836a-884ed84682f6 None admin] PATH_INFO: `/v3/projects/8514ce584a8e46e0893e98a20c6c2180` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:23.752074 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f884ff-1b9c-40cf-836a-884ed84682f6 None admin] RBAC: Authorizing `identity:get_project(project_id=8514ce584a8e46e0893e98a20c6c2180)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:23.752548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f884ff-1b9c-40cf-836a-884ed84682f6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:23.754173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 557/1105] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:15:23 2022] GET /identity/v3/projects/8514ce584a8e46e0893e98a20c6c2180 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:23.760776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e728e-0d0e-4ae9-b40a-d606ee76e477 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:23.776324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:23.859028 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e728e-0d0e-4ae9-b40a-d606ee76e477 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:23.891700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fa4c5-e8b2-454b-863d-f3ec1876faa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:23.892331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fa4c5-e8b2-454b-863d-f3ec1876faa1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:23.892611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fa4c5-e8b2-454b-863d-f3ec1876faa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:23.892883 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fa4c5-e8b2-454b-863d-f3ec1876faa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:23.893596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fa4c5-e8b2-454b-863d-f3ec1876faa1 None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=8514ce584a8e46e0893e98a20c6c2180, user.id=358c0752bf5245e49b2d006f836d3d80) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:23.893902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fa4c5-e8b2-454b-863d-f3ec1876faa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:23.895311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fa4c5-e8b2-454b-863d-f3ec1876faa1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:23.900957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 549/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:15:23 2022] GET /identity/v3/role_assignments?user.id=358c0752bf5245e49b2d006f836d3d80&scope.project.id=8514ce584a8e46e0893e98a20c6c2180&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:26.022321 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65297194-0200-4628-91ba-f08d0242a394 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:26.022834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65297194-0200-4628-91ba-f08d0242a394 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:26.022834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65297194-0200-4628-91ba-f08d0242a394 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:26.024723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 558/1107] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:26.029938 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07763bd5-0ded-4c24-86e5-4fc000d21fc5 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:26.030360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07763bd5-0ded-4c24-86e5-4fc000d21fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:26.030483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07763bd5-0ded-4c24-86e5-4fc000d21fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:26.048821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-07763bd5-0ded-4c24-86e5-4fc000d21fc5 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:26.050000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-07763bd5-0ded-4c24-86e5-4fc000d21fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:26.114092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 550/1108] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:26.381398 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65297194-0200-4628-91ba-f08d0242a394 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:26.413425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:26.481286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65297194-0200-4628-91ba-f08d0242a394 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:26.513723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983f1b8-1515-4fa9-96bd-b8278870004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:26.514332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983f1b8-1515-4fa9-96bd-b8278870004b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:26.514602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983f1b8-1515-4fa9-96bd-b8278870004b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:26.514869 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983f1b8-1515-4fa9-96bd-b8278870004b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:26.515982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983f1b8-1515-4fa9-96bd-b8278870004b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:26.522340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983f1b8-1515-4fa9-96bd-b8278870004b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:26.522340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 559/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:26.524603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07763bd5-0ded-4c24-86e5-4fc000d21fc5 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:26.534476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:26.621633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07763bd5-0ded-4c24-86e5-4fc000d21fc5 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:26.654830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e6110-0a54-470a-9472-77e274e61ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:26.655395 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e6110-0a54-470a-9472-77e274e61ca7 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:26.655673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e6110-0a54-470a-9472-77e274e61ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:26.655972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e6110-0a54-470a-9472-77e274e61ca7 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:26.656622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e6110-0a54-470a-9472-77e274e61ca7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:26.658041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e6110-0a54-470a-9472-77e274e61ca7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:26.768610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 551/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:15:26 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:15:28.910669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ad49c-f98d-4ef3-9654-2e7a11203e87 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:28.911201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ad49c-f98d-4ef3-9654-2e7a11203e87 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:28.911201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ad49c-f98d-4ef3-9654-2e7a11203e87 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:28.912709 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 560/1111] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:28.918838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244a399-a266-47f0-8de6-0d2a279b02db None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:28.919250 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244a399-a266-47f0-8de6-0d2a279b02db None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:28.919380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244a399-a266-47f0-8de6-0d2a279b02db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:28.937131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0244a399-a266-47f0-8de6-0d2a279b02db None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:28.938309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0244a399-a266-47f0-8de6-0d2a279b02db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:28.994929 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:29.002952 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 552/1112] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:15:29.267813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ad49c-f98d-4ef3-9654-2e7a11203e87 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:29.360784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:29.364395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ad49c-f98d-4ef3-9654-2e7a11203e87 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:29.396442 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ec6b4-0ee5-46fc-bc5a-f87d7d0766a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:29.397048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ec6b4-0ee5-46fc-bc5a-f87d7d0766a8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:29.397322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ec6b4-0ee5-46fc-bc5a-f87d7d0766a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:29.397590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ec6b4-0ee5-46fc-bc5a-f87d7d0766a8 None admin] PATH_INFO: `/v3/roles/f63ab1c53b2e4aa0bf00e4798908cbfb` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:29.398952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ec6b4-0ee5-46fc-bc5a-f87d7d0766a8 None admin] RBAC: Authorizing `identity:get_role(role_id=f63ab1c53b2e4aa0bf00e4798908cbfb)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:29.400907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ec6b4-0ee5-46fc-bc5a-f87d7d0766a8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:29.402199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 561/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:15:29 2022] GET /identity/v3/roles/f63ab1c53b2e4aa0bf00e4798908cbfb => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:29.407826 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244a399-a266-47f0-8de6-0d2a279b02db None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:29.502949 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244a399-a266-47f0-8de6-0d2a279b02db None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:29.562680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ebc00-ade1-47cb-be8f-e5d044a7e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:29.562680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ebc00-ade1-47cb-be8f-e5d044a7e930 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:29.562680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ebc00-ade1-47cb-be8f-e5d044a7e930 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:29.562680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ebc00-ade1-47cb-be8f-e5d044a7e930 None admin] PATH_INFO: `/v3/users/4b1ea1bb15e5493fb5fe9fbdaf01c0b5` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:29.563620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ebc00-ade1-47cb-be8f-e5d044a7e930 None admin] RBAC: Authorizing `identity:get_user(user_id=4b1ea1bb15e5493fb5fe9fbdaf01c0b5)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:29.563620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ebc00-ade1-47cb-be8f-e5d044a7e930 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:29.563620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 553/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:15:29 2022] GET /identity/v3/users/4b1ea1bb15e5493fb5fe9fbdaf01c0b5 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:29.563859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ec6b4-0ee5-46fc-bc5a-f87d7d0766a8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:29.666776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ec6b4-0ee5-46fc-bc5a-f87d7d0766a8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:29.698833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8262430-5873-4b47-a516-ad78b3879ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:29.699431 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8262430-5873-4b47-a516-ad78b3879ead None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:29.699708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8262430-5873-4b47-a516-ad78b3879ead None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:29.700003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8262430-5873-4b47-a516-ad78b3879ead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:29.733404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:29.764207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8262430-5873-4b47-a516-ad78b3879ead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:29.765623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8262430-5873-4b47-a516-ad78b3879ead None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:29.860818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 562/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:15:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:15:29.866608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ebc00-ade1-47cb-be8f-e5d044a7e930 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:29.924208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:29.973767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ebc00-ade1-47cb-be8f-e5d044a7e930 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:30.007013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c002d-cc69-4abd-a282-dde51c20873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:30.007642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c002d-cc69-4abd-a282-dde51c20873e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:30.007922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c002d-cc69-4abd-a282-dde51c20873e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:30.008228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c002d-cc69-4abd-a282-dde51c20873e None admin] PATH_INFO: `/v3/projects/8514ce584a8e46e0893e98a20c6c2180` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:30.009362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c002d-cc69-4abd-a282-dde51c20873e None admin] RBAC: Authorizing `identity:get_project(project_id=8514ce584a8e46e0893e98a20c6c2180)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:30.010783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c002d-cc69-4abd-a282-dde51c20873e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:30.012445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 554/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:15:29 2022] GET /identity/v3/projects/8514ce584a8e46e0893e98a20c6c2180 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:30.018518 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8262430-5873-4b47-a516-ad78b3879ead None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:30.081422 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:30.112528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8262430-5873-4b47-a516-ad78b3879ead None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:30.144854 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df2e2e-f5e6-492e-abca-bdc80697f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:30.145432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df2e2e-f5e6-492e-abca-bdc80697f959 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:30.145704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df2e2e-f5e6-492e-abca-bdc80697f959 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:30.145971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df2e2e-f5e6-492e-abca-bdc80697f959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:30.146675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df2e2e-f5e6-492e-abca-bdc80697f959 None admin] RBAC: Adding query filter params (role.id=f63ab1c53b2e4aa0bf00e4798908cbfb, scope.project.id=8514ce584a8e46e0893e98a20c6c2180, user.id=4b1ea1bb15e5493fb5fe9fbdaf01c0b5) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:30.146978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df2e2e-f5e6-492e-abca-bdc80697f959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:30.148413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df2e2e-f5e6-492e-abca-bdc80697f959 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:30.153697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 563/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:15:30 2022] GET /identity/v3/role_assignments?user.id=4b1ea1bb15e5493fb5fe9fbdaf01c0b5&scope.project.id=8514ce584a8e46e0893e98a20c6c2180&role.id=f63ab1c53b2e4aa0bf00e4798908cbfb => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:32.236925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de832e9-e21f-41e7-bab6-f68ddf53c3b3 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:32.237429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de832e9-e21f-41e7-bab6-f68ddf53c3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:32.237429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de832e9-e21f-41e7-bab6-f68ddf53c3b3 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:32.238694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 555/1118] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:32.243815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597940f-5655-4c17-abc5-bcebe0f88722 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:32.244269 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597940f-5655-4c17-abc5-bcebe0f88722 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:32.244364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597940f-5655-4c17-abc5-bcebe0f88722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:32.262438 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c597940f-5655-4c17-abc5-bcebe0f88722 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:32.263603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c597940f-5655-4c17-abc5-bcebe0f88722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:32.326474 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 564/1119] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:32.592868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de832e9-e21f-41e7-bab6-f68ddf53c3b3 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:32.688459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de832e9-e21f-41e7-bab6-f68ddf53c3b3 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:32.707670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:32.720836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edf451-eb9b-4021-bf33-9527600adc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:32.721450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edf451-eb9b-4021-bf33-9527600adc04 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:32.723069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edf451-eb9b-4021-bf33-9527600adc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:32.723069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edf451-eb9b-4021-bf33-9527600adc04 None admin] PATH_INFO: `/v3/roles/f63ab1c53b2e4aa0bf00e4798908cbfb` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:32.723304 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edf451-eb9b-4021-bf33-9527600adc04 None admin] RBAC: Authorizing `identity:get_role(role_id=f63ab1c53b2e4aa0bf00e4798908cbfb)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:32.724751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edf451-eb9b-4021-bf33-9527600adc04 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:32.726029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 556/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:15:32 2022] GET /identity/v3/roles/f63ab1c53b2e4aa0bf00e4798908cbfb => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:32.731741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597940f-5655-4c17-abc5-bcebe0f88722 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:32.790537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:32.828035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597940f-5655-4c17-abc5-bcebe0f88722 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:32.860792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97c570-a4c9-454a-9cbf-e84f37b6967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:32.861351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97c570-a4c9-454a-9cbf-e84f37b6967b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:32.861629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97c570-a4c9-454a-9cbf-e84f37b6967b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:32.861900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97c570-a4c9-454a-9cbf-e84f37b6967b None admin] PATH_INFO: `/v3/users/4b1ea1bb15e5493fb5fe9fbdaf01c0b5` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:32.863015 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97c570-a4c9-454a-9cbf-e84f37b6967b None admin] RBAC: Authorizing `identity:get_user(user_id=4b1ea1bb15e5493fb5fe9fbdaf01c0b5)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:32.864459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97c570-a4c9-454a-9cbf-e84f37b6967b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:32.866006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 565/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:15:32 2022] GET /identity/v3/users/4b1ea1bb15e5493fb5fe9fbdaf01c0b5 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:32.872678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edf451-eb9b-4021-bf33-9527600adc04 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:32.972559 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edf451-eb9b-4021-bf33-9527600adc04 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:33.006162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1fae8-5968-4500-8034-d78e7fd695a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:33.006781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1fae8-5968-4500-8034-d78e7fd695a6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:33.007060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1fae8-5968-4500-8034-d78e7fd695a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:33.007335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1fae8-5968-4500-8034-d78e7fd695a6 None admin] PATH_INFO: `/v3/projects/8514ce584a8e46e0893e98a20c6c2180` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:33.008487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1fae8-5968-4500-8034-d78e7fd695a6 None admin] RBAC: Authorizing `identity:get_project(project_id=8514ce584a8e46e0893e98a20c6c2180)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:33.009904 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1fae8-5968-4500-8034-d78e7fd695a6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:33.011519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 557/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:15:32 2022] GET /identity/v3/projects/8514ce584a8e46e0893e98a20c6c2180 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:33.017582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97c570-a4c9-454a-9cbf-e84f37b6967b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:33.113223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97c570-a4c9-454a-9cbf-e84f37b6967b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:33.140562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:33.146001 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a5f7f-dff1-47b6-a3cd-837c1a6ac66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:33.146634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a5f7f-dff1-47b6-a3cd-837c1a6ac66c None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:33.146909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a5f7f-dff1-47b6-a3cd-837c1a6ac66c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:33.147179 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a5f7f-dff1-47b6-a3cd-837c1a6ac66c None admin] PATH_INFO: `/v3/projects/8514ce584a8e46e0893e98a20c6c2180/users/4b1ea1bb15e5493fb5fe9fbdaf01c0b5/roles/f63ab1c53b2e4aa0bf00e4798908cbfb` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:33.149289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a5f7f-dff1-47b6-a3cd-837c1a6ac66c None admin] RBAC: Authorizing `identity:create_grant(project_id=8514ce584a8e46e0893e98a20c6c2180, user_id=4b1ea1bb15e5493fb5fe9fbdaf01c0b5, role_id=f63ab1c53b2e4aa0bf00e4798908cbfb)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:33.150686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a5f7f-dff1-47b6-a3cd-837c1a6ac66c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:33.215136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 566/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:15:33 2022] PUT /identity/v3/projects/8514ce584a8e46e0893e98a20c6c2180/users/4b1ea1bb15e5493fb5fe9fbdaf01c0b5/roles/f63ab1c53b2e4aa0bf00e4798908cbfb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:15:35.314702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643a98-593e-4707-8181-61d0d4a02665 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:35.315207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643a98-593e-4707-8181-61d0d4a02665 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:35.315207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643a98-593e-4707-8181-61d0d4a02665 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:35.316514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 558/1124] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:35.322145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329b3d3-fd9b-4c5a-9e6f-e6de63626ac8 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:35.322583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329b3d3-fd9b-4c5a-9e6f-e6de63626ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:35.322678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329b3d3-fd9b-4c5a-9e6f-e6de63626ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:35.340830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1329b3d3-fd9b-4c5a-9e6f-e6de63626ac8 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:35.341998 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1329b3d3-fd9b-4c5a-9e6f-e6de63626ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:35.405637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 567/1125] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:35.676870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643a98-593e-4707-8181-61d0d4a02665 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:35.733000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:35.776162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643a98-593e-4707-8181-61d0d4a02665 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:35.808663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537906e-860d-4fb2-b5fc-e7ca9cd760eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:35.809275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537906e-860d-4fb2-b5fc-e7ca9cd760eb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:35.809551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537906e-860d-4fb2-b5fc-e7ca9cd760eb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:35.809821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537906e-860d-4fb2-b5fc-e7ca9cd760eb None admin] PATH_INFO: `/v3/roles/f63ab1c53b2e4aa0bf00e4798908cbfb` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:35.811189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537906e-860d-4fb2-b5fc-e7ca9cd760eb None admin] RBAC: Authorizing `identity:get_role(role_id=f63ab1c53b2e4aa0bf00e4798908cbfb)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:35.812562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537906e-860d-4fb2-b5fc-e7ca9cd760eb None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:35.813861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 559/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:15:35 2022] GET /identity/v3/roles/f63ab1c53b2e4aa0bf00e4798908cbfb => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:35.819527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329b3d3-fd9b-4c5a-9e6f-e6de63626ac8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:35.918236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329b3d3-fd9b-4c5a-9e6f-e6de63626ac8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:35.937542 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:35.950911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35a7be-7347-4378-a592-050c4678ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:35.951524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a7be-7347-4378-a592-050c4678ff42 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:35.951797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a7be-7347-4378-a592-050c4678ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:35.952097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a7be-7347-4378-a592-050c4678ff42 None admin] PATH_INFO: `/v3/users/4b1ea1bb15e5493fb5fe9fbdaf01c0b5` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:35.953189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35a7be-7347-4378-a592-050c4678ff42 None admin] RBAC: Authorizing `identity:get_user(user_id=4b1ea1bb15e5493fb5fe9fbdaf01c0b5)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:35.954584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35a7be-7347-4378-a592-050c4678ff42 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:35.956160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 568/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:15:35 2022] GET /identity/v3/users/4b1ea1bb15e5493fb5fe9fbdaf01c0b5 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:35.962615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537906e-860d-4fb2-b5fc-e7ca9cd760eb None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:36.057350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537906e-860d-4fb2-b5fc-e7ca9cd760eb None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:36.079723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:36.089961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7fd08-0afe-4fd6-9313-861deec7d9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:36.090549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7fd08-0afe-4fd6-9313-861deec7d9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:36.090826 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7fd08-0afe-4fd6-9313-861deec7d9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:36.091089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7fd08-0afe-4fd6-9313-861deec7d9f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:36.155238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7fd08-0afe-4fd6-9313-861deec7d9f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:36.156689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7fd08-0afe-4fd6-9313-861deec7d9f7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:36.251408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 560/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:15:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:15:36.257475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35a7be-7347-4378-a592-050c4678ff42 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:36.351532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35a7be-7347-4378-a592-050c4678ff42 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:36.383857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ed1e2-523c-4497-8406-d39d2a705efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:36.384497 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ed1e2-523c-4497-8406-d39d2a705efe None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:36.384770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ed1e2-523c-4497-8406-d39d2a705efe None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:36.385037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ed1e2-523c-4497-8406-d39d2a705efe None admin] PATH_INFO: `/v3/projects/8514ce584a8e46e0893e98a20c6c2180` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:36.386124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ed1e2-523c-4497-8406-d39d2a705efe None admin] RBAC: Authorizing `identity:get_project(project_id=8514ce584a8e46e0893e98a20c6c2180)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:36.387515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ed1e2-523c-4497-8406-d39d2a705efe None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:36.389111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 569/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:15:36 2022] GET /identity/v3/projects/8514ce584a8e46e0893e98a20c6c2180 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:36.395084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7fd08-0afe-4fd6-9313-861deec7d9f7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:36.419485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:36.490584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7fd08-0afe-4fd6-9313-861deec7d9f7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:36.522746 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a28cb-3f27-4659-9af1-af3749775426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:36.523279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a28cb-3f27-4659-9af1-af3749775426 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:36.523555 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a28cb-3f27-4659-9af1-af3749775426 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:36.523825 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a28cb-3f27-4659-9af1-af3749775426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:36.525098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a28cb-3f27-4659-9af1-af3749775426 None admin] RBAC: Adding query filter params (role.id=f63ab1c53b2e4aa0bf00e4798908cbfb, scope.project.id=8514ce584a8e46e0893e98a20c6c2180, user.id=4b1ea1bb15e5493fb5fe9fbdaf01c0b5) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:36.525403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a28cb-3f27-4659-9af1-af3749775426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:36.526806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a28cb-3f27-4659-9af1-af3749775426 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:36.532416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 561/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:15:36 2022] GET /identity/v3/role_assignments?user.id=4b1ea1bb15e5493fb5fe9fbdaf01c0b5&scope.project.id=8514ce584a8e46e0893e98a20c6c2180&role.id=f63ab1c53b2e4aa0bf00e4798908cbfb => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:38.676908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247cf79-3dc8-44ee-86f0-5c8f6d2d3235 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:38.677438 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247cf79-3dc8-44ee-86f0-5c8f6d2d3235 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:38.677545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247cf79-3dc8-44ee-86f0-5c8f6d2d3235 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:38.678803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 570/1131] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:38.683936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceef28c-c90d-461e-b098-323db884b987 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:38.684389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceef28c-c90d-461e-b098-323db884b987 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:38.684483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceef28c-c90d-461e-b098-323db884b987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:38.701937 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-dceef28c-c90d-461e-b098-323db884b987 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:38.703098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dceef28c-c90d-461e-b098-323db884b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:38.766430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 562/1132] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:39.032957 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247cf79-3dc8-44ee-86f0-5c8f6d2d3235 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:39.087771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:39.130583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247cf79-3dc8-44ee-86f0-5c8f6d2d3235 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:39.162285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db11bbd-d370-48ca-849b-556e24efb8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:39.162895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11bbd-d370-48ca-849b-556e24efb8de None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:39.163173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11bbd-d370-48ca-849b-556e24efb8de None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:39.163445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11bbd-d370-48ca-849b-556e24efb8de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:39.164557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db11bbd-d370-48ca-849b-556e24efb8de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:39.166480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db11bbd-d370-48ca-849b-556e24efb8de None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:39.168031 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 571/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:39.173830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceef28c-c90d-461e-b098-323db884b987 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:39.191883 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:39.268146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceef28c-c90d-461e-b098-323db884b987 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:39.301038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b0872-0586-46ed-b139-be23db2e8a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:39.301571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b0872-0586-46ed-b139-be23db2e8a61 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:39.301844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b0872-0586-46ed-b139-be23db2e8a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:39.302110 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b0872-0586-46ed-b139-be23db2e8a61 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:39.302751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b0872-0586-46ed-b139-be23db2e8a61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:39.304166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b0872-0586-46ed-b139-be23db2e8a61 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:39.409274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 563/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:15:39 2022] POST /identity/v3/projects => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:15:41.566020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14570e7-0b94-462f-b128-e1bc80b16cb8 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:41.566629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14570e7-0b94-462f-b128-e1bc80b16cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:41.566629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14570e7-0b94-462f-b128-e1bc80b16cb8 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:41.567894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 572/1135] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:41.573855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c36b9-176d-42ad-ad13-bc69688f205c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:41.574290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c36b9-176d-42ad-ad13-bc69688f205c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:41.574391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c36b9-176d-42ad-ad13-bc69688f205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:41.592087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d24c36b9-176d-42ad-ad13-bc69688f205c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:41.593517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d24c36b9-176d-42ad-ad13-bc69688f205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:41.652765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:41.657139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 564/1136] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:41.922692 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14570e7-0b94-462f-b128-e1bc80b16cb8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:42.019174 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14570e7-0b94-462f-b128-e1bc80b16cb8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:42.041908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:42.051909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5fd97-37af-4c42-9497-1e069106398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:42.052548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5fd97-37af-4c42-9497-1e069106398f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:42.052826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5fd97-37af-4c42-9497-1e069106398f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:42.053097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5fd97-37af-4c42-9497-1e069106398f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:42.054336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5fd97-37af-4c42-9497-1e069106398f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:42.056404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5fd97-37af-4c42-9497-1e069106398f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:42.057966 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 573/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:15:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:42.063479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c36b9-176d-42ad-ad13-bc69688f205c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:42.158589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c36b9-176d-42ad-ad13-bc69688f205c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:42.192018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c04e2d-41fb-4e30-ad87-70e170f311b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:42.192575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c04e2d-41fb-4e30-ad87-70e170f311b5 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:42.192851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c04e2d-41fb-4e30-ad87-70e170f311b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:42.193121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c04e2d-41fb-4e30-ad87-70e170f311b5 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:42.193771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c04e2d-41fb-4e30-ad87-70e170f311b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:42.195171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c04e2d-41fb-4e30-ad87-70e170f311b5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:42.281755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 565/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:15:42 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:15:44.411517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2748a07-07ec-44fa-a706-e2001a3fa671 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:44.412073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2748a07-07ec-44fa-a706-e2001a3fa671 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:44.412073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2748a07-07ec-44fa-a706-e2001a3fa671 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:44.413405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 574/1139] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:44.419188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b112ca-789b-4875-8bf2-4f9547497914 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:44.419611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b112ca-789b-4875-8bf2-4f9547497914 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:44.419729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b112ca-789b-4875-8bf2-4f9547497914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:44.438930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-54b112ca-789b-4875-8bf2-4f9547497914 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:44.440300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-54b112ca-789b-4875-8bf2-4f9547497914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:44.489403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:44.505092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 566/1140] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:44.777081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2748a07-07ec-44fa-a706-e2001a3fa671 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:44.873556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2748a07-07ec-44fa-a706-e2001a3fa671 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:44.905633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f40e31-683e-4456-8904-eb0531e8e260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:44.906235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40e31-683e-4456-8904-eb0531e8e260 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:44.906509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40e31-683e-4456-8904-eb0531e8e260 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:44.906807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40e31-683e-4456-8904-eb0531e8e260 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:44.918175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f40e31-683e-4456-8904-eb0531e8e260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-55f40e31-683e-4456-8904-eb0531e8e260 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:15:44.922943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:44.924056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:44.925034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 575/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:15:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:44.930036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b112ca-789b-4875-8bf2-4f9547497914 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:45.025383 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b112ca-789b-4875-8bf2-4f9547497914 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:45.058024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c65b3-9876-469f-bc34-3ebd75f90fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:45.058564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c65b3-9876-469f-bc34-3ebd75f90fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:45.058843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c65b3-9876-469f-bc34-3ebd75f90fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:45.059114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c65b3-9876-469f-bc34-3ebd75f90fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:45.059773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c65b3-9876-469f-bc34-3ebd75f90fa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:45.060108 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c65b3-9876-469f-bc34-3ebd75f90fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:45.061464 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c65b3-9876-469f-bc34-3ebd75f90fa3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:45.069160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 567/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:15:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:45.075510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f40e31-683e-4456-8904-eb0531e8e260 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:45.126727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:45.171796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f40e31-683e-4456-8904-eb0531e8e260 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:45.204897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3317b7c-b88f-4713-848a-8f549598dec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:45.205509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3317b7c-b88f-4713-848a-8f549598dec9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:45.205790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3317b7c-b88f-4713-848a-8f549598dec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:45.206059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3317b7c-b88f-4713-848a-8f549598dec9 None admin] PATH_INFO: `/v3/users/52212bd26a46461f943a78e65fdb6b0d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:45.219325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3317b7c-b88f-4713-848a-8f549598dec9 None admin] RBAC: Authorizing `identity:get_user(user_id=52212bd26a46461f943a78e65fdb6b0d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:45.220767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3317b7c-b88f-4713-848a-8f549598dec9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:45.222331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 576/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:15:45 2022] GET /identity/v3/users/52212bd26a46461f943a78e65fdb6b0d => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:45.227973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c65b3-9876-469f-bc34-3ebd75f90fa3 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:45.275878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:45.325738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c65b3-9876-469f-bc34-3ebd75f90fa3 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:45.357760 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e87c4e-b152-4639-b0c6-c16e28757e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:45.358351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e87c4e-b152-4639-b0c6-c16e28757e16 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:45.358627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e87c4e-b152-4639-b0c6-c16e28757e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:45.358897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e87c4e-b152-4639-b0c6-c16e28757e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:45.422592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e87c4e-b152-4639-b0c6-c16e28757e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:45.424034 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e87c4e-b152-4639-b0c6-c16e28757e16 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:45.475879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:45.525172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 568/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:15:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:15:45.531134 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3317b7c-b88f-4713-848a-8f549598dec9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:45.626877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3317b7c-b88f-4713-848a-8f549598dec9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:45.637199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:45.659331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10d632-45b6-4e82-b176-1a6d1115aef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:45.659943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10d632-45b6-4e82-b176-1a6d1115aef1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:45.660260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10d632-45b6-4e82-b176-1a6d1115aef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:45.660532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10d632-45b6-4e82-b176-1a6d1115aef1 None admin] PATH_INFO: `/v3/projects/40d2393f7b2b4d689e17b8fc5c5ea34a` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:45.661635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10d632-45b6-4e82-b176-1a6d1115aef1 None admin] RBAC: Authorizing `identity:get_project(project_id=40d2393f7b2b4d689e17b8fc5c5ea34a)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:45.663041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10d632-45b6-4e82-b176-1a6d1115aef1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:45.665206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 577/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:15:45 2022] GET /identity/v3/projects/40d2393f7b2b4d689e17b8fc5c5ea34a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:45.671218 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e87c4e-b152-4639-b0c6-c16e28757e16 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:45.767084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e87c4e-b152-4639-b0c6-c16e28757e16 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:45.800153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc055766-1135-44a2-a339-856711a5b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:45.800749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc055766-1135-44a2-a339-856711a5b01e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:45.801029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc055766-1135-44a2-a339-856711a5b01e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:45.801303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc055766-1135-44a2-a339-856711a5b01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:45.802016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc055766-1135-44a2-a339-856711a5b01e None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=40d2393f7b2b4d689e17b8fc5c5ea34a, user.id=52212bd26a46461f943a78e65fdb6b0d) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:45.802325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc055766-1135-44a2-a339-856711a5b01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:45.803749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc055766-1135-44a2-a339-856711a5b01e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:45.809644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 569/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:15:45 2022] GET /identity/v3/role_assignments?user.id=52212bd26a46461f943a78e65fdb6b0d&scope.project.id=40d2393f7b2b4d689e17b8fc5c5ea34a&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:47.890149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f424c4-9049-4ffb-81d9-46c4bb6a2f56 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:47.890677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f424c4-9049-4ffb-81d9-46c4bb6a2f56 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:47.890677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f424c4-9049-4ffb-81d9-46c4bb6a2f56 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:47.892118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 578/1147] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:47.897245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23479bbe-54ab-4af0-a5c4-16555f985279 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:47.897670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23479bbe-54ab-4af0-a5c4-16555f985279 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:47.897779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23479bbe-54ab-4af0-a5c4-16555f985279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:47.916302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-23479bbe-54ab-4af0-a5c4-16555f985279 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:47.917477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-23479bbe-54ab-4af0-a5c4-16555f985279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:47.924745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:47.982363 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 570/1148] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:48.246476 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f424c4-9049-4ffb-81d9-46c4bb6a2f56 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:48.343368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f424c4-9049-4ffb-81d9-46c4bb6a2f56 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:48.375456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f0b73-550e-4506-9ca0-5a92ba7c435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:48.376087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0b73-550e-4506-9ca0-5a92ba7c435e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:48.376366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0b73-550e-4506-9ca0-5a92ba7c435e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:48.376635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0b73-550e-4506-9ca0-5a92ba7c435e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:48.386339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f0b73-550e-4506-9ca0-5a92ba7c435e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ae9f0b73-550e-4506-9ca0-5a92ba7c435e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:15:48.391006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:48.392098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:48.393316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 579/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:15:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:48.397965 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23479bbe-54ab-4af0-a5c4-16555f985279 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:48.493329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23479bbe-54ab-4af0-a5c4-16555f985279 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:48.526092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48736f-d871-4932-b7e2-58e7debd4c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:48.526624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48736f-d871-4932-b7e2-58e7debd4c89 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:48.526895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48736f-d871-4932-b7e2-58e7debd4c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:48.527160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48736f-d871-4932-b7e2-58e7debd4c89 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:48.527808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48736f-d871-4932-b7e2-58e7debd4c89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:48.528130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48736f-d871-4932-b7e2-58e7debd4c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:48.529467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48736f-d871-4932-b7e2-58e7debd4c89 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:48.537192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 571/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:48.542910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f0b73-550e-4506-9ca0-5a92ba7c435e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:48.581705 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:48.640500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f0b73-550e-4506-9ca0-5a92ba7c435e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:48.673281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51db45d-a7b1-4b34-ba9a-a19338796e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:48.673893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51db45d-a7b1-4b34-ba9a-a19338796e7d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:48.674173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51db45d-a7b1-4b34-ba9a-a19338796e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:48.674448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51db45d-a7b1-4b34-ba9a-a19338796e7d None admin] PATH_INFO: `/v3/users/52212bd26a46461f943a78e65fdb6b0d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:48.675559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51db45d-a7b1-4b34-ba9a-a19338796e7d None admin] RBAC: Authorizing `identity:get_user(user_id=52212bd26a46461f943a78e65fdb6b0d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:48.677035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51db45d-a7b1-4b34-ba9a-a19338796e7d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:48.678591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 580/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:15:48 2022] GET /identity/v3/users/52212bd26a46461f943a78e65fdb6b0d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:48.684901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48736f-d871-4932-b7e2-58e7debd4c89 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:48.688671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:48.784040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48736f-d871-4932-b7e2-58e7debd4c89 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:48.816881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41814b63-461e-46f9-9375-6784638703a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:48.817504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41814b63-461e-46f9-9375-6784638703a5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:48.817784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41814b63-461e-46f9-9375-6784638703a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:48.818060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41814b63-461e-46f9-9375-6784638703a5 None admin] PATH_INFO: `/v3/projects/40d2393f7b2b4d689e17b8fc5c5ea34a` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:48.819161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41814b63-461e-46f9-9375-6784638703a5 None admin] RBAC: Authorizing `identity:get_project(project_id=40d2393f7b2b4d689e17b8fc5c5ea34a)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:48.820610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41814b63-461e-46f9-9375-6784638703a5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:48.822267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 572/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:15:48 2022] GET /identity/v3/projects/40d2393f7b2b4d689e17b8fc5c5ea34a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:48.828189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51db45d-a7b1-4b34-ba9a-a19338796e7d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:48.923162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51db45d-a7b1-4b34-ba9a-a19338796e7d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:48.930286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:48.955785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826bafa-0c85-457c-b313-3dbef6f3906c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:48.956513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826bafa-0c85-457c-b313-3dbef6f3906c None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:48.956790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826bafa-0c85-457c-b313-3dbef6f3906c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:48.957057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826bafa-0c85-457c-b313-3dbef6f3906c None admin] PATH_INFO: `/v3/projects/40d2393f7b2b4d689e17b8fc5c5ea34a/users/52212bd26a46461f943a78e65fdb6b0d/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:48.958892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826bafa-0c85-457c-b313-3dbef6f3906c None admin] RBAC: Authorizing `identity:create_grant(project_id=40d2393f7b2b4d689e17b8fc5c5ea34a, user_id=52212bd26a46461f943a78e65fdb6b0d, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:48.960313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826bafa-0c85-457c-b313-3dbef6f3906c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:49.053615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 581/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:15:48 2022] PUT /identity/v3/projects/40d2393f7b2b4d689e17b8fc5c5ea34a/users/52212bd26a46461f943a78e65fdb6b0d/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:15:51.171070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10968a-dd69-4c0a-8c65-b9624d6bbb1b None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:51.171580 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10968a-dd69-4c0a-8c65-b9624d6bbb1b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:51.171580 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10968a-dd69-4c0a-8c65-b9624d6bbb1b None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:51.172901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 573/1154] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:51.178149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749677a7-521c-4f37-8181-c7aad2fe9253 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:51.178577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749677a7-521c-4f37-8181-c7aad2fe9253 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:51.178672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749677a7-521c-4f37-8181-c7aad2fe9253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:51.196786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-749677a7-521c-4f37-8181-c7aad2fe9253 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:51.197942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-749677a7-521c-4f37-8181-c7aad2fe9253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:51.262659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 582/1155] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:51.531652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10968a-dd69-4c0a-8c65-b9624d6bbb1b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:51.601234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:51.631274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10968a-dd69-4c0a-8c65-b9624d6bbb1b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:51.664074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1f437-722a-4ae6-88ee-96b351dbb73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:51.665199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1f437-722a-4ae6-88ee-96b351dbb73b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:51.665477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1f437-722a-4ae6-88ee-96b351dbb73b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:51.665746 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1f437-722a-4ae6-88ee-96b351dbb73b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:51.676085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1f437-722a-4ae6-88ee-96b351dbb73b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-dfb1f437-722a-4ae6-88ee-96b351dbb73b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:15:51.681443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:51.682587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:15:51.683446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 574/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:15:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:51.688701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749677a7-521c-4f37-8181-c7aad2fe9253 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:51.777307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:51.782807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749677a7-521c-4f37-8181-c7aad2fe9253 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:51.816385 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b105cb-53b2-448e-ba30-ff2790cf6d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:51.816982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b105cb-53b2-448e-ba30-ff2790cf6d52 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:51.817260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b105cb-53b2-448e-ba30-ff2790cf6d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:51.817531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b105cb-53b2-448e-ba30-ff2790cf6d52 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:51.818189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b105cb-53b2-448e-ba30-ff2790cf6d52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:51.818494 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b105cb-53b2-448e-ba30-ff2790cf6d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:51.819881 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b105cb-53b2-448e-ba30-ff2790cf6d52 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:51.828079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 583/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:15:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:51.834019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1f437-722a-4ae6-88ee-96b351dbb73b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:51.933040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1f437-722a-4ae6-88ee-96b351dbb73b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:51.960317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:51.965489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e4fb9-9693-4488-9911-5cb916dc00a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:51.966103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e4fb9-9693-4488-9911-5cb916dc00a6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:51.966377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e4fb9-9693-4488-9911-5cb916dc00a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:51.966694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e4fb9-9693-4488-9911-5cb916dc00a6 None admin] PATH_INFO: `/v3/users/52212bd26a46461f943a78e65fdb6b0d` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:51.967806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e4fb9-9693-4488-9911-5cb916dc00a6 None admin] RBAC: Authorizing `identity:get_user(user_id=52212bd26a46461f943a78e65fdb6b0d)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:51.969511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e4fb9-9693-4488-9911-5cb916dc00a6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:51.974871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 575/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:15:51 2022] GET /identity/v3/users/52212bd26a46461f943a78e65fdb6b0d => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:51.976742 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b105cb-53b2-448e-ba30-ff2790cf6d52 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:52.071182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b105cb-53b2-448e-ba30-ff2790cf6d52 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:52.103465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb0ce8-5a18-4c7f-80c3-ab5f82deb3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:52.104072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb0ce8-5a18-4c7f-80c3-ab5f82deb3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:52.104347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb0ce8-5a18-4c7f-80c3-ab5f82deb3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:52.104611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb0ce8-5a18-4c7f-80c3-ab5f82deb3f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:52.129355 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:52.168394 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb0ce8-5a18-4c7f-80c3-ab5f82deb3f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:52.169800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb0ce8-5a18-4c7f-80c3-ab5f82deb3f6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:52.261768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 584/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:15:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:15:52.267568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e4fb9-9693-4488-9911-5cb916dc00a6 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:52.363989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e4fb9-9693-4488-9911-5cb916dc00a6 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:52.396131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173567f-1123-4dc9-bcdc-69d89437999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:52.396742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173567f-1123-4dc9-bcdc-69d89437999f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:52.397018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173567f-1123-4dc9-bcdc-69d89437999f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:52.397289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173567f-1123-4dc9-bcdc-69d89437999f None admin] PATH_INFO: `/v3/projects/40d2393f7b2b4d689e17b8fc5c5ea34a` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:52.398387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173567f-1123-4dc9-bcdc-69d89437999f None admin] RBAC: Authorizing `identity:get_project(project_id=40d2393f7b2b4d689e17b8fc5c5ea34a)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:52.399857 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173567f-1123-4dc9-bcdc-69d89437999f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:52.401470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 576/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:15:52 2022] GET /identity/v3/projects/40d2393f7b2b4d689e17b8fc5c5ea34a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:52.407386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb0ce8-5a18-4c7f-80c3-ab5f82deb3f6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:52.467274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:52.507060 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb0ce8-5a18-4c7f-80c3-ab5f82deb3f6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:52.540564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b34063-4948-4300-9cb9-fbd492aa8655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:52.541186 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b34063-4948-4300-9cb9-fbd492aa8655 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:52.541463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b34063-4948-4300-9cb9-fbd492aa8655 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:52.541765 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b34063-4948-4300-9cb9-fbd492aa8655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:52.542492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b34063-4948-4300-9cb9-fbd492aa8655 None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=40d2393f7b2b4d689e17b8fc5c5ea34a, user.id=52212bd26a46461f943a78e65fdb6b0d) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:52.542796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b34063-4948-4300-9cb9-fbd492aa8655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:52.544213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b34063-4948-4300-9cb9-fbd492aa8655 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:52.549861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 585/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:15:52 2022] GET /identity/v3/role_assignments?user.id=52212bd26a46461f943a78e65fdb6b0d&scope.project.id=40d2393f7b2b4d689e17b8fc5c5ea34a&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:54.679836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c318a-4944-4b5d-b7d4-e1b1f1d8b5ab None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:54.680587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c318a-4944-4b5d-b7d4-e1b1f1d8b5ab None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:54.680587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c318a-4944-4b5d-b7d4-e1b1f1d8b5ab None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:54.681929 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 577/1162] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:54.687153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54858506-5a1d-4b8c-b445-3aac0666760f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:54.687570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54858506-5a1d-4b8c-b445-3aac0666760f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:54.687699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54858506-5a1d-4b8c-b445-3aac0666760f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:54.705950 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-54858506-5a1d-4b8c-b445-3aac0666760f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:54.707123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-54858506-5a1d-4b8c-b445-3aac0666760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:54.771347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 586/1163] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:55.045602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c318a-4944-4b5d-b7d4-e1b1f1d8b5ab None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:55.111284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:55.144036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c318a-4944-4b5d-b7d4-e1b1f1d8b5ab None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:55.175301 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9136913-e7a4-4b02-8bc7-b5a58e83a5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:55.175883 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9136913-e7a4-4b02-8bc7-b5a58e83a5bf None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:55.176184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9136913-e7a4-4b02-8bc7-b5a58e83a5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:55.176452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9136913-e7a4-4b02-8bc7-b5a58e83a5bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:55.239863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9136913-e7a4-4b02-8bc7-b5a58e83a5bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:55.241295 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9136913-e7a4-4b02-8bc7-b5a58e83a5bf None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:55.301678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:55.333949 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 578/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:15:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:15:55.339758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54858506-5a1d-4b8c-b445-3aac0666760f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:55.390022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:55.434160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54858506-5a1d-4b8c-b445-3aac0666760f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:55.465503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7e2bf-f1cf-4423-8702-103f1607ec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:55.466109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7e2bf-f1cf-4423-8702-103f1607ec00 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:55.466381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7e2bf-f1cf-4423-8702-103f1607ec00 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:55.466645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7e2bf-f1cf-4423-8702-103f1607ec00 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:55.473199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7e2bf-f1cf-4423-8702-103f1607ec00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:55.474618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7e2bf-f1cf-4423-8702-103f1607ec00 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3fc7e2bf-f1cf-4423-8702-103f1607ec00 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:15:55.486408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:15:55.487718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:15:55.488797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 587/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 10:15:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:15:55.493869 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9136913-e7a4-4b02-8bc7-b5a58e83a5bf None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:55.589038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9136913-e7a4-4b02-8bc7-b5a58e83a5bf None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:55.622207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a50c00-de22-4da4-9646-f2b7724327d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:55.622797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a50c00-de22-4da4-9646-f2b7724327d7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:55.623071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a50c00-de22-4da4-9646-f2b7724327d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:55.623340 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a50c00-de22-4da4-9646-f2b7724327d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:55.623993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a50c00-de22-4da4-9646-f2b7724327d7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:15:55.624291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a50c00-de22-4da4-9646-f2b7724327d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:55.625629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a50c00-de22-4da4-9646-f2b7724327d7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:55.632452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 579/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 10:15:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:15:57.738053 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf63517-e081-40b5-9efe-dc5ddf3d6da5 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:57.738616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf63517-e081-40b5-9efe-dc5ddf3d6da5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:57.738616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf63517-e081-40b5-9efe-dc5ddf3d6da5 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:57.739905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 588/1167] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:15:57.745774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7ac97-b4d2-4e68-a4b9-8cbc159bff1a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:57.746165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7ac97-b4d2-4e68-a4b9-8cbc159bff1a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:57.746317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7ac97-b4d2-4e68-a4b9-8cbc159bff1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:57.764013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-25a7ac97-b4d2-4e68-a4b9-8cbc159bff1a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:15:57.765208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-25a7ac97-b4d2-4e68-a4b9-8cbc159bff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:15:57.790284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:57.829274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 580/1168] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:15:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:15:58.099590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf63517-e081-40b5-9efe-dc5ddf3d6da5 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:15:58.195656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf63517-e081-40b5-9efe-dc5ddf3d6da5 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:15:58.207932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:15:58.228600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c06a76-5bac-4fc9-ad89-fd1236f83c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:15:58.229197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c06a76-5bac-4fc9-ad89-fd1236f83c6c None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:15:58.229476 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c06a76-5bac-4fc9-ad89-fd1236f83c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:15:58.229775 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c06a76-5bac-4fc9-ad89-fd1236f83c6c None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:15:58.230448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c06a76-5bac-4fc9-ad89-fd1236f83c6c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:15:58.231794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c06a76-5bac-4fc9-ad89-fd1236f83c6c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:15:58.290311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 589/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Tue Oct 4 10:15:58 2022] POST /identity/v3/domains => generated 267 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:16:00.424243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e67236-9c36-4dc1-a475-3d2a1fb5d05e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:00.424790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e67236-9c36-4dc1-a475-3d2a1fb5d05e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:00.424790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e67236-9c36-4dc1-a475-3d2a1fb5d05e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:00.426113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 581/1170] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:16:00.431300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d11d65-8a4e-47dc-993d-2a7b67b57ca2 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:00.431744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d11d65-8a4e-47dc-993d-2a7b67b57ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:00.431851 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d11d65-8a4e-47dc-993d-2a7b67b57ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:00.449705 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-80d11d65-8a4e-47dc-993d-2a7b67b57ca2 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:16:00.450959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-80d11d65-8a4e-47dc-993d-2a7b67b57ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:16:00.515745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 590/1171] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:16:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 10:16:00.781556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e67236-9c36-4dc1-a475-3d2a1fb5d05e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:00.878867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e67236-9c36-4dc1-a475-3d2a1fb5d05e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:00.912021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb5621-5e2e-450e-864a-feeb7c6605b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:00.912667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb5621-5e2e-450e-864a-feeb7c6605b8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:00.912949 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb5621-5e2e-450e-864a-feeb7c6605b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:00.913225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb5621-5e2e-450e-864a-feeb7c6605b8 None admin] PATH_INFO: `/v3/domains/ed71fe8d534c4d3eb2860ccef60b915e` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:00.924294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb5621-5e2e-450e-864a-feeb7c6605b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ed71fe8d534c4d3eb2860ccef60b915e)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:00.925715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb5621-5e2e-450e-864a-feeb7c6605b8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:00.927292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 582/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Tue Oct 4 10:16:00 2022] GET /identity/v3/domains/ed71fe8d534c4d3eb2860ccef60b915e => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:00.933696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d11d65-8a4e-47dc-993d-2a7b67b57ca2 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:01.026625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d11d65-8a4e-47dc-993d-2a7b67b57ca2 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:01.028116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:01.059432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87e1c5-fec9-4ca9-869a-342eeaa98e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:01.060082 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87e1c5-fec9-4ca9-869a-342eeaa98e88 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:01.060556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87e1c5-fec9-4ca9-869a-342eeaa98e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:01.060990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87e1c5-fec9-4ca9-869a-342eeaa98e88 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:01.061977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87e1c5-fec9-4ca9-869a-342eeaa98e88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:01.063409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87e1c5-fec9-4ca9-869a-342eeaa98e88 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:01.124845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 591/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:16:00 2022] POST /identity/v3/projects => generated 361 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:16:03.265081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22ce94-7979-4bc6-9bb5-6e9f80ba7de6 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:03.265589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22ce94-7979-4bc6-9bb5-6e9f80ba7de6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:03.265589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22ce94-7979-4bc6-9bb5-6e9f80ba7de6 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:03.267000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 583/1174] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:16:03.272492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a36875-0710-44d9-9390-011a91b1a70f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:03.272874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a36875-0710-44d9-9390-011a91b1a70f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:03.273043 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a36875-0710-44d9-9390-011a91b1a70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:03.290798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a8a36875-0710-44d9-9390-011a91b1a70f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:16:03.291998 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a8a36875-0710-44d9-9390-011a91b1a70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:16:03.357147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 592/1175] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:16:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:16:03.628592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22ce94-7979-4bc6-9bb5-6e9f80ba7de6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:03.654050 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:03.728884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22ce94-7979-4bc6-9bb5-6e9f80ba7de6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:03.761418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc1b23-3489-48e4-8327-d4a28667f254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:03.762033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc1b23-3489-48e4-8327-d4a28667f254 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:03.762311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc1b23-3489-48e4-8327-d4a28667f254 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:03.762586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc1b23-3489-48e4-8327-d4a28667f254 None admin] PATH_INFO: `/v3/domains/ed71fe8d534c4d3eb2860ccef60b915e` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:03.763711 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc1b23-3489-48e4-8327-d4a28667f254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ed71fe8d534c4d3eb2860ccef60b915e)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:03.765159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc1b23-3489-48e4-8327-d4a28667f254 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:03.766692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 584/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Tue Oct 4 10:16:03 2022] GET /identity/v3/domains/ed71fe8d534c4d3eb2860ccef60b915e => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:03.772342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a36875-0710-44d9-9390-011a91b1a70f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:03.850940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:03.866167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a36875-0710-44d9-9390-011a91b1a70f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:03.899375 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d64e35-84fe-464e-b7c2-6c750c57bad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:03.899892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d64e35-84fe-464e-b7c2-6c750c57bad2 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:03.900202 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d64e35-84fe-464e-b7c2-6c750c57bad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:03.900469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d64e35-84fe-464e-b7c2-6c750c57bad2 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:03.901102 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d64e35-84fe-464e-b7c2-6c750c57bad2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:03.902486 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d64e35-84fe-464e-b7c2-6c750c57bad2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:04.002507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 593/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:16:03 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:16:06.156243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a27d64-41e4-45d1-b064-dcfe90f805e8 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:06.156789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a27d64-41e4-45d1-b064-dcfe90f805e8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:06.156789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a27d64-41e4-45d1-b064-dcfe90f805e8 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:06.158101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 585/1178] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:16:06.163362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180b78a-0746-4b8c-a805-200248a0adbd None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:06.163771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180b78a-0746-4b8c-a805-200248a0adbd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:06.163870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180b78a-0746-4b8c-a805-200248a0adbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:06.182525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1180b78a-0746-4b8c-a805-200248a0adbd None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:16:06.183684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1180b78a-0746-4b8c-a805-200248a0adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:16:06.246319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 594/1179] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:16:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:16:06.511583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a27d64-41e4-45d1-b064-dcfe90f805e8 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:06.600527 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:06.610394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a27d64-41e4-45d1-b064-dcfe90f805e8 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:06.643359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9649cb-298f-401e-8a56-35354db103d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:06.643999 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9649cb-298f-401e-8a56-35354db103d3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:06.644336 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9649cb-298f-401e-8a56-35354db103d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:06.647740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9649cb-298f-401e-8a56-35354db103d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:06.654359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9649cb-298f-401e-8a56-35354db103d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-fa9649cb-298f-401e-8a56-35354db103d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:16:06.659030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:16:06.660166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:16:06.661057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 586/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:16:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:16:06.666738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180b78a-0746-4b8c-a805-200248a0adbd None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:06.732886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:06.762163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180b78a-0746-4b8c-a805-200248a0adbd None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:06.795370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fd2bd-44b4-4dde-818d-f0bf89382d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:06.795988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fd2bd-44b4-4dde-818d-f0bf89382d7e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:06.796265 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fd2bd-44b4-4dde-818d-f0bf89382d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:06.796531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fd2bd-44b4-4dde-818d-f0bf89382d7e None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:06.797182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fd2bd-44b4-4dde-818d-f0bf89382d7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:16:06.797477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fd2bd-44b4-4dde-818d-f0bf89382d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:06.798812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fd2bd-44b4-4dde-818d-f0bf89382d7e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:06.806606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 595/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:06.812612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9649cb-298f-401e-8a56-35354db103d3 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:06.909594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9649cb-298f-401e-8a56-35354db103d3 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:06.941810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110b73f-e991-4761-b526-5c8b52387317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:06.942429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110b73f-e991-4761-b526-5c8b52387317 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:06.942705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110b73f-e991-4761-b526-5c8b52387317 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:06.942973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110b73f-e991-4761-b526-5c8b52387317 None admin] PATH_INFO: `/v3/users/67f62328cb31469792c6bb2077e81707` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:06.955991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110b73f-e991-4761-b526-5c8b52387317 None admin] RBAC: Authorizing `identity:get_user(user_id=67f62328cb31469792c6bb2077e81707)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:06.957412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110b73f-e991-4761-b526-5c8b52387317 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:06.958997 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 587/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:16:06 2022] GET /identity/v3/users/67f62328cb31469792c6bb2077e81707 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:06.965346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fd2bd-44b4-4dde-818d-f0bf89382d7e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:07.061659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fd2bd-44b4-4dde-818d-f0bf89382d7e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:07.089399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:07.094338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44651d-62aa-4b7f-b82b-13151073cd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:07.094932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44651d-62aa-4b7f-b82b-13151073cd08 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:07.095209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44651d-62aa-4b7f-b82b-13151073cd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:07.095479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44651d-62aa-4b7f-b82b-13151073cd08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:07.159820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44651d-62aa-4b7f-b82b-13151073cd08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:07.161297 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44651d-62aa-4b7f-b82b-13151073cd08 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:07.255062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 596/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:16:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:16:07.261613 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110b73f-e991-4761-b526-5c8b52387317 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:07.272190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:07.357974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110b73f-e991-4761-b526-5c8b52387317 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:07.390420 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac8ed4-4b7c-4805-801c-40eb335e38e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:07.391035 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac8ed4-4b7c-4805-801c-40eb335e38e3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:07.391314 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac8ed4-4b7c-4805-801c-40eb335e38e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:07.391594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac8ed4-4b7c-4805-801c-40eb335e38e3 None admin] PATH_INFO: `/v3/projects/71b26ce89b8f4d0eb348483b49f8054e` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:07.392712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac8ed4-4b7c-4805-801c-40eb335e38e3 None admin] RBAC: Authorizing `identity:get_project(project_id=71b26ce89b8f4d0eb348483b49f8054e)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:07.394123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac8ed4-4b7c-4805-801c-40eb335e38e3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:07.395726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 588/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:16:07 2022] GET /identity/v3/projects/71b26ce89b8f4d0eb348483b49f8054e => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:07.401638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44651d-62aa-4b7f-b82b-13151073cd08 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:07.432139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:07.498188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44651d-62aa-4b7f-b82b-13151073cd08 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:07.531206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26616a4-2b6c-4046-8269-9b568dad4319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:07.531793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26616a4-2b6c-4046-8269-9b568dad4319 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:07.532117 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26616a4-2b6c-4046-8269-9b568dad4319 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:07.532391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26616a4-2b6c-4046-8269-9b568dad4319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:07.533104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26616a4-2b6c-4046-8269-9b568dad4319 None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=71b26ce89b8f4d0eb348483b49f8054e, user.id=67f62328cb31469792c6bb2077e81707) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:16:07.533413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26616a4-2b6c-4046-8269-9b568dad4319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:07.534812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26616a4-2b6c-4046-8269-9b568dad4319 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:07.540060 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 597/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:16:07 2022] GET /identity/v3/role_assignments?user.id=67f62328cb31469792c6bb2077e81707&scope.project.id=71b26ce89b8f4d0eb348483b49f8054e&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:09.622514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef267b96-a950-4eae-a31d-dafc6146c772 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:09.623041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef267b96-a950-4eae-a31d-dafc6146c772 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:09.623041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef267b96-a950-4eae-a31d-dafc6146c772 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:09.624440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 589/1186] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:16:09.629560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342a1d9-36e2-46d0-a642-cca57c51b45a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:09.629988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342a1d9-36e2-46d0-a642-cca57c51b45a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:09.630108 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342a1d9-36e2-46d0-a642-cca57c51b45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:09.648477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e342a1d9-36e2-46d0-a642-cca57c51b45a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:16:09.649649 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e342a1d9-36e2-46d0-a642-cca57c51b45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:16:09.713104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 598/1187] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:16:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:16:09.978717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef267b96-a950-4eae-a31d-dafc6146c772 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:10.053957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:10.077647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef267b96-a950-4eae-a31d-dafc6146c772 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:10.110699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ef415-d7f1-4afb-a991-243e2d913cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:10.111333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ef415-d7f1-4afb-a991-243e2d913cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:10.111614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ef415-d7f1-4afb-a991-243e2d913cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:10.111890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ef415-d7f1-4afb-a991-243e2d913cf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:10.122343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ef415-d7f1-4afb-a991-243e2d913cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-295ef415-d7f1-4afb-a991-243e2d913cf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:16:10.127067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:16:10.128192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:16:10.129245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 590/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:16:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:16:10.134822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342a1d9-36e2-46d0-a642-cca57c51b45a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:10.160127 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:10.229689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342a1d9-36e2-46d0-a642-cca57c51b45a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:10.263006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34929-ee23-4a54-b164-55689a12583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:10.263598 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34929-ee23-4a54-b164-55689a12583f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:10.263873 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34929-ee23-4a54-b164-55689a12583f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:10.264168 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34929-ee23-4a54-b164-55689a12583f None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:10.265133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d34929-ee23-4a54-b164-55689a12583f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:16:10.265499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d34929-ee23-4a54-b164-55689a12583f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:10.266831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d34929-ee23-4a54-b164-55689a12583f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:10.275208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 599/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:16:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:10.280877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ef415-d7f1-4afb-a991-243e2d913cf8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:10.377804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ef415-d7f1-4afb-a991-243e2d913cf8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:10.409475 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304e561-3318-44d6-a9e5-8ea6dc844010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:10.410078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304e561-3318-44d6-a9e5-8ea6dc844010 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:10.410352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304e561-3318-44d6-a9e5-8ea6dc844010 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:10.410621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304e561-3318-44d6-a9e5-8ea6dc844010 None admin] PATH_INFO: `/v3/users/67f62328cb31469792c6bb2077e81707` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:10.411715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304e561-3318-44d6-a9e5-8ea6dc844010 None admin] RBAC: Authorizing `identity:get_user(user_id=67f62328cb31469792c6bb2077e81707)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:10.413154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304e561-3318-44d6-a9e5-8ea6dc844010 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:10.415216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 591/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:16:10 2022] GET /identity/v3/users/67f62328cb31469792c6bb2077e81707 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:10.420800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34929-ee23-4a54-b164-55689a12583f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:10.505856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:10.517165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34929-ee23-4a54-b164-55689a12583f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:10.549218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b71e6-7d53-410c-9e75-fe78102ef1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:10.549826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b71e6-7d53-410c-9e75-fe78102ef1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:10.550098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b71e6-7d53-410c-9e75-fe78102ef1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:10.550362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b71e6-7d53-410c-9e75-fe78102ef1b2 None admin] PATH_INFO: `/v3/projects/71b26ce89b8f4d0eb348483b49f8054e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:10.551447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b71e6-7d53-410c-9e75-fe78102ef1b2 None admin] RBAC: Authorizing `identity:get_project(project_id=71b26ce89b8f4d0eb348483b49f8054e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:10.553449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b71e6-7d53-410c-9e75-fe78102ef1b2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:10.556586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 600/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:16:10 2022] GET /identity/v3/projects/71b26ce89b8f4d0eb348483b49f8054e => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:10.561887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304e561-3318-44d6-a9e5-8ea6dc844010 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:10.565745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:10.659326 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304e561-3318-44d6-a9e5-8ea6dc844010 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:10.691285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cb8f8-1a18-40d1-b614-048af25d6b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:10.691931 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cb8f8-1a18-40d1-b614-048af25d6b00 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:10.692247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cb8f8-1a18-40d1-b614-048af25d6b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:10.692522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cb8f8-1a18-40d1-b614-048af25d6b00 None admin] PATH_INFO: `/v3/projects/71b26ce89b8f4d0eb348483b49f8054e/users/67f62328cb31469792c6bb2077e81707/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:10.694393 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cb8f8-1a18-40d1-b614-048af25d6b00 None admin] RBAC: Authorizing `identity:create_grant(project_id=71b26ce89b8f4d0eb348483b49f8054e, user_id=67f62328cb31469792c6bb2077e81707, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:10.696367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cb8f8-1a18-40d1-b614-048af25d6b00 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:10.768135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 592/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:16:10 2022] PUT /identity/v3/projects/71b26ce89b8f4d0eb348483b49f8054e/users/67f62328cb31469792c6bb2077e81707/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:16:12.859661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc9afc-ba15-40ed-bbcc-8c99d4cd6e75 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:12.860225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc9afc-ba15-40ed-bbcc-8c99d4cd6e75 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:12.860225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc9afc-ba15-40ed-bbcc-8c99d4cd6e75 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:12.861567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 601/1193] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:16:12.866857 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a493a7-4ed5-4224-86f6-c54336a82bcc None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:12.867256 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a493a7-4ed5-4224-86f6-c54336a82bcc None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:12.867405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a493a7-4ed5-4224-86f6-c54336a82bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:12.885792 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b7a493a7-4ed5-4224-86f6-c54336a82bcc None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:16:12.886979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b7a493a7-4ed5-4224-86f6-c54336a82bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:16:12.944698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:12.952667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 593/1194] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:16:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:16:13.225740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc9afc-ba15-40ed-bbcc-8c99d4cd6e75 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:13.324501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc9afc-ba15-40ed-bbcc-8c99d4cd6e75 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:13.356596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45239af-cb42-4c6b-a8d6-c7f21ae07a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:13.357202 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45239af-cb42-4c6b-a8d6-c7f21ae07a8b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:13.357478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45239af-cb42-4c6b-a8d6-c7f21ae07a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:13.357749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45239af-cb42-4c6b-a8d6-c7f21ae07a8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:13.367792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45239af-cb42-4c6b-a8d6-c7f21ae07a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d45239af-cb42-4c6b-a8d6-c7f21ae07a8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:16:13.372536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:16:13.373613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:16:13.374691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 602/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:16:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:16:13.379549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a493a7-4ed5-4224-86f6-c54336a82bcc None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:13.474739 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a493a7-4ed5-4224-86f6-c54336a82bcc None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:13.506582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2d899-9606-437d-a333-604eef6e1e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:13.507119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2d899-9606-437d-a333-604eef6e1e99 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:13.507396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2d899-9606-437d-a333-604eef6e1e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:13.507681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2d899-9606-437d-a333-604eef6e1e99 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:13.508859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2d899-9606-437d-a333-604eef6e1e99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:16:13.509162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2d899-9606-437d-a333-604eef6e1e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:13.510509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2d899-9606-437d-a333-604eef6e1e99 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:13.518188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 594/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:16:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:13.524609 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45239af-cb42-4c6b-a8d6-c7f21ae07a8b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:13.542588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:13.621232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45239af-cb42-4c6b-a8d6-c7f21ae07a8b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:13.654070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760fc98-e808-4b82-a056-e0a6ae6595c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:13.654676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760fc98-e808-4b82-a056-e0a6ae6595c4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:13.654954 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760fc98-e808-4b82-a056-e0a6ae6595c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:13.655222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760fc98-e808-4b82-a056-e0a6ae6595c4 None admin] PATH_INFO: `/v3/users/67f62328cb31469792c6bb2077e81707` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:13.656478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760fc98-e808-4b82-a056-e0a6ae6595c4 None admin] RBAC: Authorizing `identity:get_user(user_id=67f62328cb31469792c6bb2077e81707)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:13.657883 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760fc98-e808-4b82-a056-e0a6ae6595c4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:13.659427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 603/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 10:16:13 2022] GET /identity/v3/users/67f62328cb31469792c6bb2077e81707 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:13.665031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2d899-9606-437d-a333-604eef6e1e99 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:13.722478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:13.765655 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2d899-9606-437d-a333-604eef6e1e99 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:13.797807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cabbe-de79-4f43-8231-2ac6049e96ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:13.798407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cabbe-de79-4f43-8231-2ac6049e96ab None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:13.798751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cabbe-de79-4f43-8231-2ac6049e96ab None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:13.799027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cabbe-de79-4f43-8231-2ac6049e96ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:13.863615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cabbe-de79-4f43-8231-2ac6049e96ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:13.865070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cabbe-de79-4f43-8231-2ac6049e96ab None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:13.917860 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:13.960994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 595/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:16:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:16:13.966893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760fc98-e808-4b82-a056-e0a6ae6595c4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:14.047650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:14.063186 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760fc98-e808-4b82-a056-e0a6ae6595c4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:14.095870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a056bd8-d0dd-4ea1-bd7d-4f48a761334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:14.096500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a056bd8-d0dd-4ea1-bd7d-4f48a761334c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:14.096778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a056bd8-d0dd-4ea1-bd7d-4f48a761334c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:14.097051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a056bd8-d0dd-4ea1-bd7d-4f48a761334c None admin] PATH_INFO: `/v3/projects/71b26ce89b8f4d0eb348483b49f8054e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:14.098149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a056bd8-d0dd-4ea1-bd7d-4f48a761334c None admin] RBAC: Authorizing `identity:get_project(project_id=71b26ce89b8f4d0eb348483b49f8054e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:14.099559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a056bd8-d0dd-4ea1-bd7d-4f48a761334c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:14.101180 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 604/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 10:16:13 2022] GET /identity/v3/projects/71b26ce89b8f4d0eb348483b49f8054e => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:14.107584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cabbe-de79-4f43-8231-2ac6049e96ab None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:16:14.202046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cabbe-de79-4f43-8231-2ac6049e96ab None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:16:14.234423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48722517-fd88-44d3-8f40-31780079e181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:16:14.235007 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48722517-fd88-44d3-8f40-31780079e181 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:16:14.235285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48722517-fd88-44d3-8f40-31780079e181 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:16:14.235549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48722517-fd88-44d3-8f40-31780079e181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:16:14.236283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48722517-fd88-44d3-8f40-31780079e181 None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=71b26ce89b8f4d0eb348483b49f8054e, user.id=67f62328cb31469792c6bb2077e81707) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:16:14.236584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48722517-fd88-44d3-8f40-31780079e181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:16:14.237979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48722517-fd88-44d3-8f40-31780079e181 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:16:14.244056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 596/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:16:14 2022] GET /identity/v3/role_assignments?user.id=67f62328cb31469792c6bb2077e81707&scope.project.id=71b26ce89b8f4d0eb348483b49f8054e&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:16:24.091560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=24 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:16:24.241099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=90 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:26.559231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa04f3-3318-4086-af9b-a058e0de91d6 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:26.559824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa04f3-3318-4086-af9b-a058e0de91d6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:26.559824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa04f3-3318-4086-af9b-a058e0de91d6 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:26.561225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 605/1201] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:17:26.566392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b08c0-909f-4a19-b6ef-391523a300a7 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:26.566822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b08c0-909f-4a19-b6ef-391523a300a7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:26.566922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b08c0-909f-4a19-b6ef-391523a300a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:26.584727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6e4b08c0-909f-4a19-b6ef-391523a300a7 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:17:26.585900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6e4b08c0-909f-4a19-b6ef-391523a300a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:17:26.651533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 597/1202] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:17:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:17:26.921826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa04f3-3318-4086-af9b-a058e0de91d6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:27.021262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa04f3-3318-4086-af9b-a058e0de91d6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:27.054058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eb877-7aa1-4946-9e3d-106521c6188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:27.054676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eb877-7aa1-4946-9e3d-106521c6188a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:27.054950 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eb877-7aa1-4946-9e3d-106521c6188a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:27.055218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eb877-7aa1-4946-9e3d-106521c6188a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:27.065555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820eb877-7aa1-4946-9e3d-106521c6188a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:27.067090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820eb877-7aa1-4946-9e3d-106521c6188a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-820eb877-7aa1-4946-9e3d-106521c6188a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:27.081362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:27.082552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:27.083897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:27.083897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:27.083897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:27.083897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 606/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 10:17:27.089224 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b08c0-909f-4a19-b6ef-391523a300a7 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:27.185497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b08c0-909f-4a19-b6ef-391523a300a7 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:27.213208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:27.218879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f21d1-c2c1-43d6-8d54-abe573279f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:27.219482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f21d1-c2c1-43d6-8d54-abe573279f15 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:27.219762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f21d1-c2c1-43d6-8d54-abe573279f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:27.220063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f21d1-c2c1-43d6-8d54-abe573279f15 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:27.220700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f21d1-c2c1-43d6-8d54-abe573279f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:27.221002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f21d1-c2c1-43d6-8d54-abe573279f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:27.222673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f21d1-c2c1-43d6-8d54-abe573279f15 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:27.233496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 598/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:27.239201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eb877-7aa1-4946-9e3d-106521c6188a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:27.291334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:27.337295 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eb877-7aa1-4946-9e3d-106521c6188a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:27.370738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc5b27-cd75-43e1-9a4b-3844d90f6e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:27.371336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5b27-cd75-43e1-9a4b-3844d90f6e4a None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:27.371610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5b27-cd75-43e1-9a4b-3844d90f6e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:27.371878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5b27-cd75-43e1-9a4b-3844d90f6e4a None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:27.372554 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc5b27-cd75-43e1-9a4b-3844d90f6e4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:27.373956 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc5b27-cd75-43e1-9a4b-3844d90f6e4a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:27.507870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 607/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 10:17:27 2022] POST /identity/v3/users => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:17:29.645347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed6b8c-880c-4c94-a4c0-07df9cf1c287 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:29.645905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed6b8c-880c-4c94-a4c0-07df9cf1c287 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:29.645905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed6b8c-880c-4c94-a4c0-07df9cf1c287 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:29.647247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 599/1206] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:17:29.652396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9208f03-e265-4ca5-916b-b1a986ec4628 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:29.652812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9208f03-e265-4ca5-916b-b1a986ec4628 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:29.653907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9208f03-e265-4ca5-916b-b1a986ec4628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:29.670773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d9208f03-e265-4ca5-916b-b1a986ec4628 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:17:29.671943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d9208f03-e265-4ca5-916b-b1a986ec4628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:17:29.737153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 608/1207] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:17:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:17:30.009893 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed6b8c-880c-4c94-a4c0-07df9cf1c287 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:30.109050 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed6b8c-880c-4c94-a4c0-07df9cf1c287 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:30.142267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736c097-d7a0-489d-b1f8-a0e04186fb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:30.142928 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736c097-d7a0-489d-b1f8-a0e04186fb14 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:30.143203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736c097-d7a0-489d-b1f8-a0e04186fb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:30.143472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736c097-d7a0-489d-b1f8-a0e04186fb14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:30.154549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736c097-d7a0-489d-b1f8-a0e04186fb14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-3736c097-d7a0-489d-b1f8-a0e04186fb14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:17:30.159222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:30.160399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:30.161539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 600/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:17:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:30.166482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9208f03-e265-4ca5-916b-b1a986ec4628 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:30.205016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:30.262168 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9208f03-e265-4ca5-916b-b1a986ec4628 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:30.294346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf190be-f546-4b88-870f-b9d4c5c6c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:30.294942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf190be-f546-4b88-870f-b9d4c5c6c127 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:30.295221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf190be-f546-4b88-870f-b9d4c5c6c127 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:30.295516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf190be-f546-4b88-870f-b9d4c5c6c127 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:30.296290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf190be-f546-4b88-870f-b9d4c5c6c127 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:30.296794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf190be-f546-4b88-870f-b9d4c5c6c127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:30.298477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf190be-f546-4b88-870f-b9d4c5c6c127 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:30.306362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 609/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:17:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:30.313579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736c097-d7a0-489d-b1f8-a0e04186fb14 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:30.363575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:30.411515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736c097-d7a0-489d-b1f8-a0e04186fb14 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:30.446465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c589f-7b37-4ff8-8ca8-e4f4a3e848a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:30.447009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c589f-7b37-4ff8-8ca8-e4f4a3e848a0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:30.447286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c589f-7b37-4ff8-8ca8-e4f4a3e848a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:30.448189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c589f-7b37-4ff8-8ca8-e4f4a3e848a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:30.458216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c589f-7b37-4ff8-8ca8-e4f4a3e848a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:30.459676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c589f-7b37-4ff8-8ca8-e4f4a3e848a0 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-586c589f-7b37-4ff8-8ca8-e4f4a3e848a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:30.474083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:30.475228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:30.476220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:30.476220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:30.476220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:30.476220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 601/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:30.481399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf190be-f546-4b88-870f-b9d4c5c6c127 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:30.575392 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:30.578212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf190be-f546-4b88-870f-b9d4c5c6c127 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:30.610596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688cd96-4d46-43b5-a8ab-57aeec48c0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:30.611245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688cd96-4d46-43b5-a8ab-57aeec48c0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:30.611521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688cd96-4d46-43b5-a8ab-57aeec48c0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:30.611788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688cd96-4d46-43b5-a8ab-57aeec48c0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:30.612449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688cd96-4d46-43b5-a8ab-57aeec48c0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:30.612745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688cd96-4d46-43b5-a8ab-57aeec48c0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:30.614191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688cd96-4d46-43b5-a8ab-57aeec48c0b2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:30.626981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 610/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:30.632747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c589f-7b37-4ff8-8ca8-e4f4a3e848a0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:30.730575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c589f-7b37-4ff8-8ca8-e4f4a3e848a0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:30.732064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:30.763732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde684e-4f83-4446-8bd6-fa67ed19ef23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:30.764378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde684e-4f83-4446-8bd6-fa67ed19ef23 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:30.764653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde684e-4f83-4446-8bd6-fa67ed19ef23 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:30.764915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde684e-4f83-4446-8bd6-fa67ed19ef23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:30.771543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde684e-4f83-4446-8bd6-fa67ed19ef23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:30.772981 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde684e-4f83-4446-8bd6-fa67ed19ef23 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-cbde684e-4f83-4446-8bd6-fa67ed19ef23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:17:30.784321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:30.785497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:30.786870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:30.786870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:30.786870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:17:30.786870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:17:30.786870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:17:30.786870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:17:30.786870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:17:30.786870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:17:30.786870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 10:17:30.786870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:30.786870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 602/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:30.791909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688cd96-4d46-43b5-a8ab-57aeec48c0b2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:30.888032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688cd96-4d46-43b5-a8ab-57aeec48c0b2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:30.921549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be81aa-4422-447b-a0fa-ad1573152481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:30.922143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be81aa-4422-447b-a0fa-ad1573152481 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:30.922416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be81aa-4422-447b-a0fa-ad1573152481 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:30.922680 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be81aa-4422-447b-a0fa-ad1573152481 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:30.923389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be81aa-4422-447b-a0fa-ad1573152481 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:30.923684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be81aa-4422-447b-a0fa-ad1573152481 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:30.925117 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be81aa-4422-447b-a0fa-ad1573152481 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:30.942401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 611/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Oct 4 10:17:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:30.948236 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde684e-4f83-4446-8bd6-fa67ed19ef23 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:31.050541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde684e-4f83-4446-8bd6-fa67ed19ef23 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:31.082273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19739d-91c1-4eac-8c68-e25129526b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:31.082868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19739d-91c1-4eac-8c68-e25129526b3d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:31.083142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19739d-91c1-4eac-8c68-e25129526b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:31.083410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19739d-91c1-4eac-8c68-e25129526b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:31.112974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:31.148879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19739d-91c1-4eac-8c68-e25129526b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:31.150311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19739d-91c1-4eac-8c68-e25129526b3d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:31.245874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 603/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:17:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:17:31.251710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be81aa-4422-447b-a0fa-ad1573152481 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:31.270440 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:31.350088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be81aa-4422-447b-a0fa-ad1573152481 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:31.382521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3f446-090e-4ec0-96ba-21c99077731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:31.383134 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3f446-090e-4ec0-96ba-21c99077731d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:31.383405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3f446-090e-4ec0-96ba-21c99077731d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:31.383668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3f446-090e-4ec0-96ba-21c99077731d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:31.393890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3f446-090e-4ec0-96ba-21c99077731d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:31.395292 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3f446-090e-4ec0-96ba-21c99077731d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e2c3f446-090e-4ec0-96ba-21c99077731d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:31.410105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:31.418481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:31.419402 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:31.419402 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:31.419402 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:31.419402 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 612/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:31.419635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19739d-91c1-4eac-8c68-e25129526b3d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:31.478253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:31.516853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19739d-91c1-4eac-8c68-e25129526b3d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:31.549272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bad5cf-6a08-418b-82a8-3d53b6673ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:31.549873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bad5cf-6a08-418b-82a8-3d53b6673ffc None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:31.550152 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bad5cf-6a08-418b-82a8-3d53b6673ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:31.550416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bad5cf-6a08-418b-82a8-3d53b6673ffc None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:31.551045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bad5cf-6a08-418b-82a8-3d53b6673ffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:31.551339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bad5cf-6a08-418b-82a8-3d53b6673ffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:31.552830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bad5cf-6a08-418b-82a8-3d53b6673ffc None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:31.565653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 604/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:31.571509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3f446-090e-4ec0-96ba-21c99077731d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:31.641748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:31.671210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3f446-090e-4ec0-96ba-21c99077731d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:31.703801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62efe3-08b2-40b8-9350-e731a95e4bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:31.704450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62efe3-08b2-40b8-9350-e731a95e4bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:31.704725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62efe3-08b2-40b8-9350-e731a95e4bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:31.704991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62efe3-08b2-40b8-9350-e731a95e4bb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:31.711334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62efe3-08b2-40b8-9350-e731a95e4bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:31.712790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62efe3-08b2-40b8-9350-e731a95e4bb6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9c62efe3-08b2-40b8-9350-e731a95e4bb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:17:31.724667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:31.725739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:31.727017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:17:31.727017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:17:31.727017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:17:31.727017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:17:31.727017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:17:31.727017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:17:31.727017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:17:31.727017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:31.727017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 613/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:31.732419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bad5cf-6a08-418b-82a8-3d53b6673ffc None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:31.827654 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bad5cf-6a08-418b-82a8-3d53b6673ffc None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:31.849673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:31.861218 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023e79c-f9db-4263-a298-a9df8d23f5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:31.861815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023e79c-f9db-4263-a298-a9df8d23f5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:31.874419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023e79c-f9db-4263-a298-a9df8d23f5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:31.874419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023e79c-f9db-4263-a298-a9df8d23f5e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:31.874419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023e79c-f9db-4263-a298-a9df8d23f5e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:31.874419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023e79c-f9db-4263-a298-a9df8d23f5e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:31.874419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023e79c-f9db-4263-a298-a9df8d23f5e6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:31.875520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 605/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:31.881583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62efe3-08b2-40b8-9350-e731a95e4bb6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:31.981024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62efe3-08b2-40b8-9350-e731a95e4bb6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:32.007647 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:32.013156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae7f44-c5bf-488e-bded-433c6e6af49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:32.013799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae7f44-c5bf-488e-bded-433c6e6af49b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:32.014071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae7f44-c5bf-488e-bded-433c6e6af49b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:32.014335 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae7f44-c5bf-488e-bded-433c6e6af49b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:32.015047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae7f44-c5bf-488e-bded-433c6e6af49b None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=505c7c48b0d14dc9af8006cc7e8eea53) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:32.015354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae7f44-c5bf-488e-bded-433c6e6af49b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:32.016790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae7f44-c5bf-488e-bded-433c6e6af49b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:32.023839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 614/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:17:31 2022] GET /identity/v3/role_assignments?user.id=505c7c48b0d14dc9af8006cc7e8eea53&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:34.114084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5895-af99-44ab-a962-87f1cc175b8e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:34.114664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5895-af99-44ab-a962-87f1cc175b8e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:34.114664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5895-af99-44ab-a962-87f1cc175b8e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:34.116022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 606/1220] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:17:34.121728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435204ea-dccb-44fd-8fc4-cf54b6709b6b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:34.122126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435204ea-dccb-44fd-8fc4-cf54b6709b6b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:34.122268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435204ea-dccb-44fd-8fc4-cf54b6709b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:34.141772 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-435204ea-dccb-44fd-8fc4-cf54b6709b6b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:17:34.148650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-435204ea-dccb-44fd-8fc4-cf54b6709b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:17:34.208655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 615/1221] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:17:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:17:34.474849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f5895-af99-44ab-a962-87f1cc175b8e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:34.574284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f5895-af99-44ab-a962-87f1cc175b8e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:34.608582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad84083-999c-47f4-b497-c799eba11cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:34.609209 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84083-999c-47f4-b497-c799eba11cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:34.609478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84083-999c-47f4-b497-c799eba11cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:34.609752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84083-999c-47f4-b497-c799eba11cb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:34.619807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad84083-999c-47f4-b497-c799eba11cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-4ad84083-999c-47f4-b497-c799eba11cb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:17:34.624704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:34.629992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 607/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:17:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:34.631975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435204ea-dccb-44fd-8fc4-cf54b6709b6b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:34.728304 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435204ea-dccb-44fd-8fc4-cf54b6709b6b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:34.750762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:34.761533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a09aa-f104-4a70-b2b3-86fe46f2e437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:34.762129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a09aa-f104-4a70-b2b3-86fe46f2e437 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:34.762404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a09aa-f104-4a70-b2b3-86fe46f2e437 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:34.762671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a09aa-f104-4a70-b2b3-86fe46f2e437 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:34.763322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a09aa-f104-4a70-b2b3-86fe46f2e437 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:34.763619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a09aa-f104-4a70-b2b3-86fe46f2e437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:34.768472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a09aa-f104-4a70-b2b3-86fe46f2e437 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:34.776665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 616/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:17:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:34.783068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad84083-999c-47f4-b497-c799eba11cb7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:34.828498 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:34.881921 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad84083-999c-47f4-b497-c799eba11cb7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:34.915827 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44df061-f8de-44da-b858-54b8e3dd6934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:34.916519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44df061-f8de-44da-b858-54b8e3dd6934 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:34.916795 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44df061-f8de-44da-b858-54b8e3dd6934 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:34.917065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44df061-f8de-44da-b858-54b8e3dd6934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:34.926904 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44df061-f8de-44da-b858-54b8e3dd6934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:34.928369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44df061-f8de-44da-b858-54b8e3dd6934 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d44df061-f8de-44da-b858-54b8e3dd6934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:34.943015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:34.944142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:34.945187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:34.945187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:34.945187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:34.945187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 608/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:34.950544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a09aa-f104-4a70-b2b3-86fe46f2e437 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:35.046302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a09aa-f104-4a70-b2b3-86fe46f2e437 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:35.078158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35c7cf-e3ea-4132-b352-60c2fd55c341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:35.078747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35c7cf-e3ea-4132-b352-60c2fd55c341 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:35.079024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35c7cf-e3ea-4132-b352-60c2fd55c341 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:35.079296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35c7cf-e3ea-4132-b352-60c2fd55c341 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:35.079924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35c7cf-e3ea-4132-b352-60c2fd55c341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:35.080256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35c7cf-e3ea-4132-b352-60c2fd55c341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:35.081590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35c7cf-e3ea-4132-b352-60c2fd55c341 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:35.092726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 617/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:35.098752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44df061-f8de-44da-b858-54b8e3dd6934 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:35.191392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:35.197731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44df061-f8de-44da-b858-54b8e3dd6934 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:35.229809 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d637348-1dd9-4789-b1aa-15a249a4ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:35.230416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d637348-1dd9-4789-b1aa-15a249a4ae19 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:35.230687 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d637348-1dd9-4789-b1aa-15a249a4ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:35.230953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d637348-1dd9-4789-b1aa-15a249a4ae19 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:35.239020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d637348-1dd9-4789-b1aa-15a249a4ae19 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:35.243893 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d637348-1dd9-4789-b1aa-15a249a4ae19 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-4d637348-1dd9-4789-b1aa-15a249a4ae19 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:17:35.252097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:35.253226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:35.254230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:35.254230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:35.254230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:17:35.254230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:17:35.254230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:17:35.254230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:17:35.254230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:17:35.254230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:17:35.254230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 10:17:35.254230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:35.254230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 609/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:35.259128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35c7cf-e3ea-4132-b352-60c2fd55c341 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:35.304737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:35.355776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35c7cf-e3ea-4132-b352-60c2fd55c341 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:35.389942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294a92f-5670-4bb6-96e3-9dfd4e6b27af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:35.390542 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294a92f-5670-4bb6-96e3-9dfd4e6b27af None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:35.390820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294a92f-5670-4bb6-96e3-9dfd4e6b27af None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:35.391090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294a92f-5670-4bb6-96e3-9dfd4e6b27af None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:35.391812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294a92f-5670-4bb6-96e3-9dfd4e6b27af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:35.392142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294a92f-5670-4bb6-96e3-9dfd4e6b27af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:35.393625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294a92f-5670-4bb6-96e3-9dfd4e6b27af None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:35.410450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 618/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Oct 4 10:17:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:35.416768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d637348-1dd9-4789-b1aa-15a249a4ae19 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:35.514205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d637348-1dd9-4789-b1aa-15a249a4ae19 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:35.547192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8ddb3-b2ab-4a9f-859e-311114dad753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:35.547807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8ddb3-b2ab-4a9f-859e-311114dad753 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:35.548114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8ddb3-b2ab-4a9f-859e-311114dad753 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:35.548473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8ddb3-b2ab-4a9f-859e-311114dad753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:35.558878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8ddb3-b2ab-4a9f-859e-311114dad753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:35.560336 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8ddb3-b2ab-4a9f-859e-311114dad753 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-83d8ddb3-b2ab-4a9f-859e-311114dad753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:35.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:35.575240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:35.576355 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:35.576355 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:35.576355 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:35.576355 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 610/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:35.581164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294a92f-5670-4bb6-96e3-9dfd4e6b27af None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:35.677577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294a92f-5670-4bb6-96e3-9dfd4e6b27af None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:35.679832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:35.711132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3dd12-79af-42cc-a97a-4da385485d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:35.711723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3dd12-79af-42cc-a97a-4da385485d17 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:35.712030 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3dd12-79af-42cc-a97a-4da385485d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:35.712305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3dd12-79af-42cc-a97a-4da385485d17 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:35.712965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3dd12-79af-42cc-a97a-4da385485d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:35.713289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3dd12-79af-42cc-a97a-4da385485d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:35.714629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3dd12-79af-42cc-a97a-4da385485d17 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:35.725676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 619/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:35.731424 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8ddb3-b2ab-4a9f-859e-311114dad753 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:35.740624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:35.830197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8ddb3-b2ab-4a9f-859e-311114dad753 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:35.863230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8692042-a23c-433e-b8ca-7bf21bd80dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:35.863851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692042-a23c-433e-b8ca-7bf21bd80dca None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:35.864154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692042-a23c-433e-b8ca-7bf21bd80dca None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:35.864427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692042-a23c-433e-b8ca-7bf21bd80dca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:35.871058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8692042-a23c-433e-b8ca-7bf21bd80dca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:35.872579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8692042-a23c-433e-b8ca-7bf21bd80dca None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-c8692042-a23c-433e-b8ca-7bf21bd80dca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:17:35.884399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:35.890508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:35.891680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:17:35.891680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:17:35.891680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:17:35.891680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:17:35.891680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:17:35.891680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:17:35.891680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:17:35.891680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:35.891680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 611/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:17:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:35.892322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3dd12-79af-42cc-a97a-4da385485d17 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:35.991833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3dd12-79af-42cc-a97a-4da385485d17 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:36.024276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fc665-efbd-453f-b4d3-6580f079a6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:36.024874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fc665-efbd-453f-b4d3-6580f079a6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:36.025151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fc665-efbd-453f-b4d3-6580f079a6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:36.025418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fc665-efbd-453f-b4d3-6580f079a6e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:36.026688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fc665-efbd-453f-b4d3-6580f079a6e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:36.026989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fc665-efbd-453f-b4d3-6580f079a6e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:36.028431 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fc665-efbd-453f-b4d3-6580f079a6e0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:36.039915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 620/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:17:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:36.046152 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8692042-a23c-433e-b8ca-7bf21bd80dca None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:36.113185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:36.145884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8692042-a23c-433e-b8ca-7bf21bd80dca None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:36.178135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf90b2-4326-4744-bc51-502aba0de124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:36.178778 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf90b2-4326-4744-bc51-502aba0de124 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:36.179054 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf90b2-4326-4744-bc51-502aba0de124 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:36.179321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf90b2-4326-4744-bc51-502aba0de124 None admin] PATH_INFO: `/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/505c7c48b0d14dc9af8006cc7e8eea53/roles/f53f657a7b1f44a98ec5e754a93d8b3c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:36.193415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf90b2-4326-4744-bc51-502aba0de124 None admin] RBAC: Authorizing `identity:create_grant(project_id=c41ae2f9d03c48be8017a1ca480bf7db, user_id=505c7c48b0d14dc9af8006cc7e8eea53, role_id=f53f657a7b1f44a98ec5e754a93d8b3c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:36.194837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf90b2-4326-4744-bc51-502aba0de124 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:36.280107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 612/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:17:36 2022] PUT /identity/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/505c7c48b0d14dc9af8006cc7e8eea53/roles/f53f657a7b1f44a98ec5e754a93d8b3c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:17:38.373037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba49198-9ae5-459c-99df-d1026b075434 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:38.373566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba49198-9ae5-459c-99df-d1026b075434 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:38.373566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba49198-9ae5-459c-99df-d1026b075434 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:38.374916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 621/1233] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:17:38.380276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f9faa-27a2-4b1a-995e-83865b9d257c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:38.381587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f9faa-27a2-4b1a-995e-83865b9d257c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:38.381587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f9faa-27a2-4b1a-995e-83865b9d257c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:38.399141 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-430f9faa-27a2-4b1a-995e-83865b9d257c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:17:38.400358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-430f9faa-27a2-4b1a-995e-83865b9d257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:17:38.466724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 613/1234] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:17:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:17:38.735269 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba49198-9ae5-459c-99df-d1026b075434 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:38.759623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:38.832466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba49198-9ae5-459c-99df-d1026b075434 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:38.864547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c313ce6-cf53-4622-9770-23b66a7b6429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:38.865159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c313ce6-cf53-4622-9770-23b66a7b6429 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:38.865434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c313ce6-cf53-4622-9770-23b66a7b6429 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:38.865701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c313ce6-cf53-4622-9770-23b66a7b6429 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:38.875759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c313ce6-cf53-4622-9770-23b66a7b6429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7c313ce6-cf53-4622-9770-23b66a7b6429 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:17:38.885622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:38.886574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:38.887701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 622/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 10:17:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:38.888632 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f9faa-27a2-4b1a-995e-83865b9d257c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:38.933413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:38.985833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f9faa-27a2-4b1a-995e-83865b9d257c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:39.018049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9005bd1-69bc-4a57-b61d-459477f078e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:39.018641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9005bd1-69bc-4a57-b61d-459477f078e2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:39.018914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9005bd1-69bc-4a57-b61d-459477f078e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:39.019180 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9005bd1-69bc-4a57-b61d-459477f078e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:39.019835 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9005bd1-69bc-4a57-b61d-459477f078e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:39.020161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9005bd1-69bc-4a57-b61d-459477f078e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:39.021585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9005bd1-69bc-4a57-b61d-459477f078e2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:39.029789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 614/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 10:17:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:39.035601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c313ce6-cf53-4622-9770-23b66a7b6429 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:39.116433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:39.131069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c313ce6-cf53-4622-9770-23b66a7b6429 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:39.163598 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef99d18-4bb6-4608-b471-e62cd7dbcb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:39.164303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef99d18-4bb6-4608-b471-e62cd7dbcb50 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:39.164544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef99d18-4bb6-4608-b471-e62cd7dbcb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:39.169617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef99d18-4bb6-4608-b471-e62cd7dbcb50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:39.174921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef99d18-4bb6-4608-b471-e62cd7dbcb50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:39.176406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef99d18-4bb6-4608-b471-e62cd7dbcb50 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5ef99d18-4bb6-4608-b471-e62cd7dbcb50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:39.190378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:39.191500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:39.192467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:39.192467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:39.192467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:39.192467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 623/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:39.197252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9005bd1-69bc-4a57-b61d-459477f078e2 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:39.294677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9005bd1-69bc-4a57-b61d-459477f078e2 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:39.303214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:39.328588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84241448-44e9-482e-b17d-22c5f7231479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:39.329179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84241448-44e9-482e-b17d-22c5f7231479 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:39.329455 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84241448-44e9-482e-b17d-22c5f7231479 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:39.329722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84241448-44e9-482e-b17d-22c5f7231479 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:39.330433 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84241448-44e9-482e-b17d-22c5f7231479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:39.330733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84241448-44e9-482e-b17d-22c5f7231479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:39.332109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84241448-44e9-482e-b17d-22c5f7231479 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:39.343452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 615/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:39.349630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef99d18-4bb6-4608-b471-e62cd7dbcb50 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:39.446441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef99d18-4bb6-4608-b471-e62cd7dbcb50 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:39.479525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946b0f8-7b04-419d-b9f3-2f0e579dd668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:39.480196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946b0f8-7b04-419d-b9f3-2f0e579dd668 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:39.480462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946b0f8-7b04-419d-b9f3-2f0e579dd668 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:39.480731 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946b0f8-7b04-419d-b9f3-2f0e579dd668 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:39.483332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:39.488391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946b0f8-7b04-419d-b9f3-2f0e579dd668 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:39.489804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946b0f8-7b04-419d-b9f3-2f0e579dd668 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6946b0f8-7b04-419d-b9f3-2f0e579dd668 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:17:39.501067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:39.502190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:39.503386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:39.503386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:39.503386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:17:39.503386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:17:39.503386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:17:39.503386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:17:39.503386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:17:39.503386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:17:39.503386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 10:17:39.503386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:39.503386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 624/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:39.508431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84241448-44e9-482e-b17d-22c5f7231479 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:39.606945 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84241448-44e9-482e-b17d-22c5f7231479 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:39.640561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bf9f6-5516-448c-af15-e0fb0ccf6aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:39.641159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bf9f6-5516-448c-af15-e0fb0ccf6aba None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:39.641433 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bf9f6-5516-448c-af15-e0fb0ccf6aba None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:39.641698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bf9f6-5516-448c-af15-e0fb0ccf6aba None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:39.642409 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bf9f6-5516-448c-af15-e0fb0ccf6aba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:39.642706 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bf9f6-5516-448c-af15-e0fb0ccf6aba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:39.644128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bf9f6-5516-448c-af15-e0fb0ccf6aba None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:39.660639 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 616/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Oct 4 10:17:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:39.667133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946b0f8-7b04-419d-b9f3-2f0e579dd668 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:39.765409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946b0f8-7b04-419d-b9f3-2f0e579dd668 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:39.798182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde959eb-d61c-4881-b2ec-5058a045ddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:39.798779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde959eb-d61c-4881-b2ec-5058a045ddd9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:39.799107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde959eb-d61c-4881-b2ec-5058a045ddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:39.799381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde959eb-d61c-4881-b2ec-5058a045ddd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:39.860477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:39.866764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde959eb-d61c-4881-b2ec-5058a045ddd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:39.868235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde959eb-d61c-4881-b2ec-5058a045ddd9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:39.965037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 625/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:17:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:17:39.970853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bf9f6-5516-448c-af15-e0fb0ccf6aba None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:39.998508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:40.069010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bf9f6-5516-448c-af15-e0fb0ccf6aba None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:40.102008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf8b8e-de5e-4894-9922-4176007e35de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:40.102623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf8b8e-de5e-4894-9922-4176007e35de None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:40.102898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf8b8e-de5e-4894-9922-4176007e35de None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:40.103203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf8b8e-de5e-4894-9922-4176007e35de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:40.113332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf8b8e-de5e-4894-9922-4176007e35de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:40.114693 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf8b8e-de5e-4894-9922-4176007e35de None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-e5cf8b8e-de5e-4894-9922-4176007e35de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:40.128479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:40.129684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:40.130771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:40.130771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:40.130771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:40.130771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 617/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:40.135234 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde959eb-d61c-4881-b2ec-5058a045ddd9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:40.224801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:40.230877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde959eb-d61c-4881-b2ec-5058a045ddd9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:40.263697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510a486-6e28-4dca-9507-d6050a3ad9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:40.264339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510a486-6e28-4dca-9507-d6050a3ad9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:40.264601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510a486-6e28-4dca-9507-d6050a3ad9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:40.264868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510a486-6e28-4dca-9507-d6050a3ad9b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:40.265503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510a486-6e28-4dca-9507-d6050a3ad9b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:40.265803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510a486-6e28-4dca-9507-d6050a3ad9b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:40.267137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510a486-6e28-4dca-9507-d6050a3ad9b6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:40.278556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 626/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:40.284300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf8b8e-de5e-4894-9922-4176007e35de None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:40.363557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:40.384214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf8b8e-de5e-4894-9922-4176007e35de None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:40.417451 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0be2b2-d1e8-4a18-a5ef-bc113b4adf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:40.418071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0be2b2-d1e8-4a18-a5ef-bc113b4adf69 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:40.418350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0be2b2-d1e8-4a18-a5ef-bc113b4adf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:40.418620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0be2b2-d1e8-4a18-a5ef-bc113b4adf69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:40.425089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0be2b2-d1e8-4a18-a5ef-bc113b4adf69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:40.426614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0be2b2-d1e8-4a18-a5ef-bc113b4adf69 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-aa0be2b2-d1e8-4a18-a5ef-bc113b4adf69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:17:40.437507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:40.438538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:40.439515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:17:40.439515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:17:40.439515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:17:40.439515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:17:40.439515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:17:40.439515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:17:40.439515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:17:40.439515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:40.439515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 618/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:17:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:40.444505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510a486-6e28-4dca-9507-d6050a3ad9b6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:40.542130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510a486-6e28-4dca-9507-d6050a3ad9b6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:40.574674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9a3ca-56a0-41d8-848f-22bc813803fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:40.575272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9a3ca-56a0-41d8-848f-22bc813803fc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:40.575549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9a3ca-56a0-41d8-848f-22bc813803fc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:40.575817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9a3ca-56a0-41d8-848f-22bc813803fc None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:40.576521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9a3ca-56a0-41d8-848f-22bc813803fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:40.576826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9a3ca-56a0-41d8-848f-22bc813803fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:40.578229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9a3ca-56a0-41d8-848f-22bc813803fc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:40.590245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 627/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:17:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:17:40.596387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0be2b2-d1e8-4a18-a5ef-bc113b4adf69 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:40.693915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0be2b2-d1e8-4a18-a5ef-bc113b4adf69 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:40.727529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da669ca9-a990-4b82-9940-8aa1910dc8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:40.728165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da669ca9-a990-4b82-9940-8aa1910dc8bb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:40.728446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da669ca9-a990-4b82-9940-8aa1910dc8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:40.728722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da669ca9-a990-4b82-9940-8aa1910dc8bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:40.729442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da669ca9-a990-4b82-9940-8aa1910dc8bb None admin] RBAC: Adding query filter params (role.id=f53f657a7b1f44a98ec5e754a93d8b3c, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=505c7c48b0d14dc9af8006cc7e8eea53) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:40.729748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da669ca9-a990-4b82-9940-8aa1910dc8bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:40.731159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da669ca9-a990-4b82-9940-8aa1910dc8bb None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:40.737114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 619/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:17:40 2022] GET /identity/v3/role_assignments?user.id=505c7c48b0d14dc9af8006cc7e8eea53&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=f53f657a7b1f44a98ec5e754a93d8b3c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:42.913385 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5248f-0856-47a7-9d8f-5ad43721c938 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:42.913912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5248f-0856-47a7-9d8f-5ad43721c938 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:42.914009 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5248f-0856-47a7-9d8f-5ad43721c938 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:42.915333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 628/1247] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:17:42.921288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08459-1e5d-4825-a355-7c40988bad39 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:42.921721 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08459-1e5d-4825-a355-7c40988bad39 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:42.921842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08459-1e5d-4825-a355-7c40988bad39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:42.928130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:42.940847 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c7b08459-1e5d-4825-a355-7c40988bad39 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:17:42.942111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c7b08459-1e5d-4825-a355-7c40988bad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:17:43.006577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 620/1248] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:17:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:17:43.278797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5248f-0856-47a7-9d8f-5ad43721c938 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:43.296949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:43.377252 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5248f-0856-47a7-9d8f-5ad43721c938 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:43.410749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b0d9c-067c-42a5-9dc4-1e2db5874824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:43.411370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0d9c-067c-42a5-9dc4-1e2db5874824 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:43.411645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0d9c-067c-42a5-9dc4-1e2db5874824 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:43.411920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0d9c-067c-42a5-9dc4-1e2db5874824 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:43.422197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b0d9c-067c-42a5-9dc4-1e2db5874824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-808b0d9c-067c-42a5-9dc4-1e2db5874824 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:17:43.426861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:43.428096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:43.431631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 629/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:17:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:43.434601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b08459-1e5d-4825-a355-7c40988bad39 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:43.530165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b08459-1e5d-4825-a355-7c40988bad39 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:43.559192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:43.564087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ac3fa-be1d-4e10-ad21-c4d2def54e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:43.564694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ac3fa-be1d-4e10-ad21-c4d2def54e1e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:43.564973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ac3fa-be1d-4e10-ad21-c4d2def54e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:43.565242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ac3fa-be1d-4e10-ad21-c4d2def54e1e None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:43.565897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ac3fa-be1d-4e10-ad21-c4d2def54e1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:43.566199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ac3fa-be1d-4e10-ad21-c4d2def54e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:43.567546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ac3fa-be1d-4e10-ad21-c4d2def54e1e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:43.575354 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 621/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:17:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:43.581310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b0d9c-067c-42a5-9dc4-1e2db5874824 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:43.656544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:43.677812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b0d9c-067c-42a5-9dc4-1e2db5874824 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:43.709792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b6b3e-ad39-41ec-82b7-bec2f6871721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:43.710398 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b6b3e-ad39-41ec-82b7-bec2f6871721 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:43.710672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b6b3e-ad39-41ec-82b7-bec2f6871721 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:43.710939 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b6b3e-ad39-41ec-82b7-bec2f6871721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:43.721378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b6b3e-ad39-41ec-82b7-bec2f6871721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:43.722852 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b6b3e-ad39-41ec-82b7-bec2f6871721 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-473b6b3e-ad39-41ec-82b7-bec2f6871721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:43.737732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:43.738834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:43.740129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:43.740129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:43.740129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:43.740129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 630/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:43.744633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ac3fa-be1d-4e10-ad21-c4d2def54e1e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:43.842271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ac3fa-be1d-4e10-ad21-c4d2def54e1e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:43.875422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711fc2d-549f-4c9e-b3fd-43e2f23c1046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:43.876044 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711fc2d-549f-4c9e-b3fd-43e2f23c1046 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:43.876319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711fc2d-549f-4c9e-b3fd-43e2f23c1046 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:43.876588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711fc2d-549f-4c9e-b3fd-43e2f23c1046 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:43.877242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711fc2d-549f-4c9e-b3fd-43e2f23c1046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:43.877537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711fc2d-549f-4c9e-b3fd-43e2f23c1046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:43.879027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711fc2d-549f-4c9e-b3fd-43e2f23c1046 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:43.890445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 622/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:43.896167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b6b3e-ad39-41ec-82b7-bec2f6871721 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:43.993967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b6b3e-ad39-41ec-82b7-bec2f6871721 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:44.019409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:44.027359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83907c-8685-46bf-8ebe-c12d865fc5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:44.028001 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83907c-8685-46bf-8ebe-c12d865fc5ca None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:44.028282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83907c-8685-46bf-8ebe-c12d865fc5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:44.028552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83907c-8685-46bf-8ebe-c12d865fc5ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:44.035702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83907c-8685-46bf-8ebe-c12d865fc5ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:44.037157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83907c-8685-46bf-8ebe-c12d865fc5ca None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5b83907c-8685-46bf-8ebe-c12d865fc5ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:17:44.048613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:44.051572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:44.052665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:44.052665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:44.052665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:17:44.052665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:17:44.052665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:17:44.052665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:17:44.052665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:17:44.052665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:17:44.052665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 10:17:44.052665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:44.052665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 631/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:44.055723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711fc2d-549f-4c9e-b3fd-43e2f23c1046 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:44.110714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:44.154826 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711fc2d-549f-4c9e-b3fd-43e2f23c1046 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:44.186796 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71659721-ce6b-4ecb-a5d9-e79c55d0b340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:44.187385 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71659721-ce6b-4ecb-a5d9-e79c55d0b340 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:44.187662 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71659721-ce6b-4ecb-a5d9-e79c55d0b340 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:44.187942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71659721-ce6b-4ecb-a5d9-e79c55d0b340 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:44.188670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71659721-ce6b-4ecb-a5d9-e79c55d0b340 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:44.188967 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71659721-ce6b-4ecb-a5d9-e79c55d0b340 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:44.190365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71659721-ce6b-4ecb-a5d9-e79c55d0b340 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:44.208523 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 623/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Oct 4 10:17:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:44.214940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83907c-8685-46bf-8ebe-c12d865fc5ca None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:44.310581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83907c-8685-46bf-8ebe-c12d865fc5ca None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:44.343245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848e919-c0af-41d4-a60d-f0f27d8d489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:44.343834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848e919-c0af-41d4-a60d-f0f27d8d489d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:44.344165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848e919-c0af-41d4-a60d-f0f27d8d489d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:44.344412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848e919-c0af-41d4-a60d-f0f27d8d489d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:44.397783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:44.410021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848e919-c0af-41d4-a60d-f0f27d8d489d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:44.411496 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848e919-c0af-41d4-a60d-f0f27d8d489d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:44.509877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 632/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:17:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:17:44.516171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71659721-ce6b-4ecb-a5d9-e79c55d0b340 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:44.614442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71659721-ce6b-4ecb-a5d9-e79c55d0b340 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:44.627872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:44.648698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf580e-9f6d-4e7f-b500-f1d73d5fbb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:44.649310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf580e-9f6d-4e7f-b500-f1d73d5fbb78 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:44.649588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf580e-9f6d-4e7f-b500-f1d73d5fbb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:44.649862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf580e-9f6d-4e7f-b500-f1d73d5fbb78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:44.659551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf580e-9f6d-4e7f-b500-f1d73d5fbb78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:44.661013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf580e-9f6d-4e7f-b500-f1d73d5fbb78 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-14bf580e-9f6d-4e7f-b500-f1d73d5fbb78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:44.674833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:44.680526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:44.681739 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:44.681739 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:44.681739 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:44.681739 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 624/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:44.683574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848e919-c0af-41d4-a60d-f0f27d8d489d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:44.770385 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:44.782364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848e919-c0af-41d4-a60d-f0f27d8d489d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:44.816029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e45c5-4ce6-4d09-a5e1-52a32d2e319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:44.816618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e45c5-4ce6-4d09-a5e1-52a32d2e319c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:44.816888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e45c5-4ce6-4d09-a5e1-52a32d2e319c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:44.817189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e45c5-4ce6-4d09-a5e1-52a32d2e319c None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:44.817813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e45c5-4ce6-4d09-a5e1-52a32d2e319c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:44.818109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e45c5-4ce6-4d09-a5e1-52a32d2e319c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:44.819445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e45c5-4ce6-4d09-a5e1-52a32d2e319c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:44.830210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 633/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:44.836000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf580e-9f6d-4e7f-b500-f1d73d5fbb78 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:44.933596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf580e-9f6d-4e7f-b500-f1d73d5fbb78 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:44.965381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abcce0-6dc8-412d-a6f2-1b19c55acc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:44.966003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abcce0-6dc8-412d-a6f2-1b19c55acc3d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:44.966281 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abcce0-6dc8-412d-a6f2-1b19c55acc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:44.966551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abcce0-6dc8-412d-a6f2-1b19c55acc3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:44.972911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abcce0-6dc8-412d-a6f2-1b19c55acc3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:44.974591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abcce0-6dc8-412d-a6f2-1b19c55acc3d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-f9abcce0-6dc8-412d-a6f2-1b19c55acc3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:17:44.986081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:44.987142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:44.988558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:17:44.988558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:17:44.988558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:17:44.988558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:17:44.988558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:17:44.988558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:17:44.988558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:17:44.988558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:44.988558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 625/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:17:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:44.993187 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e45c5-4ce6-4d09-a5e1-52a32d2e319c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:45.090195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e45c5-4ce6-4d09-a5e1-52a32d2e319c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:45.123976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86b147-3ade-4756-bfc0-5f828a193a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:45.124581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86b147-3ade-4756-bfc0-5f828a193a14 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:45.124855 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86b147-3ade-4756-bfc0-5f828a193a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:45.125120 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86b147-3ade-4756-bfc0-5f828a193a14 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:45.125799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86b147-3ade-4756-bfc0-5f828a193a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:45.126099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86b147-3ade-4756-bfc0-5f828a193a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:45.127537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86b147-3ade-4756-bfc0-5f828a193a14 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:45.139053 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 634/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:17:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:45.145218 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abcce0-6dc8-412d-a6f2-1b19c55acc3d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:45.170868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:45.242698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abcce0-6dc8-412d-a6f2-1b19c55acc3d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:45.274468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af995c08-b2c5-4f7e-999e-35dfced7840e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:45.275060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af995c08-b2c5-4f7e-999e-35dfced7840e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:45.275335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af995c08-b2c5-4f7e-999e-35dfced7840e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:45.276132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af995c08-b2c5-4f7e-999e-35dfced7840e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:45.276859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af995c08-b2c5-4f7e-999e-35dfced7840e None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=505c7c48b0d14dc9af8006cc7e8eea53) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:45.277162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af995c08-b2c5-4f7e-999e-35dfced7840e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:45.278568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af995c08-b2c5-4f7e-999e-35dfced7840e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:45.283955 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 626/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:17:45 2022] GET /identity/v3/role_assignments?user.id=505c7c48b0d14dc9af8006cc7e8eea53&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:47.374196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a474a-5368-438f-af01-64e6d17e5e10 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:47.374717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a474a-5368-438f-af01-64e6d17e5e10 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:47.374809 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a474a-5368-438f-af01-64e6d17e5e10 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:47.376112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 635/1261] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:17:47.381092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146fb43-fb78-4a94-acf1-69eb42fba1d2 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:47.381523 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146fb43-fb78-4a94-acf1-69eb42fba1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:47.381617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146fb43-fb78-4a94-acf1-69eb42fba1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:47.401561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a146fb43-fb78-4a94-acf1-69eb42fba1d2 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:17:47.406894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a146fb43-fb78-4a94-acf1-69eb42fba1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:17:47.467618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 627/1262] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:17:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:17:47.735573 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a474a-5368-438f-af01-64e6d17e5e10 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:47.747033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:47.837352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a474a-5368-438f-af01-64e6d17e5e10 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:47.874191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d132800-7ef9-4fa3-8d58-c67f0555b5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:47.874824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132800-7ef9-4fa3-8d58-c67f0555b5cd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:47.875101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132800-7ef9-4fa3-8d58-c67f0555b5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:47.875371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132800-7ef9-4fa3-8d58-c67f0555b5cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:47.885705 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d132800-7ef9-4fa3-8d58-c67f0555b5cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1d132800-7ef9-4fa3-8d58-c67f0555b5cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:17:47.890427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:47.891372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:47.892268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 636/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:17:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:47.897639 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146fb43-fb78-4a94-acf1-69eb42fba1d2 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:47.919862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:48.001181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146fb43-fb78-4a94-acf1-69eb42fba1d2 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:48.034571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ad2be-1bf2-44a7-a4de-17d5810fa204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:48.035177 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ad2be-1bf2-44a7-a4de-17d5810fa204 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:48.035453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ad2be-1bf2-44a7-a4de-17d5810fa204 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:48.035722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ad2be-1bf2-44a7-a4de-17d5810fa204 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:48.036423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ad2be-1bf2-44a7-a4de-17d5810fa204 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:48.036722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ad2be-1bf2-44a7-a4de-17d5810fa204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:48.038068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ad2be-1bf2-44a7-a4de-17d5810fa204 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:48.046289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 628/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:17:48.052016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d132800-7ef9-4fa3-8d58-c67f0555b5cd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:48.116536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:48.148120 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d132800-7ef9-4fa3-8d58-c67f0555b5cd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:48.180512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df130a7-a61f-4f29-ac44-cb39e006375c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:48.181123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df130a7-a61f-4f29-ac44-cb39e006375c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:48.181400 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df130a7-a61f-4f29-ac44-cb39e006375c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:48.181671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df130a7-a61f-4f29-ac44-cb39e006375c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:48.191700 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df130a7-a61f-4f29-ac44-cb39e006375c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:48.193153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df130a7-a61f-4f29-ac44-cb39e006375c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2df130a7-a61f-4f29-ac44-cb39e006375c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:48.206894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:48.208050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:48.209116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:48.209116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:48.209116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:48.209116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 637/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:48.214506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ad2be-1bf2-44a7-a4de-17d5810fa204 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:48.292879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:48.310627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ad2be-1bf2-44a7-a4de-17d5810fa204 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:48.342751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eab60b-b2aa-4c7c-8bae-7ec6229b470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:48.343339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eab60b-b2aa-4c7c-8bae-7ec6229b470b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:48.343613 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eab60b-b2aa-4c7c-8bae-7ec6229b470b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:48.343879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eab60b-b2aa-4c7c-8bae-7ec6229b470b None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:48.344538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eab60b-b2aa-4c7c-8bae-7ec6229b470b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:48.354499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eab60b-b2aa-4c7c-8bae-7ec6229b470b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:48.354499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eab60b-b2aa-4c7c-8bae-7ec6229b470b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:48.358159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 629/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:17:48.363799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df130a7-a61f-4f29-ac44-cb39e006375c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:48.461364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df130a7-a61f-4f29-ac44-cb39e006375c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:48.481695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:48.495387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21da74-dd07-447a-9c98-0de6afae0961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:48.496049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21da74-dd07-447a-9c98-0de6afae0961 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:48.496343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21da74-dd07-447a-9c98-0de6afae0961 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:48.496739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21da74-dd07-447a-9c98-0de6afae0961 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:48.505083 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21da74-dd07-447a-9c98-0de6afae0961 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:48.506611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21da74-dd07-447a-9c98-0de6afae0961 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ba21da74-dd07-447a-9c98-0de6afae0961 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:17:48.518198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:48.519161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:48.520213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:48.520213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:48.520213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:17:48.520213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:17:48.520213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:17:48.520213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:17:48.520213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:17:48.520213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:17:48.520213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 10:17:48.520213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:48.520213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 638/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:48.525124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eab60b-b2aa-4c7c-8bae-7ec6229b470b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:48.625252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eab60b-b2aa-4c7c-8bae-7ec6229b470b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:48.659236 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80facea5-9807-4689-8b30-5d475af4d5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:48.659839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80facea5-9807-4689-8b30-5d475af4d5fe None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:48.660154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80facea5-9807-4689-8b30-5d475af4d5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:48.660427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80facea5-9807-4689-8b30-5d475af4d5fe None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:48.661149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80facea5-9807-4689-8b30-5d475af4d5fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:48.661456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80facea5-9807-4689-8b30-5d475af4d5fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:48.663002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80facea5-9807-4689-8b30-5d475af4d5fe None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:48.672010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:48.679843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 630/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Oct 4 10:17:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:17:48.686095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21da74-dd07-447a-9c98-0de6afae0961 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:48.784031 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21da74-dd07-447a-9c98-0de6afae0961 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:48.816777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f393d1a-3c73-4428-9558-c2d239c3ff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:48.817393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f393d1a-3c73-4428-9558-c2d239c3ff24 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:48.817668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f393d1a-3c73-4428-9558-c2d239c3ff24 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:48.817934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f393d1a-3c73-4428-9558-c2d239c3ff24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:48.828606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f393d1a-3c73-4428-9558-c2d239c3ff24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:48.830024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f393d1a-3c73-4428-9558-c2d239c3ff24 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5f393d1a-3c73-4428-9558-c2d239c3ff24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:48.844359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:48.845469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:48.846731 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:48.846731 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:48.846731 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:48.846731 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 639/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:48.851561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80facea5-9807-4689-8b30-5d475af4d5fe None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:48.950051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80facea5-9807-4689-8b30-5d475af4d5fe None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:48.983850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9226c13-edde-424e-9ac7-3782b61784f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:48.984496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9226c13-edde-424e-9ac7-3782b61784f2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:48.984776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9226c13-edde-424e-9ac7-3782b61784f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:48.985049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9226c13-edde-424e-9ac7-3782b61784f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:48.985677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9226c13-edde-424e-9ac7-3782b61784f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:48.985978 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9226c13-edde-424e-9ac7-3782b61784f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:48.987448 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9226c13-edde-424e-9ac7-3782b61784f2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:48.998386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 631/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:49.004267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f393d1a-3c73-4428-9558-c2d239c3ff24 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:49.035028 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:49.101250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f393d1a-3c73-4428-9558-c2d239c3ff24 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:49.134734 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f4179-bc1b-4820-81df-67284ba7ca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:49.135358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4179-bc1b-4820-81df-67284ba7ca48 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:49.135635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4179-bc1b-4820-81df-67284ba7ca48 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:49.135905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4179-bc1b-4820-81df-67284ba7ca48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:49.142573 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f4179-bc1b-4820-81df-67284ba7ca48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:49.144009 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f4179-bc1b-4820-81df-67284ba7ca48 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-cc2f4179-bc1b-4820-81df-67284ba7ca48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:17:49.155686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:49.156727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:49.157713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:17:49.157713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:17:49.157713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:17:49.157713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:17:49.157713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:17:49.157713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:17:49.157713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:17:49.157713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:49.157713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 640/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:17:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:49.163685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9226c13-edde-424e-9ac7-3782b61784f2 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:49.220161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:49.260082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9226c13-edde-424e-9ac7-3782b61784f2 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:49.292406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b80340-3a9d-4fe3-86cd-f6fd051f2715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:49.292997 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b80340-3a9d-4fe3-86cd-f6fd051f2715 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:49.293273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b80340-3a9d-4fe3-86cd-f6fd051f2715 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:49.293538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b80340-3a9d-4fe3-86cd-f6fd051f2715 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:49.294215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b80340-3a9d-4fe3-86cd-f6fd051f2715 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:49.294513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b80340-3a9d-4fe3-86cd-f6fd051f2715 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:49.295913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b80340-3a9d-4fe3-86cd-f6fd051f2715 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:49.307922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 632/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:17:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:49.313889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f4179-bc1b-4820-81df-67284ba7ca48 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:49.402679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:49.410890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f4179-bc1b-4820-81df-67284ba7ca48 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:49.442237 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9959899-d9ab-4310-b793-0398e807ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:49.442816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9959899-d9ab-4310-b793-0398e807ba71 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:49.443088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9959899-d9ab-4310-b793-0398e807ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:49.443356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9959899-d9ab-4310-b793-0398e807ba71 None admin] PATH_INFO: `/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/505c7c48b0d14dc9af8006cc7e8eea53/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:49.445219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9959899-d9ab-4310-b793-0398e807ba71 None admin] RBAC: Authorizing `identity:create_grant(project_id=c41ae2f9d03c48be8017a1ca480bf7db, user_id=505c7c48b0d14dc9af8006cc7e8eea53, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:49.446607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9959899-d9ab-4310-b793-0398e807ba71 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:49.502832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 641/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 10:17:49 2022] PUT /identity/v3/projects/c41ae2f9d03c48be8017a1ca480bf7db/users/505c7c48b0d14dc9af8006cc7e8eea53/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:17:51.638523 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3cdb6-9904-4360-b446-14e4a6c9759b None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:51.639065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3cdb6-9904-4360-b446-14e4a6c9759b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:51.639065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3cdb6-9904-4360-b446-14e4a6c9759b None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:51.640452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 633/1274] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:17:51.645740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7e9cf-4087-4a39-92a9-baf1ff891c5e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:51.646122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7e9cf-4087-4a39-92a9-baf1ff891c5e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:51.646311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7e9cf-4087-4a39-92a9-baf1ff891c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:51.664776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-62a7e9cf-4087-4a39-92a9-baf1ff891c5e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:17:51.666041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-62a7e9cf-4087-4a39-92a9-baf1ff891c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:17:51.734725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 642/1275] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:17:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:17:52.002226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3cdb6-9904-4360-b446-14e4a6c9759b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:52.103744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3cdb6-9904-4360-b446-14e4a6c9759b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:52.121238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:52.137875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037167ec-2c73-4984-8a4a-f607cd3d2853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:52.138498 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037167ec-2c73-4984-8a4a-f607cd3d2853 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:52.138775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037167ec-2c73-4984-8a4a-f607cd3d2853 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:52.139046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037167ec-2c73-4984-8a4a-f607cd3d2853 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:52.149071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037167ec-2c73-4984-8a4a-f607cd3d2853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-037167ec-2c73-4984-8a4a-f607cd3d2853 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 10:17:52.154048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:52.155099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:52.156006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 634/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 10:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:52.161229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7e9cf-4087-4a39-92a9-baf1ff891c5e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:52.238645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:52.256116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7e9cf-4087-4a39-92a9-baf1ff891c5e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:52.289080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771c485-6eb9-4b97-ae57-afbed0e3b195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:52.289670 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771c485-6eb9-4b97-ae57-afbed0e3b195 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:52.289945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771c485-6eb9-4b97-ae57-afbed0e3b195 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:52.290211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771c485-6eb9-4b97-ae57-afbed0e3b195 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:52.290861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771c485-6eb9-4b97-ae57-afbed0e3b195 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:52.291163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771c485-6eb9-4b97-ae57-afbed0e3b195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:52.293074 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771c485-6eb9-4b97-ae57-afbed0e3b195 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:52.300710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 643/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 10:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:52.306576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037167ec-2c73-4984-8a4a-f607cd3d2853 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:52.405650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037167ec-2c73-4984-8a4a-f607cd3d2853 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:52.439263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bc313-7d53-409a-9df2-4188c5d6d812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:52.439886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bc313-7d53-409a-9df2-4188c5d6d812 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:52.440185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bc313-7d53-409a-9df2-4188c5d6d812 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:52.440456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bc313-7d53-409a-9df2-4188c5d6d812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:52.450157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bc313-7d53-409a-9df2-4188c5d6d812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:52.459482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bc313-7d53-409a-9df2-4188c5d6d812 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-3e5bc313-7d53-409a-9df2-4188c5d6d812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:52.465673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:52.466824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:52.467939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:52.467939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:52.467939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:52.467939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 635/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:52.472563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771c485-6eb9-4b97-ae57-afbed0e3b195 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:52.572481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771c485-6eb9-4b97-ae57-afbed0e3b195 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:52.608389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb2660-2886-424c-a138-fa30dd1dc806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:52.608977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb2660-2886-424c-a138-fa30dd1dc806 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:52.609259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb2660-2886-424c-a138-fa30dd1dc806 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:52.609512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb2660-2886-424c-a138-fa30dd1dc806 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:52.610134 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb2660-2886-424c-a138-fa30dd1dc806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:52.610436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb2660-2886-424c-a138-fa30dd1dc806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:52.611796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb2660-2886-424c-a138-fa30dd1dc806 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:52.623520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 644/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:52.629346 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bc313-7d53-409a-9df2-4188c5d6d812 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:52.659321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:52.734696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bc313-7d53-409a-9df2-4188c5d6d812 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:52.767520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc090f-d996-412b-b5c9-87f34c07f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:52.768173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc090f-d996-412b-b5c9-87f34c07f386 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:52.768451 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc090f-d996-412b-b5c9-87f34c07f386 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:52.768718 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc090f-d996-412b-b5c9-87f34c07f386 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:52.776190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc090f-d996-412b-b5c9-87f34c07f386 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:52.777629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc090f-d996-412b-b5c9-87f34c07f386 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d9fc090f-d996-412b-b5c9-87f34c07f386 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 10:17:52.789548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:52.790649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:52.792571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:52.792571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:52.792571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 10:17:52.792571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 10:17:52.792571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 10:17:52.792571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 10:17:52.792571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 10:17:52.792571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 10:17:52.792571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 10:17:52.792571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:52.792571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 636/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:52.797172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb2660-2886-424c-a138-fa30dd1dc806 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:52.800928 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:52.892354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb2660-2886-424c-a138-fa30dd1dc806 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:52.926621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb57bfd-3271-4d48-aeda-a0c569d15270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:52.927266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb57bfd-3271-4d48-aeda-a0c569d15270 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:52.927569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb57bfd-3271-4d48-aeda-a0c569d15270 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:52.927836 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb57bfd-3271-4d48-aeda-a0c569d15270 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:52.928592 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb57bfd-3271-4d48-aeda-a0c569d15270 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:52.928896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb57bfd-3271-4d48-aeda-a0c569d15270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:52.930343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb57bfd-3271-4d48-aeda-a0c569d15270 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:52.946946 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 645/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Oct 4 10:17:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:52.952766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc090f-d996-412b-b5c9-87f34c07f386 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:53.042928 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:53.052283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc090f-d996-412b-b5c9-87f34c07f386 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:53.085049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce847b0d-d4eb-4eb8-81c9-59842e192a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:53.085643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce847b0d-d4eb-4eb8-81c9-59842e192a27 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:53.085920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce847b0d-d4eb-4eb8-81c9-59842e192a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:53.086191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce847b0d-d4eb-4eb8-81c9-59842e192a27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:53.150026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce847b0d-d4eb-4eb8-81c9-59842e192a27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:53.152023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce847b0d-d4eb-4eb8-81c9-59842e192a27 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:53.237716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:53.247532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 637/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 10:17:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 10:17:53.253638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb57bfd-3271-4d48-aeda-a0c569d15270 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:53.315472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:53.353442 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb57bfd-3271-4d48-aeda-a0c569d15270 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:53.386288 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea7d8-13cd-4156-8d2b-3ae9ca43c7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:53.386904 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea7d8-13cd-4156-8d2b-3ae9ca43c7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:53.387181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea7d8-13cd-4156-8d2b-3ae9ca43c7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:53.387450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea7d8-13cd-4156-8d2b-3ae9ca43c7c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:53.399596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeea7d8-13cd-4156-8d2b-3ae9ca43c7c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:53.404000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeea7d8-13cd-4156-8d2b-3ae9ca43c7c7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ffeea7d8-13cd-4156-8d2b-3ae9ca43c7c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 10:17:53.416049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:53.417112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 10:17:53.418093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 10:17:53.418093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 10:17:53.418093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:53.418093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 646/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:53.422996 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce847b0d-d4eb-4eb8-81c9-59842e192a27 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:53.520503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce847b0d-d4eb-4eb8-81c9-59842e192a27 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:53.552811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7167c84-74c3-4fdf-8ebc-7d17cc09e4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:53.553543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7167c84-74c3-4fdf-8ebc-7d17cc09e4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:53.553745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7167c84-74c3-4fdf-8ebc-7d17cc09e4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:53.554012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7167c84-74c3-4fdf-8ebc-7d17cc09e4d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:53.554656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7167c84-74c3-4fdf-8ebc-7d17cc09e4d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:53.554960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7167c84-74c3-4fdf-8ebc-7d17cc09e4d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:53.556343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7167c84-74c3-4fdf-8ebc-7d17cc09e4d3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:53.567923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 638/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 10:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:53.574235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea7d8-13cd-4156-8d2b-3ae9ca43c7c7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:53.673800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea7d8-13cd-4156-8d2b-3ae9ca43c7c7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:53.687483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:53.706989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb70f60-eef9-4072-9bf4-8ae595b2511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:53.707615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb70f60-eef9-4072-9bf4-8ae595b2511a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:53.707876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb70f60-eef9-4072-9bf4-8ae595b2511a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:53.708175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb70f60-eef9-4072-9bf4-8ae595b2511a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:53.714562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb70f60-eef9-4072-9bf4-8ae595b2511a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:53.717300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb70f60-eef9-4072-9bf4-8ae595b2511a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4cb70f60-eef9-4072-9bf4-8ae595b2511a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 10:17:53.728576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:53.729630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:53.730682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 10:17:53.730682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 10:17:53.730682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 10:17:53.730682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 10:17:53.730682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 10:17:53.730682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 10:17:53.730682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 10:17:53.730682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: ERROR keystone.server.flask.application Oct 04 10:17:53.730682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 647/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 10:17:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:53.735688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7167c84-74c3-4fdf-8ebc-7d17cc09e4d3 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:53.785312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:53.833698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7167c84-74c3-4fdf-8ebc-7d17cc09e4d3 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:53.866038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f69d8-32a4-4dff-9194-76d01ff87a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:53.866633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f69d8-32a4-4dff-9194-76d01ff87a75 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:53.866907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f69d8-32a4-4dff-9194-76d01ff87a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:53.867176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f69d8-32a4-4dff-9194-76d01ff87a75 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:53.867911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f69d8-32a4-4dff-9194-76d01ff87a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:53.868244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f69d8-32a4-4dff-9194-76d01ff87a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:53.870269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f69d8-32a4-4dff-9194-76d01ff87a75 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:53.881646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 639/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 10:17:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:53.887710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb70f60-eef9-4072-9bf4-8ae595b2511a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:53.987889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb70f60-eef9-4072-9bf4-8ae595b2511a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:54.020227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf73066-54df-4903-90f1-056e60adcabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:54.020820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf73066-54df-4903-90f1-056e60adcabd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:54.021095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf73066-54df-4903-90f1-056e60adcabd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:54.021362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf73066-54df-4903-90f1-056e60adcabd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:54.022081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf73066-54df-4903-90f1-056e60adcabd None admin] RBAC: Adding query filter params (role.id=6f40bb5616cd47bd8a43ef05c2643557, scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db, user.id=505c7c48b0d14dc9af8006cc7e8eea53) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:54.022378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf73066-54df-4903-90f1-056e60adcabd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:54.023785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf73066-54df-4903-90f1-056e60adcabd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:54.029329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 648/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 10:17:53 2022] GET /identity/v3/role_assignments?user.id=505c7c48b0d14dc9af8006cc7e8eea53&scope.project.id=c41ae2f9d03c48be8017a1ca480bf7db&role.id=6f40bb5616cd47bd8a43ef05c2643557 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:56.178622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a526f-8f18-479b-a1c7-64f2f41dd9cc None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:56.179169 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a526f-8f18-479b-a1c7-64f2f41dd9cc None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:56.179169 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a526f-8f18-479b-a1c7-64f2f41dd9cc None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:56.180538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 640/1288] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:17:56.186367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc751d-9000-408c-b033-275f662e0678 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:56.186798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc751d-9000-408c-b033-275f662e0678 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:56.186899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc751d-9000-408c-b033-275f662e0678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:56.205265 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-efcc751d-9000-408c-b033-275f662e0678 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:17:56.206478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-efcc751d-9000-408c-b033-275f662e0678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:17:56.235625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:56.270764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 649/1289] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:17:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:17:56.539817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a526f-8f18-479b-a1c7-64f2f41dd9cc None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:56.638149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a526f-8f18-479b-a1c7-64f2f41dd9cc None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:56.648323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:56.671396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b3ea4-e992-4047-bac9-13edecc18f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:56.672050 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b3ea4-e992-4047-bac9-13edecc18f4e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:56.672332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b3ea4-e992-4047-bac9-13edecc18f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:56.672601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b3ea4-e992-4047-bac9-13edecc18f4e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:56.673174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b3ea4-e992-4047-bac9-13edecc18f4e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:56.674518 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b3ea4-e992-4047-bac9-13edecc18f4e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-502b3ea4-e992-4047-bac9-13edecc18f4e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:17:56.682944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:17:56.684202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:17:56.685261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 641/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 10:17:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:17:56.689972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc751d-9000-408c-b033-275f662e0678 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:56.785516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc751d-9000-408c-b033-275f662e0678 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:56.819168 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ae14a-ffb2-4d89-9129-c0e787c32d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:56.819702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ae14a-ffb2-4d89-9129-c0e787c32d14 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:56.820074 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ae14a-ffb2-4d89-9129-c0e787c32d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:56.820350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ae14a-ffb2-4d89-9129-c0e787c32d14 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:56.820973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ae14a-ffb2-4d89-9129-c0e787c32d14 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:56.821273 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ae14a-ffb2-4d89-9129-c0e787c32d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:56.823144 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ae14a-ffb2-4d89-9129-c0e787c32d14 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:56.827780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 650/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Oct 4 10:17:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:17:56.833508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b3ea4-e992-4047-bac9-13edecc18f4e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:56.933245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b3ea4-e992-4047-bac9-13edecc18f4e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:56.966669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ea0c6-1cbe-41dd-a230-4fc51e2bd57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:56.967274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ea0c6-1cbe-41dd-a230-4fc51e2bd57d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:56.967551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ea0c6-1cbe-41dd-a230-4fc51e2bd57d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:56.967824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ea0c6-1cbe-41dd-a230-4fc51e2bd57d None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:56.968476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ea0c6-1cbe-41dd-a230-4fc51e2bd57d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:17:56.968775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ea0c6-1cbe-41dd-a230-4fc51e2bd57d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:56.970161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ea0c6-1cbe-41dd-a230-4fc51e2bd57d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:56.974704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 642/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Oct 4 10:17:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:17:59.128332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2098e8d-fe56-4ba7-9130-785072c80247 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:59.128905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2098e8d-fe56-4ba7-9130-785072c80247 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:59.128905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2098e8d-fe56-4ba7-9130-785072c80247 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:59.130227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 651/1293] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:17:59.136817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d50f69-1673-4cd5-8aff-6bdd9d82e6b5 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:59.138936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d50f69-1673-4cd5-8aff-6bdd9d82e6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:59.138936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d50f69-1673-4cd5-8aff-6bdd9d82e6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:59.156709 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-63d50f69-1673-4cd5-8aff-6bdd9d82e6b5 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:17:59.157924 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-63d50f69-1673-4cd5-8aff-6bdd9d82e6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:17:59.189693 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:59.229073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 643/1294] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:17:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:17:59.501922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2098e8d-fe56-4ba7-9130-785072c80247 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:17:59.532929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:17:59.603504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2098e8d-fe56-4ba7-9130-785072c80247 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:17:59.635744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c24b70-c6f0-4c3f-b65f-a591b70db140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:17:59.636428 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c24b70-c6f0-4c3f-b65f-a591b70db140 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:17:59.636703 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c24b70-c6f0-4c3f-b65f-a591b70db140 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:17:59.636970 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c24b70-c6f0-4c3f-b65f-a591b70db140 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:17:59.637615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c24b70-c6f0-4c3f-b65f-a591b70db140 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:17:59.638948 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c24b70-c6f0-4c3f-b65f-a591b70db140 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:17:59.721319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 652/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 10:17:59 2022] POST /identity/v3/services => generated 246 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:18:01.845413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265d526-4774-456e-bf67-69681d45fe99 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:18:01.845969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265d526-4774-456e-bf67-69681d45fe99 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:18:01.845969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265d526-4774-456e-bf67-69681d45fe99 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:18:01.847335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 644/1296] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:18:01.852754 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026ded2-064f-4994-9f67-a9ede1c4268f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:18:01.853157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026ded2-064f-4994-9f67-a9ede1c4268f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:18:01.862004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026ded2-064f-4994-9f67-a9ede1c4268f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:18:01.871558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7026ded2-064f-4994-9f67-a9ede1c4268f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:18:01.872766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7026ded2-064f-4994-9f67-a9ede1c4268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:18:01.943621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 653/1297] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:18:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:18:02.207680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265d526-4774-456e-bf67-69681d45fe99 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:18:02.312454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265d526-4774-456e-bf67-69681d45fe99 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:18:02.345536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d81f5c-6ca4-455f-81e4-79ea3aea1bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:18:02.346158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81f5c-6ca4-455f-81e4-79ea3aea1bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:18:02.346435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81f5c-6ca4-455f-81e4-79ea3aea1bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:18:02.346704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81f5c-6ca4-455f-81e4-79ea3aea1bf1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:18:02.347279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d81f5c-6ca4-455f-81e4-79ea3aea1bf1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:18:02.348737 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d81f5c-6ca4-455f-81e4-79ea3aea1bf1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d4d81f5c-6ca4-455f-81e4-79ea3aea1bf1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:18:02.358154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:18:02.360974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:18:02.362047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 645/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 10:18:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:18:02.365303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026ded2-064f-4994-9f67-a9ede1c4268f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:18:02.383602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:18:02.462098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026ded2-064f-4994-9f67-a9ede1c4268f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:18:02.495546 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841cb4e-d4e1-4d01-b88b-2095b93da253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:18:02.496163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841cb4e-d4e1-4d01-b88b-2095b93da253 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:18:02.496439 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841cb4e-d4e1-4d01-b88b-2095b93da253 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:18:02.496709 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841cb4e-d4e1-4d01-b88b-2095b93da253 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:18:02.497336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841cb4e-d4e1-4d01-b88b-2095b93da253 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:18:02.497836 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841cb4e-d4e1-4d01-b88b-2095b93da253 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:18:02.500079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841cb4e-d4e1-4d01-b88b-2095b93da253 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:18:02.505068 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 654/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Oct 4 10:18:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:18:02.511135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d81f5c-6ca4-455f-81e4-79ea3aea1bf1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:18:02.543403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:18:02.607879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d81f5c-6ca4-455f-81e4-79ea3aea1bf1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:18:02.639481 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff20c7-02e7-4980-9cee-310953498e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:18:02.640098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff20c7-02e7-4980-9cee-310953498e32 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:18:02.640374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff20c7-02e7-4980-9cee-310953498e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:18:02.640648 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff20c7-02e7-4980-9cee-310953498e32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:18:02.641330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff20c7-02e7-4980-9cee-310953498e32 None admin] RBAC: Adding query filter params (interface=public, service_id=6bac43c3ea5744a1beefbfb342dbba8d, region_id=RegionOne) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:18:02.641632 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff20c7-02e7-4980-9cee-310953498e32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:18:02.642968 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff20c7-02e7-4980-9cee-310953498e32 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:18:02.648519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 646/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 10:18:02 2022] GET /identity/v3/endpoints?service_id=6bac43c3ea5744a1beefbfb342dbba8d&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:18:02.654612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841cb4e-d4e1-4d01-b88b-2095b93da253 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:18:02.733610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:18:02.750395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841cb4e-d4e1-4d01-b88b-2095b93da253 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:18:02.782291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7b222-c99c-4aeb-af45-e2cd380025a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:18:02.782890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7b222-c99c-4aeb-af45-e2cd380025a4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:18:02.783375 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7b222-c99c-4aeb-af45-e2cd380025a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:18:02.783806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7b222-c99c-4aeb-af45-e2cd380025a4 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:18:02.784815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7b222-c99c-4aeb-af45-e2cd380025a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:18:02.786184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7b222-c99c-4aeb-af45-e2cd380025a4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:18:02.793400 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 655/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 10:18:02 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:18:04.920134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413aca4-13e2-4081-8165-af11a8b9cef5 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:18:04.924216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413aca4-13e2-4081-8165-af11a8b9cef5 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:18:04.924216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413aca4-13e2-4081-8165-af11a8b9cef5 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:18:04.924216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 647/1302] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:18:04.927365 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f9a9-b44d-44b1-b2d2-4f395ea0fe79 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:18:04.927793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f9a9-b44d-44b1-b2d2-4f395ea0fe79 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:18:04.927914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f9a9-b44d-44b1-b2d2-4f395ea0fe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:18:04.946159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3523f9a9-b44d-44b1-b2d2-4f395ea0fe79 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:18:04.947341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3523f9a9-b44d-44b1-b2d2-4f395ea0fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:18:05.012321 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 656/1303] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:18:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 10:18:05.279033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413aca4-13e2-4081-8165-af11a8b9cef5 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:18:05.373509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:18:05.380000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413aca4-13e2-4081-8165-af11a8b9cef5 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:18:05.413792 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd7740-c6f8-4c62-876a-1e332de5490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:18:05.414409 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd7740-c6f8-4c62-876a-1e332de5490d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:18:05.414685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd7740-c6f8-4c62-876a-1e332de5490d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:18:05.414955 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd7740-c6f8-4c62-876a-1e332de5490d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:18:05.415529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd7740-c6f8-4c62-876a-1e332de5490d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:18:05.416911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd7740-c6f8-4c62-876a-1e332de5490d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-07fd7740-c6f8-4c62-876a-1e332de5490d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 10:18:05.425371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 10:18:05.426588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: ERROR keystone.server.flask.application Oct 04 10:18:05.427759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 648/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 10:18:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 10:18:05.433175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f9a9-b44d-44b1-b2d2-4f395ea0fe79 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:18:05.506527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:18:05.528020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f9a9-b44d-44b1-b2d2-4f395ea0fe79 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:18:05.560443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707c288-6db2-4ed5-8c64-497d291da1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:18:05.560983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707c288-6db2-4ed5-8c64-497d291da1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:18:05.561257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707c288-6db2-4ed5-8c64-497d291da1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:18:05.561525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707c288-6db2-4ed5-8c64-497d291da1e8 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:18:05.562184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707c288-6db2-4ed5-8c64-497d291da1e8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:18:05.562488 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707c288-6db2-4ed5-8c64-497d291da1e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:18:05.563836 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707c288-6db2-4ed5-8c64-497d291da1e8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:18:05.568780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 657/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Oct 4 10:18:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:18:05.575318 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd7740-c6f8-4c62-876a-1e332de5490d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:18:05.671200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd7740-c6f8-4c62-876a-1e332de5490d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:18:05.704496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc1859-4f0c-494c-9bf8-5c4f68c88013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:18:05.705091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1859-4f0c-494c-9bf8-5c4f68c88013 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:18:05.705367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1859-4f0c-494c-9bf8-5c4f68c88013 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:18:05.705633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1859-4f0c-494c-9bf8-5c4f68c88013 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:18:05.706287 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc1859-4f0c-494c-9bf8-5c4f68c88013 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:18:05.707649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc1859-4f0c-494c-9bf8-5c4f68c88013 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:18:05.806716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 649/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:18:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:18:15.624170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=30 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:18:15.802161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:25:47.125298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24855215-02d2-4208-9329-2b01224181d4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:47.126346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24855215-02d2-4208-9329-2b01224181d4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:47.126867 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24855215-02d2-4208-9329-2b01224181d4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:47.134130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d090a-7564-48ff-9abc-e12086ad7cf7 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:47.135035 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d090a-7564-48ff-9abc-e12086ad7cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:47.135514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d090a-7564-48ff-9abc-e12086ad7cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:47.140344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 658/1307] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:25:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:25:47.250315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-063d090a-7564-48ff-9abc-e12086ad7cf7 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:25:47.251440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-063d090a-7564-48ff-9abc-e12086ad7cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:47.427990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 650/1308] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:25:47.723712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782779d-168c-466d-8bff-4fa2bde95942 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:47.723915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782779d-168c-466d-8bff-4fa2bde95942 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:47.724286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782779d-168c-466d-8bff-4fa2bde95942 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:47.725912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 659/1309] 10.222.0.33 () {54 vars in 964 bytes} [Tue Oct 4 10:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:25:47.734871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5e4c-74e3-49a5-9d1c-3ae4a3223325 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:47.735168 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5e4c-74e3-49a5-9d1c-3ae4a3223325 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:47.735445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5e4c-74e3-49a5-9d1c-3ae4a3223325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:47.820072 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-2dff5e4c-74e3-49a5-9d1c-3ae4a3223325 None None] MFA Rules not processed for user `b040de20aa6f4e7b8366c7daa54c093c`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:25:47.821293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2dff5e4c-74e3-49a5-9d1c-3ae4a3223325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:47.844881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:25:47.918302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 651/1310] 10.222.0.33 () {58 vars in 1061 bytes} [Tue Oct 4 10:25:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:25:47.927574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782779d-168c-466d-8bff-4fa2bde95942 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:25:47.929391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0782779d-168c-466d-8bff-4fa2bde95942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:48.068495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782779d-168c-466d-8bff-4fa2bde95942 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:25:48.158677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5c8f2-d005-49a0-8075-0d13f475fd09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:25:48.159473 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c8f2-d005-49a0-8075-0d13f475fd09 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:48.159871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c8f2-d005-49a0-8075-0d13f475fd09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:48.160292 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c8f2-d005-49a0-8075-0d13f475fd09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:48.162012 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-dbe5c8f2-d005-49a0-8075-0d13f475fd09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:48.227562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:25:48.300930 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5c8f2-d005-49a0-8075-0d13f475fd09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:25:48.302314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5c8f2-d005-49a0-8075-0d13f475fd09 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:25:48.326892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 660/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:25:50.841061 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c097a5-489e-4bb4-a0b7-2d337ce8e1dd None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:50.841599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c097a5-489e-4bb4-a0b7-2d337ce8e1dd None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:50.841599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c097a5-489e-4bb4-a0b7-2d337ce8e1dd None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:50.842957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 652/1312] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:25:50.848732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778ddf1-55b8-40c8-b25a-849d98c8a140 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:50.849125 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778ddf1-55b8-40c8-b25a-849d98c8a140 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:50.849298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778ddf1-55b8-40c8-b25a-849d98c8a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:50.937636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a778ddf1-55b8-40c8-b25a-849d98c8a140 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:25:50.938839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a778ddf1-55b8-40c8-b25a-849d98c8a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:51.036025 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 661/1313] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:25:51.323171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c097a5-489e-4bb4-a0b7-2d337ce8e1dd None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:25:51.324739 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b8c097a5-489e-4bb4-a0b7-2d337ce8e1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:51.426564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c097a5-489e-4bb4-a0b7-2d337ce8e1dd None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:25:51.495348 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:25:51.497674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411a58d-3373-4bd2-97e7-9129afe4c0c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:25:51.498267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411a58d-3373-4bd2-97e7-9129afe4c0c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:51.498541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411a58d-3373-4bd2-97e7-9129afe4c0c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:51.498808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411a58d-3373-4bd2-97e7-9129afe4c0c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:51.500972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7411a58d-3373-4bd2-97e7-9129afe4c0c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:51.607413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411a58d-3373-4bd2-97e7-9129afe4c0c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:25:51.608810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411a58d-3373-4bd2-97e7-9129afe4c0c7 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:25:51.626730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 653/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:25:54.352310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1ac0-5853-4152-a3c5-2d3f90c64b26 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:54.352822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1ac0-5853-4152-a3c5-2d3f90c64b26 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:54.352822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1ac0-5853-4152-a3c5-2d3f90c64b26 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:54.354101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 662/1315] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:25:54.359234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affcad3-26f7-4cf6-b61d-de02cc297456 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:54.359632 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affcad3-26f7-4cf6-b61d-de02cc297456 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:54.359783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affcad3-26f7-4cf6-b61d-de02cc297456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:54.423663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6affcad3-26f7-4cf6-b61d-de02cc297456 None None] MFA Rules not processed for user `a8bbff83ddbe4d6295c01a6aea214d09`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:25:54.424890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6affcad3-26f7-4cf6-b61d-de02cc297456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:54.475605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:25:54.519670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 654/1316] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:25:54 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:25:54.802055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae1ac0-5853-4152-a3c5-2d3f90c64b26 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:25:54.803605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-07ae1ac0-5853-4152-a3c5-2d3f90c64b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:54.813750 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:25:54.903332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae1ac0-5853-4152-a3c5-2d3f90c64b26 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:25:54.977764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72ace1-5bab-49d1-a24b-adc4e3660080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:25:54.978364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72ace1-5bab-49d1-a24b-adc4e3660080 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:54.978642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72ace1-5bab-49d1-a24b-adc4e3660080 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:54.978912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72ace1-5bab-49d1-a24b-adc4e3660080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:54.980512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6f72ace1-5bab-49d1-a24b-adc4e3660080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:55.040683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:25:55.087521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72ace1-5bab-49d1-a24b-adc4e3660080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:25:55.088945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72ace1-5bab-49d1-a24b-adc4e3660080 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:25:55.108081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 663/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:25:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:25:58.042330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1b788-1d13-442e-b642-d2b833ac8a69 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:58.042885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1b788-1d13-442e-b642-d2b833ac8a69 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:58.042885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1b788-1d13-442e-b642-d2b833ac8a69 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:58.044237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 655/1318] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:25:58.050067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c7346-db83-4cb7-b9a0-a60976780d21 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:58.050478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c7346-db83-4cb7-b9a0-a60976780d21 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:58.050633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c7346-db83-4cb7-b9a0-a60976780d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:58.114564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-cf1c7346-db83-4cb7-b9a0-a60976780d21 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:25:58.115741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cf1c7346-db83-4cb7-b9a0-a60976780d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:58.209581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 664/1319] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:25:58.489302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1b788-1d13-442e-b642-d2b833ac8a69 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:25:58.490823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3fe1b788-1d13-442e-b642-d2b833ac8a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:58.591642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1b788-1d13-442e-b642-d2b833ac8a69 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:25:58.663163 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3410e-81f0-4666-8f89-be1fda915e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:25:58.663754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3410e-81f0-4666-8f89-be1fda915e5d service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:25:58.664052 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3410e-81f0-4666-8f89-be1fda915e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:25:58.664320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3410e-81f0-4666-8f89-be1fda915e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:25:58.665888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-44f3410e-81f0-4666-8f89-be1fda915e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:25:58.673057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:25:58.771370 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3410e-81f0-4666-8f89-be1fda915e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:25:58.772729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3410e-81f0-4666-8f89-be1fda915e5d service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:25:58.790093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 656/1320] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:01.928045 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe492b-d4f8-4e9c-859b-592bc2c2e464 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:01.928543 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe492b-d4f8-4e9c-859b-592bc2c2e464 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:01.928650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe492b-d4f8-4e9c-859b-592bc2c2e464 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:01.929945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 665/1321] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:01.935250 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537270ec-7070-4bb2-ac64-7d618821b40d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:01.935681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537270ec-7070-4bb2-ac64-7d618821b40d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:01.935925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537270ec-7070-4bb2-ac64-7d618821b40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:02.001864 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-537270ec-7070-4bb2-ac64-7d618821b40d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:02.003074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-537270ec-7070-4bb2-ac64-7d618821b40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:02.059755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:02.098601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 657/1322] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:02.377223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe492b-d4f8-4e9c-859b-592bc2c2e464 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:02.378746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fbfe492b-d4f8-4e9c-859b-592bc2c2e464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:02.399100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:02.481941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe492b-d4f8-4e9c-859b-592bc2c2e464 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:02.570615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9df77d-62f4-4c6f-b00e-38b42a2605b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:02.571111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df77d-62f4-4c6f-b00e-38b42a2605b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:02.571388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df77d-62f4-4c6f-b00e-38b42a2605b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:02.571654 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df77d-62f4-4c6f-b00e-38b42a2605b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:02.573270 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2f9df77d-62f4-4c6f-b00e-38b42a2605b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:02.644569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:02.681457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9df77d-62f4-4c6f-b00e-38b42a2605b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:02.682929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9df77d-62f4-4c6f-b00e-38b42a2605b3 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:02.701056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 666/1323] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:04.915531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad32b2-73a6-4ef1-9521-0ea0df38991e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:04.915969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad32b2-73a6-4ef1-9521-0ea0df38991e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:04.916125 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad32b2-73a6-4ef1-9521-0ea0df38991e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:04.917537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 658/1324] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:04.923332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369df808-872a-40fb-9c2d-a08a20edef57 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:04.923738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369df808-872a-40fb-9c2d-a08a20edef57 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:04.923882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369df808-872a-40fb-9c2d-a08a20edef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:04.995836 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-369df808-872a-40fb-9c2d-a08a20edef57 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:04.997111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-369df808-872a-40fb-9c2d-a08a20edef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:05.093707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 667/1325] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:05.372391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad32b2-73a6-4ef1-9521-0ea0df38991e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:05.374630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4cad32b2-73a6-4ef1-9521-0ea0df38991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:05.476049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad32b2-73a6-4ef1-9521-0ea0df38991e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:05.549950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b432416-ed80-4251-a268-bcda30a59ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:05.550552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b432416-ed80-4251-a268-bcda30a59ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:05.550828 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b432416-ed80-4251-a268-bcda30a59ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:05.551098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b432416-ed80-4251-a268-bcda30a59ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:05.552723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6b432416-ed80-4251-a268-bcda30a59ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:05.570093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:05.668247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b432416-ed80-4251-a268-bcda30a59ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:05.669676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b432416-ed80-4251-a268-bcda30a59ad3 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:05.688506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 659/1326] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:07.932526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be062249-ff96-4250-8a31-3864d7725b61 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:07.933007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be062249-ff96-4250-8a31-3864d7725b61 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:07.933110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be062249-ff96-4250-8a31-3864d7725b61 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:07.934420 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 668/1327] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:07.939536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a6c2a-c9aa-459a-9e8c-581dab077691 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:07.940004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a6c2a-c9aa-459a-9e8c-581dab077691 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:07.940119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a6c2a-c9aa-459a-9e8c-581dab077691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:08.005274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c24a6c2a-c9aa-459a-9e8c-581dab077691 None None] MFA Rules not processed for user `a8bbff83ddbe4d6295c01a6aea214d09`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:08.006405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c24a6c2a-c9aa-459a-9e8c-581dab077691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:08.071384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:08.102259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 660/1328] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:08.387221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be062249-ff96-4250-8a31-3864d7725b61 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:08.388744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-be062249-ff96-4250-8a31-3864d7725b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:08.421708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:08.497042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be062249-ff96-4250-8a31-3864d7725b61 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:08.573886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fd952-578f-4200-80b5-d449fc7e62ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:08.574489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fd952-578f-4200-80b5-d449fc7e62ee service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:08.574765 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fd952-578f-4200-80b5-d449fc7e62ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:08.575151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fd952-578f-4200-80b5-d449fc7e62ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:08.576669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-563fd952-578f-4200-80b5-d449fc7e62ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:08.656992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:08.688553 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563fd952-578f-4200-80b5-d449fc7e62ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:08.690013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563fd952-578f-4200-80b5-d449fc7e62ee service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:08.708753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 669/1329] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:11.356978 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f53eb-6211-4ab3-a37f-8523516f41c9 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:11.357531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f53eb-6211-4ab3-a37f-8523516f41c9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:11.357531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f53eb-6211-4ab3-a37f-8523516f41c9 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:11.358988 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 661/1330] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:11.364219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed13b0-8d57-4e36-aa38-2f9dcad7f0b6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:11.364607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed13b0-8d57-4e36-aa38-2f9dcad7f0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:11.364777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed13b0-8d57-4e36-aa38-2f9dcad7f0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:11.428691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b6ed13b0-8d57-4e36-aa38-2f9dcad7f0b6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:11.429895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b6ed13b0-8d57-4e36-aa38-2f9dcad7f0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:11.523856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 670/1331] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:11.803014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f53eb-6211-4ab3-a37f-8523516f41c9 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:11.804574 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7a9f53eb-6211-4ab3-a37f-8523516f41c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:11.906055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f53eb-6211-4ab3-a37f-8523516f41c9 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:11.979326 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7afed-1bce-4f65-ba35-87b43588bb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:11.979918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7afed-1bce-4f65-ba35-87b43588bb03 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:11.980219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7afed-1bce-4f65-ba35-87b43588bb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:11.980481 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7afed-1bce-4f65-ba35-87b43588bb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:11.982056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-69a7afed-1bce-4f65-ba35-87b43588bb03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:12.008431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:12.086458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7afed-1bce-4f65-ba35-87b43588bb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:12.087802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7afed-1bce-4f65-ba35-87b43588bb03 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:12.107158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 662/1332] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:14.308599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f540792-a020-4b40-854d-33e5df99bd83 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:14.309123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f540792-a020-4b40-854d-33e5df99bd83 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:14.309123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f540792-a020-4b40-854d-33e5df99bd83 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:14.310438 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 671/1333] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:14.315563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48624d-1dc8-4a6e-a395-712641193e35 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:14.316032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48624d-1dc8-4a6e-a395-712641193e35 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:14.316148 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48624d-1dc8-4a6e-a395-712641193e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:14.380540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0a48624d-1dc8-4a6e-a395-712641193e35 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:14.381735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0a48624d-1dc8-4a6e-a395-712641193e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:14.453887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:14.475928 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 663/1334] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:14.761830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f540792-a020-4b40-854d-33e5df99bd83 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:14.763364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9f540792-a020-4b40-854d-33e5df99bd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:14.803248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:14.864478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f540792-a020-4b40-854d-33e5df99bd83 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:14.937830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d6345-3b5a-400a-bf84-dd6525569303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:14.938426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d6345-3b5a-400a-bf84-dd6525569303 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:14.938705 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d6345-3b5a-400a-bf84-dd6525569303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:14.938976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d6345-3b5a-400a-bf84-dd6525569303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:14.940584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-410d6345-3b5a-400a-bf84-dd6525569303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:15.031298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:15.055541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d6345-3b5a-400a-bf84-dd6525569303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:15.057008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d6345-3b5a-400a-bf84-dd6525569303 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:15.075745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 672/1335] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:17.772927 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa1e83-b04d-448a-a6e3-6a192fe1284e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:17.773473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa1e83-b04d-448a-a6e3-6a192fe1284e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:17.773473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa1e83-b04d-448a-a6e3-6a192fe1284e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:17.774985 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 664/1336] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:17.780220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9246a-ea82-43e3-a0ac-12157ad93cd7 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:17.780647 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9246a-ea82-43e3-a0ac-12157ad93cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:17.780768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9246a-ea82-43e3-a0ac-12157ad93cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:17.848143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e5b9246a-ea82-43e3-a0ac-12157ad93cd7 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:17.849371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e5b9246a-ea82-43e3-a0ac-12157ad93cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:17.945232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 673/1337] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:18.223318 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa1e83-b04d-448a-a6e3-6a192fe1284e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:18.224867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6baa1e83-b04d-448a-a6e3-6a192fe1284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:18.326238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa1e83-b04d-448a-a6e3-6a192fe1284e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:18.399547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34620a59-e939-44b7-9213-b05a40baee7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:18.400166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34620a59-e939-44b7-9213-b05a40baee7a service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:18.400441 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34620a59-e939-44b7-9213-b05a40baee7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:18.400707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34620a59-e939-44b7-9213-b05a40baee7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:18.402303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-34620a59-e939-44b7-9213-b05a40baee7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:18.436949 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:18.508106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34620a59-e939-44b7-9213-b05a40baee7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:18.509453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34620a59-e939-44b7-9213-b05a40baee7a service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:18.527694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 665/1338] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:22.843459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74274e20-2ed1-4765-b4a8-9d53537d1cb3 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:22.844039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74274e20-2ed1-4765-b4a8-9d53537d1cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:22.844039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74274e20-2ed1-4765-b4a8-9d53537d1cb3 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:22.845381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 674/1339] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:22.850715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a849993-c004-4efc-928f-b5521ede469b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:22.851173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a849993-c004-4efc-928f-b5521ede469b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:22.851267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a849993-c004-4efc-928f-b5521ede469b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:22.921394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-7a849993-c004-4efc-928f-b5521ede469b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:22.922588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7a849993-c004-4efc-928f-b5521ede469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:23.006737 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:23.018305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 666/1340] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:23.300723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74274e20-2ed1-4765-b4a8-9d53537d1cb3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:23.302324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-74274e20-2ed1-4765-b4a8-9d53537d1cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:23.352267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:23.407561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74274e20-2ed1-4765-b4a8-9d53537d1cb3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:23.481083 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525cb5b-c5c6-418b-9adc-fd1115fe19cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:23.481684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525cb5b-c5c6-418b-9adc-fd1115fe19cd service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:23.481958 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525cb5b-c5c6-418b-9adc-fd1115fe19cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:23.482223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525cb5b-c5c6-418b-9adc-fd1115fe19cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:23.484415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7525cb5b-c5c6-418b-9adc-fd1115fe19cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:23.578275 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:23.594568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525cb5b-c5c6-418b-9adc-fd1115fe19cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:23.595999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525cb5b-c5c6-418b-9adc-fd1115fe19cd service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:23.614505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 675/1341] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:26.802150 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4cc4a-c194-47e3-b320-163c9d74b4d0 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:26.802708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4cc4a-c194-47e3-b320-163c9d74b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:26.802708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4cc4a-c194-47e3-b320-163c9d74b4d0 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:26.804239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 667/1342] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:26.809163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c1b23-df9e-40e5-82d6-6760ccbe9662 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:26.809605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c1b23-df9e-40e5-82d6-6760ccbe9662 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:26.809699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c1b23-df9e-40e5-82d6-6760ccbe9662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:26.874957 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e31c1b23-df9e-40e5-82d6-6760ccbe9662 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:26.876200 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e31c1b23-df9e-40e5-82d6-6760ccbe9662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:26.974258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 676/1343] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:27.266862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d611384-00ba-478d-845e-c91ebb43a981 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:27.267138 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d611384-00ba-478d-845e-c91ebb43a981 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:27.267413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d611384-00ba-478d-845e-c91ebb43a981 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:27.268790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 668/1344] 10.222.0.33 () {54 vars in 964 bytes} [Tue Oct 4 10:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:27.274363 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b665e-3892-453f-9827-6ab438fb59fb None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:27.274652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b665e-3892-453f-9827-6ab438fb59fb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:27.274931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b665e-3892-453f-9827-6ab438fb59fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:27.342490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:27.350887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-451b665e-3892-453f-9827-6ab438fb59fb None None] MFA Rules not processed for user `b040de20aa6f4e7b8366c7daa54c093c`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:27.355109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-451b665e-3892-453f-9827-6ab438fb59fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:27.453650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 677/1345] 10.222.0.33 () {58 vars in 1061 bytes} [Tue Oct 4 10:26:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:27.462642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d611384-00ba-478d-845e-c91ebb43a981 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:27.464202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3d611384-00ba-478d-845e-c91ebb43a981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:27.584632 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d611384-00ba-478d-845e-c91ebb43a981 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:27.662227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661898c-e1d7-48da-aa96-eb6a7c66798f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:27.662836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661898c-e1d7-48da-aa96-eb6a7c66798f service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:27.663109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661898c-e1d7-48da-aa96-eb6a7c66798f service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:27.663373 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661898c-e1d7-48da-aa96-eb6a7c66798f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:27.665029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6661898c-e1d7-48da-aa96-eb6a7c66798f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:27.712078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:27.786208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661898c-e1d7-48da-aa96-eb6a7c66798f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:27.787638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661898c-e1d7-48da-aa96-eb6a7c66798f service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:27.806185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 669/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:32.749391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6102-7f09-4f2c-93e2-d61e1a78b00b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:32.749954 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6102-7f09-4f2c-93e2-d61e1a78b00b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:32.749954 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6102-7f09-4f2c-93e2-d61e1a78b00b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:32.751792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 678/1347] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:32.756853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6681c-9415-418b-8a56-38d725b83721 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:32.757377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6681c-9415-418b-8a56-38d725b83721 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:32.757377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6681c-9415-418b-8a56-38d725b83721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:32.827857 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ade6681c-9415-418b-8a56-38d725b83721 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:32.829152 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ade6681c-9415-418b-8a56-38d725b83721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:32.929148 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:32.931333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 670/1348] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:33.217363 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d6102-7f09-4f2c-93e2-d61e1a78b00b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:33.219535 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b01d6102-7f09-4f2c-93e2-d61e1a78b00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:33.321926 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d6102-7f09-4f2c-93e2-d61e1a78b00b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:33.374342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:33.396831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb818a04-3edb-4f5e-938b-f58f183e61bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:33.397434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818a04-3edb-4f5e-938b-f58f183e61bb service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:33.397712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818a04-3edb-4f5e-938b-f58f183e61bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:33.397979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818a04-3edb-4f5e-938b-f58f183e61bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:33.399565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-eb818a04-3edb-4f5e-938b-f58f183e61bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:33.506626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb818a04-3edb-4f5e-938b-f58f183e61bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:33.508052 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb818a04-3edb-4f5e-938b-f58f183e61bb service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:33.526649 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 679/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:26:38.416089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb7bd2-fddc-4618-99ee-60513dd2adad None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:38.416661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb7bd2-fddc-4618-99ee-60513dd2adad None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:38.416661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb7bd2-fddc-4618-99ee-60513dd2adad None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:38.418138 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 671/1350] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:26:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:38.424037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd15211-e217-4d4c-815f-8769a02fb4bb None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:38.424467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd15211-e217-4d4c-815f-8769a02fb4bb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:38.424653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd15211-e217-4d4c-815f-8769a02fb4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:38.535167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-dbd15211-e217-4d4c-815f-8769a02fb4bb None None] MFA Rules not processed for user `505c7c48b0d14dc9af8006cc7e8eea53`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:38.536331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-dbd15211-e217-4d4c-815f-8769a02fb4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:38.572923 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:38.697513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 680/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:26:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:26:42.845147 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d51f8-dd5a-4df7-9265-9b57eccd2d53 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:42.845694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d51f8-dd5a-4df7-9265-9b57eccd2d53 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:42.845694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d51f8-dd5a-4df7-9265-9b57eccd2d53 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:42.847021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 672/1352] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:42.853282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151ac3a-bf7e-484b-9545-5b04c2d4b4d1 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:42.853732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151ac3a-bf7e-484b-9545-5b04c2d4b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:42.853813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151ac3a-bf7e-484b-9545-5b04c2d4b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:42.938201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2151ac3a-bf7e-484b-9545-5b04c2d4b4d1 None None] MFA Rules not processed for user `505c7c48b0d14dc9af8006cc7e8eea53`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:42.939414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2151ac3a-bf7e-484b-9545-5b04c2d4b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:43.018351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:43.058302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 681/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:26:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:44.301852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda244b-b0e5-4721-aca6-56e4a9705db0 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:44.302492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda244b-b0e5-4721-aca6-56e4a9705db0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:44.302492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda244b-b0e5-4721-aca6-56e4a9705db0 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:44.303698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 673/1354] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:44.308780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71f4c-8891-4a1a-9fd8-c311a3b7d761 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:44.309217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71f4c-8891-4a1a-9fd8-c311a3b7d761 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:44.309450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71f4c-8891-4a1a-9fd8-c311a3b7d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:44.390134 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-91c71f4c-8891-4a1a-9fd8-c311a3b7d761 None None] MFA Rules not processed for user `505c7c48b0d14dc9af8006cc7e8eea53`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:44.391365 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-91c71f4c-8891-4a1a-9fd8-c311a3b7d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:44.495702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 682/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:26:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:48.105572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1919b00-9097-4869-ab9f-26365e66beef None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:48.106494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1919b00-9097-4869-ab9f-26365e66beef None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:48.106776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1919b00-9097-4869-ab9f-26365e66beef None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:48.109779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 674/1356] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:48.115546 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3f047-2b7a-4b89-a521-1d41783a7b10 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:48.116459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3f047-2b7a-4b89-a521-1d41783a7b10 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:48.116962 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3f047-2b7a-4b89-a521-1d41783a7b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:48.163489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:48.198563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a6f3f047-2b7a-4b89-a521-1d41783a7b10 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:48.199871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a6f3f047-2b7a-4b89-a521-1d41783a7b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:48.303989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 683/1357] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:48.599976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57435a-c873-4bd2-a5b7-d43d44129fb6 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:48.600280 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57435a-c873-4bd2-a5b7-d43d44129fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:48.600553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57435a-c873-4bd2-a5b7-d43d44129fb6 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:48.601884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 675/1358] 10.222.0.33 () {54 vars in 961 bytes} [Tue Oct 4 10:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:48.612336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93380f2-d386-43f0-85f3-de4c20125699 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:48.612874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93380f2-d386-43f0-85f3-de4c20125699 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:48.613572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93380f2-d386-43f0-85f3-de4c20125699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:48.711289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c93380f2-d386-43f0-85f3-de4c20125699 None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:48.712581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c93380f2-d386-43f0-85f3-de4c20125699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:48.767454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:48.843036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 684/1359] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Oct 4 10:26:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:48.850848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57435a-c873-4bd2-a5b7-d43d44129fb6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:48.852488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ef57435a-c873-4bd2-a5b7-d43d44129fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:49.026695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57435a-c873-4bd2-a5b7-d43d44129fb6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:49.107384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:49.147401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e952d-f66a-4735-a712-63ad08c482a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:49.148257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e952d-f66a-4735-a712-63ad08c482a0 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:49.148537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e952d-f66a-4735-a712-63ad08c482a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:49.148804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e952d-f66a-4735-a712-63ad08c482a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:49.150678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-083e952d-f66a-4735-a712-63ad08c482a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:49.249442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e952d-f66a-4735-a712-63ad08c482a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:49.251252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e952d-f66a-4735-a712-63ad08c482a0 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:49.271506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 676/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:51.686628 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28189d3-557c-4a40-b335-3b61945f305a None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:51.687166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28189d3-557c-4a40-b335-3b61945f305a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:51.687166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28189d3-557c-4a40-b335-3b61945f305a None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:51.688727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 685/1361] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:51.694170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b3ea2-d9d5-459e-98a4-68c8c2239bd7 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:51.694626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b3ea2-d9d5-459e-98a4-68c8c2239bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:51.694720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b3ea2-d9d5-459e-98a4-68c8c2239bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:51.770232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a08b3ea2-d9d5-459e-98a4-68c8c2239bd7 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:51.771411 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a08b3ea2-d9d5-459e-98a4-68c8c2239bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:51.810537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:51.874499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 677/1362] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:52.167361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28189d3-557c-4a40-b335-3b61945f305a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:52.169448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e28189d3-557c-4a40-b335-3b61945f305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:52.331411 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28189d3-557c-4a40-b335-3b61945f305a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:52.342274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:52.474412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f63b40-3128-43d0-95a3-a53ad81c5d23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:52.475148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f63b40-3128-43d0-95a3-a53ad81c5d23 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:52.475524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f63b40-3128-43d0-95a3-a53ad81c5d23 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:52.476256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f63b40-3128-43d0-95a3-a53ad81c5d23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:52.478162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-93f63b40-3128-43d0-95a3-a53ad81c5d23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:52.587305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f63b40-3128-43d0-95a3-a53ad81c5d23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:52.588986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f63b40-3128-43d0-95a3-a53ad81c5d23 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:52.608130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 686/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:55.173046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed7772-e005-44b9-be6b-232fc2a78c05 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:55.173682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed7772-e005-44b9-be6b-232fc2a78c05 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:55.173682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed7772-e005-44b9-be6b-232fc2a78c05 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:55.174928 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 678/1364] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:55.180332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae3548-8d1b-4973-914d-34c84a56db90 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:55.180719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae3548-8d1b-4973-914d-34c84a56db90 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:55.180909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae3548-8d1b-4973-914d-34c84a56db90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:55.197315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:55.250502 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-66ae3548-8d1b-4973-914d-34c84a56db90 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:55.251700 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-66ae3548-8d1b-4973-914d-34c84a56db90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:55.351342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 687/1365] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:55.640179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2a468-d089-4cbf-9197-00f6e67bd0d8 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:55.640770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2a468-d089-4cbf-9197-00f6e67bd0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:55.641070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2a468-d089-4cbf-9197-00f6e67bd0d8 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:55.642844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 679/1366] 10.222.0.33 () {54 vars in 961 bytes} [Tue Oct 4 10:26:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:55.648716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717712f-5d91-49d3-9183-870660801c4c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:55.649061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717712f-5d91-49d3-9183-870660801c4c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:55.649334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717712f-5d91-49d3-9183-870660801c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:55.728820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7717712f-5d91-49d3-9183-870660801c4c None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:55.730035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7717712f-5d91-49d3-9183-870660801c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:55.765648 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:55.848733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 688/1367] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Oct 4 10:26:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:55.856877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2a468-d089-4cbf-9197-00f6e67bd0d8 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:55.858700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d5d2a468-d089-4cbf-9197-00f6e67bd0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:56.032548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2a468-d089-4cbf-9197-00f6e67bd0d8 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:56.054993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:56.162436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4979ea-04ef-48e9-90e5-043d79e62c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:56.163502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4979ea-04ef-48e9-90e5-043d79e62c09 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:56.163797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4979ea-04ef-48e9-90e5-043d79e62c09 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:56.164097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4979ea-04ef-48e9-90e5-043d79e62c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:56.165707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bf4979ea-04ef-48e9-90e5-043d79e62c09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:56.260749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4979ea-04ef-48e9-90e5-043d79e62c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:56.262410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4979ea-04ef-48e9-90e5-043d79e62c09 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:56.283571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 680/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:56.428611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b6982-8a4b-4dd0-ab73-3256cf2de23b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:56.429092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b6982-8a4b-4dd0-ab73-3256cf2de23b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:56.429204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b6982-8a4b-4dd0-ab73-3256cf2de23b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:56.430493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 689/1369] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:56.436850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f2ab-f9f9-4b14-904f-3440c45ad86c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:56.437257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f2ab-f9f9-4b14-904f-3440c45ad86c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:56.437767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f2ab-f9f9-4b14-904f-3440c45ad86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:56.474763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:56.511355 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-bad8f2ab-f9f9-4b14-904f-3440c45ad86c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:56.512554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bad8f2ab-f9f9-4b14-904f-3440c45ad86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:56.630785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 681/1370] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:26:56.968817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca99fa-66e3-4216-a505-66d29e8872a8 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:56.969157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca99fa-66e3-4216-a505-66d29e8872a8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:56.969487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca99fa-66e3-4216-a505-66d29e8872a8 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:56.971055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 690/1371] 10.222.0.33 () {54 vars in 963 bytes} [Tue Oct 4 10:26:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:56.976080 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f558dd7-32c3-4afa-a905-55917a96dd5b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:56.976471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f558dd7-32c3-4afa-a905-55917a96dd5b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:56.976849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f558dd7-32c3-4afa-a905-55917a96dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:57.061262 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5f558dd7-32c3-4afa-a905-55917a96dd5b None None] MFA Rules not processed for user `2bf4d6e392fd4f8dadb37527f1750fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:57.061727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5f558dd7-32c3-4afa-a905-55917a96dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:57.112885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:57.142986 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 682/1372] 10.222.0.33 () {58 vars in 1060 bytes} [Tue Oct 4 10:26:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:57.150512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca99fa-66e3-4216-a505-66d29e8872a8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:57.152094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-03ca99fa-66e3-4216-a505-66d29e8872a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:57.264174 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca99fa-66e3-4216-a505-66d29e8872a8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:57.314380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:57.353310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5f094-1ffa-4ef3-85e5-05372b1bdc3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:57.353924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f094-1ffa-4ef3-85e5-05372b1bdc3f service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:57.354203 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f094-1ffa-4ef3-85e5-05372b1bdc3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:57.354472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f094-1ffa-4ef3-85e5-05372b1bdc3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:57.356089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-aca5f094-1ffa-4ef3-85e5-05372b1bdc3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:57.480921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5f094-1ffa-4ef3-85e5-05372b1bdc3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:57.482325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5f094-1ffa-4ef3-85e5-05372b1bdc3f service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:57.516146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 691/1373] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:26:58.667129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5119d07-7379-4f0f-8dfc-94f33fa5bd6f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:58.667695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5119d07-7379-4f0f-8dfc-94f33fa5bd6f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:58.667695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5119d07-7379-4f0f-8dfc-94f33fa5bd6f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:58.669022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 683/1374] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:26:58.674224 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9ed87-e94e-43ce-b2a4-3ac3e254fb7f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:58.674697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9ed87-e94e-43ce-b2a4-3ac3e254fb7f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:58.674806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9ed87-e94e-43ce-b2a4-3ac3e254fb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:58.741360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-63a9ed87-e94e-43ce-b2a4-3ac3e254fb7f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:26:58.742550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-63a9ed87-e94e-43ce-b2a4-3ac3e254fb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:58.763258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:58.840175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 692/1375] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:26:59.136262 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5119d07-7379-4f0f-8dfc-94f33fa5bd6f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:26:59.137802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a5119d07-7379-4f0f-8dfc-94f33fa5bd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:59.293555 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5119d07-7379-4f0f-8dfc-94f33fa5bd6f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:26:59.346969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:26:59.408263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e21c26-22ec-414e-b2f9-532ff6859317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:26:59.408868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e21c26-22ec-414e-b2f9-532ff6859317 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:26:59.409137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e21c26-22ec-414e-b2f9-532ff6859317 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:26:59.409404 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e21c26-22ec-414e-b2f9-532ff6859317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:26:59.411019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f6e21c26-22ec-414e-b2f9-532ff6859317 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:26:59.507080 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e21c26-22ec-414e-b2f9-532ff6859317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:26:59.508807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e21c26-22ec-414e-b2f9-532ff6859317 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:26:59.528364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 684/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:01.878174 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13126bcd-3b0e-4a6b-ba0b-8c6a69b6b629 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:01.878745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13126bcd-3b0e-4a6b-ba0b-8c6a69b6b629 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:01.878745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13126bcd-3b0e-4a6b-ba0b-8c6a69b6b629 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:01.880231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 693/1377] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:27:01.885267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63f2e2-ba0b-442c-bc00-69b1849ea263 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:01.885664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63f2e2-ba0b-442c-bc00-69b1849ea263 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:01.885864 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63f2e2-ba0b-442c-bc00-69b1849ea263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:01.964790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-cb63f2e2-ba0b-442c-bc00-69b1849ea263 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:01.966254 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cb63f2e2-ba0b-442c-bc00-69b1849ea263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:01.974940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:02.075989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 685/1378] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:02.361481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13126bcd-3b0e-4a6b-ba0b-8c6a69b6b629 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:02.363149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-13126bcd-3b0e-4a6b-ba0b-8c6a69b6b629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:02.530373 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13126bcd-3b0e-4a6b-ba0b-8c6a69b6b629 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:02.535136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:02.651358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c3986-f82d-4aac-abe7-8b19576130d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:02.651982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c3986-f82d-4aac-abe7-8b19576130d2 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:02.652267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c3986-f82d-4aac-abe7-8b19576130d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:02.652537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c3986-f82d-4aac-abe7-8b19576130d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:02.654109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2f5c3986-f82d-4aac-abe7-8b19576130d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:02.749419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c3986-f82d-4aac-abe7-8b19576130d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:02.751005 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c3986-f82d-4aac-abe7-8b19576130d2 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:02.771030 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 694/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:05.104423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8d07f-5935-493c-b500-768021af0a34 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:05.106082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8d07f-5935-493c-b500-768021af0a34 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:05.106082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8d07f-5935-493c-b500-768021af0a34 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:05.107696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 686/1380] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:05.111538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d3a10-7df6-4a50-8de8-7ce269dbff2e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:05.111923 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d3a10-7df6-4a50-8de8-7ce269dbff2e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:05.112108 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d3a10-7df6-4a50-8de8-7ce269dbff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:05.123370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:05.218435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-db2d3a10-7df6-4a50-8de8-7ce269dbff2e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:05.223054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-db2d3a10-7df6-4a50-8de8-7ce269dbff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:05.340399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 695/1381] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:05.630851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8d07f-5935-493c-b500-768021af0a34 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:05.632921 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-69a8d07f-5935-493c-b500-768021af0a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:05.803453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:05.816026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8d07f-5935-493c-b500-768021af0a34 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:05.947789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb7dc8-0efb-4cb5-97a0-27b9d47d5315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:05.948428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb7dc8-0efb-4cb5-97a0-27b9d47d5315 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:05.948707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb7dc8-0efb-4cb5-97a0-27b9d47d5315 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:05.948981 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb7dc8-0efb-4cb5-97a0-27b9d47d5315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:05.950590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-84eb7dc8-0efb-4cb5-97a0-27b9d47d5315 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:06.055975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb7dc8-0efb-4cb5-97a0-27b9d47d5315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:06.058062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb7dc8-0efb-4cb5-97a0-27b9d47d5315 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:06.070906 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:06.080670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 687/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:08.977165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38444040-73f1-47f2-8dac-26c016ffa6cb None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:08.977895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38444040-73f1-47f2-8dac-26c016ffa6cb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:08.977895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38444040-73f1-47f2-8dac-26c016ffa6cb None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:08.979105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 696/1383] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:08.985265 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba8098-26d2-478c-b382-a56f896e8a7e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:08.996530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba8098-26d2-478c-b382-a56f896e8a7e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:08.996530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba8098-26d2-478c-b382-a56f896e8a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:09.066152 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c2ba8098-26d2-478c-b382-a56f896e8a7e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:09.067680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c2ba8098-26d2-478c-b382-a56f896e8a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:09.191129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 688/1384] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:09.529921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38444040-73f1-47f2-8dac-26c016ffa6cb None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:09.531454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-38444040-73f1-47f2-8dac-26c016ffa6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:09.622597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:09.683377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38444040-73f1-47f2-8dac-26c016ffa6cb None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:09.806845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b5095-17d2-47ff-a04d-58a70aa093e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:09.807374 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b5095-17d2-47ff-a04d-58a70aa093e9 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:09.807656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b5095-17d2-47ff-a04d-58a70aa093e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:09.807928 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b5095-17d2-47ff-a04d-58a70aa093e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:09.809642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ec4b5095-17d2-47ff-a04d-58a70aa093e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:09.861021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:09.908121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b5095-17d2-47ff-a04d-58a70aa093e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:09.909799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b5095-17d2-47ff-a04d-58a70aa093e9 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:09.929771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 697/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:12.112522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878803f-2e1a-45c7-b41a-e2ad654ca038 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:12.113104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878803f-2e1a-45c7-b41a-e2ad654ca038 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:12.113104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878803f-2e1a-45c7-b41a-e2ad654ca038 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:12.114595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 689/1386] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:12.119778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e1808-6cd2-4516-b511-a90a203740e3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:12.120214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e1808-6cd2-4516-b511-a90a203740e3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:12.120352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e1808-6cd2-4516-b511-a90a203740e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:12.186324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7b1e1808-6cd2-4516-b511-a90a203740e3 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:12.187446 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7b1e1808-6cd2-4516-b511-a90a203740e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:12.282959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 698/1387] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:12.572040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878803f-2e1a-45c7-b41a-e2ad654ca038 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:12.573537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4878803f-2e1a-45c7-b41a-e2ad654ca038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:12.650567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:12.721257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878803f-2e1a-45c7-b41a-e2ad654ca038 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:12.834124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6e347-2d5d-402b-97d6-c4382a5d5901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:12.834645 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e347-2d5d-402b-97d6-c4382a5d5901 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:12.834925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e347-2d5d-402b-97d6-c4382a5d5901 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:12.835224 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e347-2d5d-402b-97d6-c4382a5d5901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:12.836887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3ca6e347-2d5d-402b-97d6-c4382a5d5901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:12.875628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:12.934110 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6e347-2d5d-402b-97d6-c4382a5d5901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:12.936438 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6e347-2d5d-402b-97d6-c4382a5d5901 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:12.957704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 690/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:13.055051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc13b0-36f7-4349-a100-8e16f2da8c67 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:13.055399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc13b0-36f7-4349-a100-8e16f2da8c67 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:13.055611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc13b0-36f7-4349-a100-8e16f2da8c67 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:13.057159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 699/1389] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:13.063351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ae17-e84a-4bc4-95bb-7da425f158f7 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:13.066465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ae17-e84a-4bc4-95bb-7da425f158f7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:13.066465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ae17-e84a-4bc4-95bb-7da425f158f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:13.137284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f1a1ae17-e84a-4bc4-95bb-7da425f158f7 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:13.139027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f1a1ae17-e84a-4bc4-95bb-7da425f158f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:13.246844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 691/1390] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:13.549588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87ab15-d369-409a-91c3-6a4f37fdddde None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:13.550054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87ab15-d369-409a-91c3-6a4f37fdddde None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:13.550287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87ab15-d369-409a-91c3-6a4f37fdddde None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:13.551694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 700/1391] 10.222.0.33 () {54 vars in 962 bytes} [Tue Oct 4 10:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:27:13.557206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a8896-9725-4ef1-b03c-3074430e813a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:13.557492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a8896-9725-4ef1-b03c-3074430e813a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:13.557769 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a8896-9725-4ef1-b03c-3074430e813a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:13.574308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:13.635573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-697a8896-9725-4ef1-b03c-3074430e813a None None] MFA Rules not processed for user `6462736c485545d8a26766360ebe0c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:13.636817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-697a8896-9725-4ef1-b03c-3074430e813a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:13.711527 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 692/1392] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Oct 4 10:27:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:13.720885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87ab15-d369-409a-91c3-6a4f37fdddde None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:13.722486 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1f87ab15-d369-409a-91c3-6a4f37fdddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:13.753563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:13.828748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87ab15-d369-409a-91c3-6a4f37fdddde None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:13.905845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382d497-8207-440f-aad2-00f5699252e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6462736c485545d8a26766360ebe0c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:13.906493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382d497-8207-440f-aad2-00f5699252e8 service glance] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:13.906892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382d497-8207-440f-aad2-00f5699252e8 service glance] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:13.907633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382d497-8207-440f-aad2-00f5699252e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:13.909319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9382d497-8207-440f-aad2-00f5699252e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:13.989771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:14.024527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382d497-8207-440f-aad2-00f5699252e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:14.025985 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382d497-8207-440f-aad2-00f5699252e8 service glance] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:14.044942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 701/1393] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:15.076226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa245b-24e2-4b59-90ca-af254517c99a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:15.076749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa245b-24e2-4b59-90ca-af254517c99a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:15.076852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa245b-24e2-4b59-90ca-af254517c99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:15.146572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-22fa245b-24e2-4b59-90ca-af254517c99a None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:15.147786 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-22fa245b-24e2-4b59-90ca-af254517c99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:15.209226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:15.242073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 693/1394] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:27:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:15.285277 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8621-9f8f-4c3a-a650-d3256965fd9d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:15.285786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8621-9f8f-4c3a-a650-d3256965fd9d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:15.285895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8621-9f8f-4c3a-a650-d3256965fd9d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:15.287187 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 702/1395] 10.222.0.33 () {54 vars in 943 bytes} [Tue Oct 4 10:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:15.293502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99592fd2-ddf1-4606-a7b3-7644fc6a28c4 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:15.293783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99592fd2-ddf1-4606-a7b3-7644fc6a28c4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:15.294051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99592fd2-ddf1-4606-a7b3-7644fc6a28c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:15.298254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3c9e7-97ae-49b5-88e6-813e30292485 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:15.298543 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3c9e7-97ae-49b5-88e6-813e30292485 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:15.298821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3c9e7-97ae-49b5-88e6-813e30292485 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:15.300137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 703/1396] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:27:15.305047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808df0ef-6d89-4e75-bf69-8b273257b925 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:15.305330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808df0ef-6d89-4e75-bf69-8b273257b925 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:15.305606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808df0ef-6d89-4e75-bf69-8b273257b925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:15.371033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-808df0ef-6d89-4e75-bf69-8b273257b925 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:15.372256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-808df0ef-6d89-4e75-bf69-8b273257b925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:15.379361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-99592fd2-ddf1-4606-a7b3-7644fc6a28c4 None None] MFA Rules not processed for user `fe9c03800bc6451aa9e5a39ca4ea0bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:15.380564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-99592fd2-ddf1-4606-a7b3-7644fc6a28c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:15.469364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 704/1397] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:27:15.489162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 694/1398] 10.222.0.33 () {58 vars in 1040 bytes} [Tue Oct 4 10:27:15 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:15.499034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808df0ef-6d89-4e75-bf69-8b273257b925 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:15.500271 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-808df0ef-6d89-4e75-bf69-8b273257b925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:15.539226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:15.602920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808df0ef-6d89-4e75-bf69-8b273257b925 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:15.706260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87b30e-2c42-46d5-a4f8-92cc6097bbd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:15.706863 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87b30e-2c42-46d5-a4f8-92cc6097bbd7 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:15.707142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87b30e-2c42-46d5-a4f8-92cc6097bbd7 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:15.707415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87b30e-2c42-46d5-a4f8-92cc6097bbd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:15.709089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ea87b30e-2c42-46d5-a4f8-92cc6097bbd7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:15.762263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99592fd2-ddf1-4606-a7b3-7644fc6a28c4 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:15.763931 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-99592fd2-ddf1-4606-a7b3-7644fc6a28c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:15.766341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:15.794285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87b30e-2c42-46d5-a4f8-92cc6097bbd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:15.796105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:15.796504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87b30e-2c42-46d5-a4f8-92cc6097bbd7 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:15.805103 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 705/1399] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:27:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:27:15.865542 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99592fd2-ddf1-4606-a7b3-7644fc6a28c4 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:15.979148 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f25fac-e156-41ab-8f13-dea1c22f486a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:15.979859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f25fac-e156-41ab-8f13-dea1c22f486a service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:15.980166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f25fac-e156-41ab-8f13-dea1c22f486a service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:15.980433 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f25fac-e156-41ab-8f13-dea1c22f486a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:15.982182 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-04f25fac-e156-41ab-8f13-dea1c22f486a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:16.024023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:16.070538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f25fac-e156-41ab-8f13-dea1c22f486a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:16.072221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f25fac-e156-41ab-8f13-dea1c22f486a service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:16.092624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 695/1400] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:27:18.476384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e12c-af6b-42d2-8d43-6b81f3285088 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:18.476954 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e12c-af6b-42d2-8d43-6b81f3285088 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:18.476954 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e12c-af6b-42d2-8d43-6b81f3285088 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:18.478562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 706/1401] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:18.484516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686a19-c159-4189-9cf5-8f11f9a956f1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:18.484997 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686a19-c159-4189-9cf5-8f11f9a956f1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:18.485104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686a19-c159-4189-9cf5-8f11f9a956f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:18.558609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d6686a19-c159-4189-9cf5-8f11f9a956f1 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:18.559819 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d6686a19-c159-4189-9cf5-8f11f9a956f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:18.680585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 696/1402] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:18.975306 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63e12c-af6b-42d2-8d43-6b81f3285088 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:18.976839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7a63e12c-af6b-42d2-8d43-6b81f3285088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:19.176638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63e12c-af6b-42d2-8d43-6b81f3285088 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:19.249586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:19.328576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20999915-c4f6-46ef-a6bd-9529c20930ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:19.329402 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999915-c4f6-46ef-a6bd-9529c20930ad service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:19.329732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999915-c4f6-46ef-a6bd-9529c20930ad service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:19.330086 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999915-c4f6-46ef-a6bd-9529c20930ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:19.332526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-20999915-c4f6-46ef-a6bd-9529c20930ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:19.455531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20999915-c4f6-46ef-a6bd-9529c20930ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:19.456414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20999915-c4f6-46ef-a6bd-9529c20930ad service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:19.479777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 707/1403] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:22.415276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312a83-f4b9-472f-852b-ca1e469b357a None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:22.416238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312a83-f4b9-472f-852b-ca1e469b357a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:22.416518 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312a83-f4b9-472f-852b-ca1e469b357a None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:22.417882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 697/1404] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:22.424544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7f1aa-0033-4e6c-bd38-1ab6594b7b26 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:22.425454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7f1aa-0033-4e6c-bd38-1ab6594b7b26 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:22.425942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7f1aa-0033-4e6c-bd38-1ab6594b7b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:22.501526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c1d7f1aa-0033-4e6c-bd38-1ab6594b7b26 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:22.502750 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c1d7f1aa-0033-4e6c-bd38-1ab6594b7b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:22.505807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:22.616655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 708/1405] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:22.910812 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312a83-f4b9-472f-852b-ca1e469b357a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:22.914984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7b312a83-f4b9-472f-852b-ca1e469b357a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:22.937912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:23.080936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312a83-f4b9-472f-852b-ca1e469b357a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:23.186174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:23.213425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129f7d7-1162-4d93-8fa2-48860e36482e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:23.214032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129f7d7-1162-4d93-8fa2-48860e36482e service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:23.214310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129f7d7-1162-4d93-8fa2-48860e36482e service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:23.214578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129f7d7-1162-4d93-8fa2-48860e36482e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:23.216717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e129f7d7-1162-4d93-8fa2-48860e36482e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:23.319798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129f7d7-1162-4d93-8fa2-48860e36482e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:23.321431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129f7d7-1162-4d93-8fa2-48860e36482e service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:23.341892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 698/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:25.730737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6258f82-13cb-4214-a824-aaa32e826c6b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:25.731309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6258f82-13cb-4214-a824-aaa32e826c6b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:25.731309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6258f82-13cb-4214-a824-aaa32e826c6b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:25.733449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 709/1407] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:25.738851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ad678-d590-47d6-b745-93709c934c7f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:25.742776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ad678-d590-47d6-b745-93709c934c7f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:25.742776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ad678-d590-47d6-b745-93709c934c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:25.811234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5c9ad678-d590-47d6-b745-93709c934c7f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:25.812488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5c9ad678-d590-47d6-b745-93709c934c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:25.872100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:25.927936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 699/1408] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:26.219609 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6258f82-13cb-4214-a824-aaa32e826c6b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:26.221838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f6258f82-13cb-4214-a824-aaa32e826c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:26.368826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:26.379829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6258f82-13cb-4214-a824-aaa32e826c6b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:26.508192 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb396d93-0e8f-4eea-a75c-d093a5dec7d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:26.508714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396d93-0e8f-4eea-a75c-d093a5dec7d3 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:26.508993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396d93-0e8f-4eea-a75c-d093a5dec7d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:26.509268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396d93-0e8f-4eea-a75c-d093a5dec7d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:26.510878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-eb396d93-0e8f-4eea-a75c-d093a5dec7d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:26.608879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb396d93-0e8f-4eea-a75c-d093a5dec7d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:26.610802 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb396d93-0e8f-4eea-a75c-d093a5dec7d3 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:26.620682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:26.631552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 710/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:35.926540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=19 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:36.655723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:39.944469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97325964-1a45-44ae-b2ff-28b0c2702e32 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:39.945030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97325964-1a45-44ae-b2ff-28b0c2702e32 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:39.945030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97325964-1a45-44ae-b2ff-28b0c2702e32 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:39.946353 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 700/1410] 10.222.0.33 () {54 vars in 918 bytes} [Tue Oct 4 10:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:39.952093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63813c43-be1c-4316-af99-eb4c3046867c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:39.955313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63813c43-be1c-4316-af99-eb4c3046867c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:39.955313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63813c43-be1c-4316-af99-eb4c3046867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:40.028168 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-63813c43-be1c-4316-af99-eb4c3046867c None None] MFA Rules not processed for user `505c7c48b0d14dc9af8006cc7e8eea53`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:40.029392 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-63813c43-be1c-4316-af99-eb4c3046867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:40.134081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 711/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Oct 4 10:27:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:27:40.148206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685936ec-945e-4d66-a37b-eeeffc2aeabb None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:40.148492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685936ec-945e-4d66-a37b-eeeffc2aeabb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:40.148826 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685936ec-945e-4d66-a37b-eeeffc2aeabb None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:40.150208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 701/1412] 10.222.0.33 () {54 vars in 918 bytes} [Tue Oct 4 10:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:40.154785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59751f-52a0-454e-9556-9582351cdfa1 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:40.155067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59751f-52a0-454e-9556-9582351cdfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:40.155342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59751f-52a0-454e-9556-9582351cdfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:40.226579 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:40.229586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8c59751f-52a0-454e-9556-9582351cdfa1 None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:40.230913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8c59751f-52a0-454e-9556-9582351cdfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:40.346029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 712/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Oct 4 10:27:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:42.890172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cf23e-b92c-40d9-8994-f7d888462983 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:42.890744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cf23e-b92c-40d9-8994-f7d888462983 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:42.890744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cf23e-b92c-40d9-8994-f7d888462983 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:42.892207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:42.897522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b506571-c52c-4d83-ac2e-e726a071899c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:42.897933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b506571-c52c-4d83-ac2e-e726a071899c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:42.898049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b506571-c52c-4d83-ac2e-e726a071899c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:42.963567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0b506571-c52c-4d83-ac2e-e726a071899c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:42.964789 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0b506571-c52c-4d83-ac2e-e726a071899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:43.018102 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:43.058883 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:27:43.346134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cf23e-b92c-40d9-8994-f7d888462983 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:43.347660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1c5cf23e-b92c-40d9-8994-f7d888462983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:43.491224 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cf23e-b92c-40d9-8994-f7d888462983 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:43.562149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:43.602313 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe85e2-9056-4aee-bfc0-4c602ad6bdc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:43.602839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe85e2-9056-4aee-bfc0-4c602ad6bdc5 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:43.603111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe85e2-9056-4aee-bfc0-4c602ad6bdc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:43.603376 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe85e2-9056-4aee-bfc0-4c602ad6bdc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:43.604980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4ffe85e2-9056-4aee-bfc0-4c602ad6bdc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:43.692307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe85e2-9056-4aee-bfc0-4c602ad6bdc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:43.693943 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe85e2-9056-4aee-bfc0-4c602ad6bdc5 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:43.712057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 703/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:44.849422 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa7114-e0e1-425a-b292-264773ee02c2 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:44.849991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa7114-e0e1-425a-b292-264773ee02c2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:44.849991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa7114-e0e1-425a-b292-264773ee02c2 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:44.851325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 10:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:44.858092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a74d4-af13-47b6-8738-aaea692feca9 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:44.858506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a74d4-af13-47b6-8738-aaea692feca9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:44.858630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a74d4-af13-47b6-8738-aaea692feca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:44.935524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d04a74d4-af13-47b6-8738-aaea692feca9 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:44.936771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d04a74d4-af13-47b6-8738-aaea692feca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:44.963352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:45.033057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 10:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:45.197879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa7114-e0e1-425a-b292-264773ee02c2 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:45.199675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-68fa7114-e0e1-425a-b292-264773ee02c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:45.349247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa7114-e0e1-425a-b292-264773ee02c2 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:45.388674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:45.458414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23312a42-4860-42c3-8bba-7cce98c64d8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:45.459015 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23312a42-4860-42c3-8bba-7cce98c64d8b service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:45.459290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23312a42-4860-42c3-8bba-7cce98c64d8b service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:45.459558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23312a42-4860-42c3-8bba-7cce98c64d8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:45.461167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-23312a42-4860-42c3-8bba-7cce98c64d8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:45.549784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23312a42-4860-42c3-8bba-7cce98c64d8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:45.551358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23312a42-4860-42c3-8bba-7cce98c64d8b service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:45.568931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 715/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:46.702862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c18331-0b40-463a-affa-d2ab2ab9632d None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:46.703428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c18331-0b40-463a-affa-d2ab2ab9632d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:46.703428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c18331-0b40-463a-affa-d2ab2ab9632d None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:46.704788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 10:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:46.711201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfcd9c-31b2-443d-a942-e6804888bc2d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:46.711617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfcd9c-31b2-443d-a942-e6804888bc2d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:46.711744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfcd9c-31b2-443d-a942-e6804888bc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:46.765721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:46.787821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-cdcfcd9c-31b2-443d-a942-e6804888bc2d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:46.789055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cdcfcd9c-31b2-443d-a942-e6804888bc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:46.884148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 10:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:47.034423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c18331-0b40-463a-affa-d2ab2ab9632d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:47.035890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c7c18331-0b40-463a-affa-d2ab2ab9632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:47.178589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c18331-0b40-463a-affa-d2ab2ab9632d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:47.190927 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:47.290161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4e62-e3e7-4037-a5a9-5a381e1f7633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:47.290658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4e62-e3e7-4037-a5a9-5a381e1f7633 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:47.290930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4e62-e3e7-4037-a5a9-5a381e1f7633 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:47.291196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4e62-e3e7-4037-a5a9-5a381e1f7633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:47.292817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-454c4e62-e3e7-4037-a5a9-5a381e1f7633 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:47.380984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c4e62-e3e7-4037-a5a9-5a381e1f7633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:47.382582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c4e62-e3e7-4037-a5a9-5a381e1f7633 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:47.400092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 706/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:48.502807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f487fc4-bddf-43e7-b1b6-a6edae5142a6 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:48.503354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f487fc4-bddf-43e7-b1b6-a6edae5142a6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:48.503354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f487fc4-bddf-43e7-b1b6-a6edae5142a6 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:48.504744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 10:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:48.511015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d471b-7bda-4ec5-b62b-db1991160025 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:48.511475 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d471b-7bda-4ec5-b62b-db1991160025 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:48.511586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d471b-7bda-4ec5-b62b-db1991160025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:48.530724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:48.587280 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1f7d471b-7bda-4ec5-b62b-db1991160025 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:48.588524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1f7d471b-7bda-4ec5-b62b-db1991160025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:48.683482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 10:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:48.834031 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f487fc4-bddf-43e7-b1b6-a6edae5142a6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:48.835463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0f487fc4-bddf-43e7-b1b6-a6edae5142a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:48.953281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:48.988725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f487fc4-bddf-43e7-b1b6-a6edae5142a6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:49.097185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0cebe-df4b-453a-83ed-9dbbb6c59acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:49.097699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0cebe-df4b-453a-83ed-9dbbb6c59acf service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:49.097971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0cebe-df4b-453a-83ed-9dbbb6c59acf service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:49.098233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0cebe-df4b-453a-83ed-9dbbb6c59acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:49.099801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8dc0cebe-df4b-453a-83ed-9dbbb6c59acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:49.174879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:49.188164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0cebe-df4b-453a-83ed-9dbbb6c59acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:49.189759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0cebe-df4b-453a-83ed-9dbbb6c59acf service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:49.207990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 718/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:50.310819 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd08b44-19f7-4444-8e1d-ccc4ec62bbf4 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:50.311352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd08b44-19f7-4444-8e1d-ccc4ec62bbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:50.311352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd08b44-19f7-4444-8e1d-ccc4ec62bbf4 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:50.312649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 10:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:50.318754 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88fa9e-57c7-43a2-af66-bd4cdce75ae7 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:50.319182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88fa9e-57c7-43a2-af66-bd4cdce75ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:50.319302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88fa9e-57c7-43a2-af66-bd4cdce75ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:50.398761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-cf88fa9e-57c7-43a2-af66-bd4cdce75ae7 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:50.400110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cf88fa9e-57c7-43a2-af66-bd4cdce75ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:50.500235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 10:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:27:50.649269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd08b44-19f7-4444-8e1d-ccc4ec62bbf4 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:50.650797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0dd08b44-19f7-4444-8e1d-ccc4ec62bbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:50.732752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:50.792447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd08b44-19f7-4444-8e1d-ccc4ec62bbf4 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:50.904012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5ed5e-d9b6-4d11-a921-b7d26a582619 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:50.904536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5ed5e-d9b6-4d11-a921-b7d26a582619 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:50.904814 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5ed5e-d9b6-4d11-a921-b7d26a582619 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:50.905077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5ed5e-d9b6-4d11-a921-b7d26a582619 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:50.906658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-20c5ed5e-d9b6-4d11-a921-b7d26a582619 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:50.955277 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:50.995740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5ed5e-d9b6-4d11-a921-b7d26a582619 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:50.997904 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5ed5e-d9b6-4d11-a921-b7d26a582619 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:51.015738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 709/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:52.121186 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a6674-a459-4682-82f8-023a01facf41 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:52.121722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a6674-a459-4682-82f8-023a01facf41 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:52.121843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a6674-a459-4682-82f8-023a01facf41 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:52.123090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 10:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:52.129284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd06f-800a-48f2-ab04-f613fdd423b5 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:52.129677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd06f-800a-48f2-ab04-f613fdd423b5 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:52.129834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd06f-800a-48f2-ab04-f613fdd423b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:52.321146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a29cd06f-800a-48f2-ab04-f613fdd423b5 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:52.322278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a29cd06f-800a-48f2-ab04-f613fdd423b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:52.418085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 10:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:52.566909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a6674-a459-4682-82f8-023a01facf41 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:52.568460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b49a6674-a459-4682-82f8-023a01facf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:52.617114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:52.712257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a6674-a459-4682-82f8-023a01facf41 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:52.820105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6930b-bdf5-443e-b95f-c6856d4a109a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:52.820700 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6930b-bdf5-443e-b95f-c6856d4a109a service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:52.820974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6930b-bdf5-443e-b95f-c6856d4a109a service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:52.821242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6930b-bdf5-443e-b95f-c6856d4a109a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:52.822803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1df6930b-bdf5-443e-b95f-c6856d4a109a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:52.830049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:52.911234 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6930b-bdf5-443e-b95f-c6856d4a109a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:52.912871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6930b-bdf5-443e-b95f-c6856d4a109a service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:52.931675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 721/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:54.054087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc515996-7053-43da-96fc-1e56fbb744a8 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:54.054658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc515996-7053-43da-96fc-1e56fbb744a8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:54.054658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc515996-7053-43da-96fc-1e56fbb744a8 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:54.056045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 10:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:54.062227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3a0f5-b962-4e2a-b7da-92b1d60aeb04 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:54.062637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3a0f5-b962-4e2a-b7da-92b1d60aeb04 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:54.062830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3a0f5-b962-4e2a-b7da-92b1d60aeb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:54.137264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1ce3a0f5-b962-4e2a-b7da-92b1d60aeb04 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:54.138461 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1ce3a0f5-b962-4e2a-b7da-92b1d60aeb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:54.203162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:54.233248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 10:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:54.381513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc515996-7053-43da-96fc-1e56fbb744a8 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:54.383022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cc515996-7053-43da-96fc-1e56fbb744a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:54.403862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:54.528994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc515996-7053-43da-96fc-1e56fbb744a8 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:54.614160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:54.639861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60279a-904d-49a7-8c78-79aa200dbaba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:54.640554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60279a-904d-49a7-8c78-79aa200dbaba service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:54.640843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60279a-904d-49a7-8c78-79aa200dbaba service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:54.641367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60279a-904d-49a7-8c78-79aa200dbaba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:54.643407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9c60279a-904d-49a7-8c78-79aa200dbaba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:54.731874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60279a-904d-49a7-8c78-79aa200dbaba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:54.733470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60279a-904d-49a7-8c78-79aa200dbaba service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:54.751042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 712/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:55.896197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39b37-47d3-445c-8902-1ac2f240e035 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:55.896747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39b37-47d3-445c-8902-1ac2f240e035 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:55.896747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39b37-47d3-445c-8902-1ac2f240e035 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:55.898134 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 10:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:55.904991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f4323-9680-49e8-abe3-c8b92115ac2b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:55.905443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f4323-9680-49e8-abe3-c8b92115ac2b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:55.905539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f4323-9680-49e8-abe3-c8b92115ac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:55.981223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5f1f4323-9680-49e8-abe3-c8b92115ac2b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:55.982415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5f1f4323-9680-49e8-abe3-c8b92115ac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:56.022675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:56.075319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 10:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:27:56.224968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf39b37-47d3-445c-8902-1ac2f240e035 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:56.226425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-baf39b37-47d3-445c-8902-1ac2f240e035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:56.367442 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf39b37-47d3-445c-8902-1ac2f240e035 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:56.421496 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:56.477725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5d1ab-5e01-4532-9af1-1596ca159cae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:56.478260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5d1ab-5e01-4532-9af1-1596ca159cae service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:56.478537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5d1ab-5e01-4532-9af1-1596ca159cae service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:56.478812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5d1ab-5e01-4532-9af1-1596ca159cae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:56.480450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-eff5d1ab-5e01-4532-9af1-1596ca159cae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:56.568299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5d1ab-5e01-4532-9af1-1596ca159cae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:56.569884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5d1ab-5e01-4532-9af1-1596ca159cae service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:56.588016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 724/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:27:57.690283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d47995-e100-4a5f-8506-7fb36c7b3b34 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:57.690831 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d47995-e100-4a5f-8506-7fb36c7b3b34 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:57.690831 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d47995-e100-4a5f-8506-7fb36c7b3b34 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:57.692260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 10:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:27:57.698315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1972ec-858d-43fc-aa6c-cf54781797d9 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:57.698754 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1972ec-858d-43fc-aa6c-cf54781797d9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:57.698861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1972ec-858d-43fc-aa6c-cf54781797d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:57.774347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ac1972ec-858d-43fc-aa6c-cf54781797d9 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:27:57.775551 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ac1972ec-858d-43fc-aa6c-cf54781797d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:57.777589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:57.871364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 10:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:27:58.026911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d47995-e100-4a5f-8506-7fb36c7b3b34 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:27:58.028904 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-58d47995-e100-4a5f-8506-7fb36c7b3b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:58.171159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d47995-e100-4a5f-8506-7fb36c7b3b34 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:27:58.196773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:27:58.282386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd9253-e154-42ec-82b6-f055b441da56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:27:58.282910 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd9253-e154-42ec-82b6-f055b441da56 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:27:58.283216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd9253-e154-42ec-82b6-f055b441da56 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:27:58.283485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd9253-e154-42ec-82b6-f055b441da56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:27:58.285147 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2edd9253-e154-42ec-82b6-f055b441da56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:27:58.372668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd9253-e154-42ec-82b6-f055b441da56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:27:58.374247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd9253-e154-42ec-82b6-f055b441da56 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:27:58.392142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 715/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:00.467326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a5b4-a400-4003-9def-86d3991cc629 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:00.468271 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a5b4-a400-4003-9def-86d3991cc629 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:00.468271 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a5b4-a400-4003-9def-86d3991cc629 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:00.469635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:00.474977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb44a1f-8427-4d09-a157-a2a1d0507410 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:00.475407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb44a1f-8427-4d09-a157-a2a1d0507410 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:00.475509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb44a1f-8427-4d09-a157-a2a1d0507410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:00.516943 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:00.541174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-8cb44a1f-8427-4d09-a157-a2a1d0507410 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:00.542502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8cb44a1f-8427-4d09-a157-a2a1d0507410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:00.636985 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:00.922766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33a5b4-a400-4003-9def-86d3991cc629 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:00.924370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4a33a5b4-a400-4003-9def-86d3991cc629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:01.023082 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33a5b4-a400-4003-9def-86d3991cc629 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:01.054819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:01.095195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b92aaa-7f75-4b24-a23a-71e9a2b82ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:01.095783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b92aaa-7f75-4b24-a23a-71e9a2b82ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:01.096106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b92aaa-7f75-4b24-a23a-71e9a2b82ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:01.096370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b92aaa-7f75-4b24-a23a-71e9a2b82ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:01.097931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-46b92aaa-7f75-4b24-a23a-71e9a2b82ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:01.205943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b92aaa-7f75-4b24-a23a-71e9a2b82ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:01.207321 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b92aaa-7f75-4b24-a23a-71e9a2b82ff6 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:01.225225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 727/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:03.515268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eeace-fae6-4110-92d0-4d3a74763b4f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:03.515848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eeace-fae6-4110-92d0-4d3a74763b4f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:03.515848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eeace-fae6-4110-92d0-4d3a74763b4f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:03.517298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:03.522397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8c011-5570-4342-a1f7-1caea95a0e07 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:03.522825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8c011-5570-4342-a1f7-1caea95a0e07 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:03.522929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8c011-5570-4342-a1f7-1caea95a0e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:03.587501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e5a8c011-5570-4342-a1f7-1caea95a0e07 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:03.588748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e5a8c011-5570-4342-a1f7-1caea95a0e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:03.602259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:03.685457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:03.968051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eeace-fae6-4110-92d0-4d3a74763b4f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:03.969875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-de6eeace-fae6-4110-92d0-4d3a74763b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:04.070702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eeace-fae6-4110-92d0-4d3a74763b4f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:04.083834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:04.143478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225cb53-2c70-49e9-9553-d13bebe46aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:04.144103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225cb53-2c70-49e9-9553-d13bebe46aee service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:04.144376 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225cb53-2c70-49e9-9553-d13bebe46aee service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:04.144638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225cb53-2c70-49e9-9553-d13bebe46aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:04.146191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2225cb53-2c70-49e9-9553-d13bebe46aee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:04.250663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225cb53-2c70-49e9-9553-d13bebe46aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:04.252014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225cb53-2c70-49e9-9553-d13bebe46aee service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:04.271730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 718/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:06.813986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95870d49-9cb8-4179-9880-12f85350f4cb None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:06.814570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95870d49-9cb8-4179-9880-12f85350f4cb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:06.814570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95870d49-9cb8-4179-9880-12f85350f4cb None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:06.815884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:06.821177 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9a1f1-0dec-41dc-bfb8-1490dc08ab73 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:06.821585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9a1f1-0dec-41dc-bfb8-1490dc08ab73 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:06.821696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9a1f1-0dec-41dc-bfb8-1490dc08ab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:06.868700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:06.886336 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-bdc9a1f1-0dec-41dc-bfb8-1490dc08ab73 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:06.887533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bdc9a1f1-0dec-41dc-bfb8-1490dc08ab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:06.983051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:07.262382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95870d49-9cb8-4179-9880-12f85350f4cb None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:07.263975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-95870d49-9cb8-4179-9880-12f85350f4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:07.480908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95870d49-9cb8-4179-9880-12f85350f4cb None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:07.521472 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:07.553058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a404be-ba4f-48ba-aad3-5654f8559264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:07.553650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a404be-ba4f-48ba-aad3-5654f8559264 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:07.553928 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a404be-ba4f-48ba-aad3-5654f8559264 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:07.554197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a404be-ba4f-48ba-aad3-5654f8559264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:07.555773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d8a404be-ba4f-48ba-aad3-5654f8559264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:07.667854 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a404be-ba4f-48ba-aad3-5654f8559264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:07.669293 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a404be-ba4f-48ba-aad3-5654f8559264 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:07.687075 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 730/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:09.946515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a0af6-fda5-45e9-82ff-602c7171ab2c None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:09.947063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a0af6-fda5-45e9-82ff-602c7171ab2c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:09.947063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a0af6-fda5-45e9-82ff-602c7171ab2c None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:09.948449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:09.953794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2ce99-f856-4104-85a1-2bf0fe0f6b92 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:09.954213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2ce99-f856-4104-85a1-2bf0fe0f6b92 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:09.954346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2ce99-f856-4104-85a1-2bf0fe0f6b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:10.021850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-42e2ce99-f856-4104-85a1-2bf0fe0f6b92 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:10.023044 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-42e2ce99-f856-4104-85a1-2bf0fe0f6b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:10.044160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:10.119538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:10.413325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a0af6-fda5-45e9-82ff-602c7171ab2c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:10.414845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-517a0af6-fda5-45e9-82ff-602c7171ab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:10.516567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a0af6-fda5-45e9-82ff-602c7171ab2c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:10.537455 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:10.591199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a6642-aa8e-4650-ab31-2c301cc657db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:10.591804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a6642-aa8e-4650-ab31-2c301cc657db service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:10.592140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a6642-aa8e-4650-ab31-2c301cc657db service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:10.592406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a6642-aa8e-4650-ab31-2c301cc657db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:10.594274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-913a6642-aa8e-4650-ab31-2c301cc657db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:10.700992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a6642-aa8e-4650-ab31-2c301cc657db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:10.702332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a6642-aa8e-4650-ab31-2c301cc657db service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:10.720784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 721/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:12.915940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4a9e3-3262-4782-97c1-ba2883c1fcb4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:12.916485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4a9e3-3262-4782-97c1-ba2883c1fcb4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:12.916593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4a9e3-3262-4782-97c1-ba2883c1fcb4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:12.917874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:12.924064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ae57b-9a89-47d9-8065-8cc2a90b4f70 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:12.924503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ae57b-9a89-47d9-8065-8cc2a90b4f70 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:12.924717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ae57b-9a89-47d9-8065-8cc2a90b4f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:12.997166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:13.000087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b36ae57b-9a89-47d9-8065-8cc2a90b4f70 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:13.001435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b36ae57b-9a89-47d9-8065-8cc2a90b4f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:13.109487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:13.393319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4a9e3-3262-4782-97c1-ba2883c1fcb4 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:13.394850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8cf4a9e3-3262-4782-97c1-ba2883c1fcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:13.505136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4a9e3-3262-4782-97c1-ba2883c1fcb4 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:13.552670 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:13.577589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341fac1-4e3f-47e8-8431-111ba6ba4036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:13.578189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341fac1-4e3f-47e8-8431-111ba6ba4036 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:13.578460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341fac1-4e3f-47e8-8431-111ba6ba4036 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:13.578721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341fac1-4e3f-47e8-8431-111ba6ba4036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:13.580329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e341fac1-4e3f-47e8-8431-111ba6ba4036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:13.687637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341fac1-4e3f-47e8-8431-111ba6ba4036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:13.689044 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341fac1-4e3f-47e8-8431-111ba6ba4036 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:13.707891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 733/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:15.925639 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d83f82-34f5-4562-94e7-b0d64c234756 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:15.926170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d83f82-34f5-4562-94e7-b0d64c234756 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:15.926170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d83f82-34f5-4562-94e7-b0d64c234756 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:15.927537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:15.932884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8e2bd-4833-40bc-b00a-03e816a48c37 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:15.933310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8e2bd-4833-40bc-b00a-03e816a48c37 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:15.933426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8e2bd-4833-40bc-b00a-03e816a48c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:15.998947 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9bf8e2bd-4833-40bc-b00a-03e816a48c37 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:16.000213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9bf8e2bd-4833-40bc-b00a-03e816a48c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:16.028871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:16.095038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:16.380667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d83f82-34f5-4562-94e7-b0d64c234756 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:16.382190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c4d83f82-34f5-4562-94e7-b0d64c234756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:16.484735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d83f82-34f5-4562-94e7-b0d64c234756 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:16.512769 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:16.558342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3a4e8-b9d3-4a7b-8936-f2821408f33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:16.558971 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3a4e8-b9d3-4a7b-8936-f2821408f33d service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:16.559248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3a4e8-b9d3-4a7b-8936-f2821408f33d service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:16.559517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3a4e8-b9d3-4a7b-8936-f2821408f33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:16.561149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-61e3a4e8-b9d3-4a7b-8936-f2821408f33d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:16.666989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3a4e8-b9d3-4a7b-8936-f2821408f33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:16.669008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3a4e8-b9d3-4a7b-8936-f2821408f33d service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:16.686352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 724/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:18.896171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91d2cf-888a-4a42-9657-e2893316be5f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:18.896693 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91d2cf-888a-4a42-9657-e2893316be5f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:18.896787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91d2cf-888a-4a42-9657-e2893316be5f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:18.898256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:18.904174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cc54f-4988-407c-9433-e5fec14fc1ce None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:18.904596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cc54f-4988-407c-9433-e5fec14fc1ce None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:18.904756 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cc54f-4988-407c-9433-e5fec14fc1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:18.971530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-773cc54f-4988-407c-9433-e5fec14fc1ce None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:18.972764 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-773cc54f-4988-407c-9433-e5fec14fc1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:18.981432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:19.066916 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:19.348572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91d2cf-888a-4a42-9657-e2893316be5f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:19.350113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-da91d2cf-888a-4a42-9657-e2893316be5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:19.455592 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91d2cf-888a-4a42-9657-e2893316be5f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:19.512481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:19.530597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feee72e-ce02-4fed-b592-6acfba6db378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:19.531190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feee72e-ce02-4fed-b592-6acfba6db378 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:19.531499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feee72e-ce02-4fed-b592-6acfba6db378 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:19.531805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feee72e-ce02-4fed-b592-6acfba6db378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:19.533411 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9feee72e-ce02-4fed-b592-6acfba6db378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:19.638438 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feee72e-ce02-4fed-b592-6acfba6db378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:19.639902 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feee72e-ce02-4fed-b592-6acfba6db378 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:19.658118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 736/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:21.841942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85188e-3c43-490f-92df-035e39367a60 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:21.842519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85188e-3c43-490f-92df-035e39367a60 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:21.842519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85188e-3c43-490f-92df-035e39367a60 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:21.844096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:21.849428 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a565b2-01e0-4d7e-ac06-ee6ba8b0658a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:21.849868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a565b2-01e0-4d7e-ac06-ee6ba8b0658a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:21.849990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a565b2-01e0-4d7e-ac06-ee6ba8b0658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:21.915616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-55a565b2-01e0-4d7e-ac06-ee6ba8b0658a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:21.916846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-55a565b2-01e0-4d7e-ac06-ee6ba8b0658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:21.954115 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:22.010640 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:22.294503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85188e-3c43-490f-92df-035e39367a60 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:22.296126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6f85188e-3c43-490f-92df-035e39367a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:22.397004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85188e-3c43-490f-92df-035e39367a60 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:22.434169 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:22.470794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7b931-a542-4587-9f8c-26f491a43d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:22.471388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7b931-a542-4587-9f8c-26f491a43d6c service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:22.471659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7b931-a542-4587-9f8c-26f491a43d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:22.471923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7b931-a542-4587-9f8c-26f491a43d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:22.473532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cbd7b931-a542-4587-9f8c-26f491a43d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:22.582071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7b931-a542-4587-9f8c-26f491a43d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:22.583450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7b931-a542-4587-9f8c-26f491a43d6c service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:22.601591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 727/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:24.780098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433020d2-d93f-4c44-b3ae-fd316f524267 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:24.780679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433020d2-d93f-4c44-b3ae-fd316f524267 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:24.780679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433020d2-d93f-4c44-b3ae-fd316f524267 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:24.781987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:24.787413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af332101-d68c-4c4d-90ab-1d6206dd683c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:24.787807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af332101-d68c-4c4d-90ab-1d6206dd683c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:24.787968 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af332101-d68c-4c4d-90ab-1d6206dd683c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:24.852526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-af332101-d68c-4c4d-90ab-1d6206dd683c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:24.853722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-af332101-d68c-4c4d-90ab-1d6206dd683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:24.872016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:24.951045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:25.235308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433020d2-d93f-4c44-b3ae-fd316f524267 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:25.236966 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-433020d2-d93f-4c44-b3ae-fd316f524267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:25.339337 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433020d2-d93f-4c44-b3ae-fd316f524267 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:25.407491 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:25.413688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b4d92-9ee4-4b90-8231-79c20f07cd24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:25.414319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b4d92-9ee4-4b90-8231-79c20f07cd24 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:25.414595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b4d92-9ee4-4b90-8231-79c20f07cd24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:25.414865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b4d92-9ee4-4b90-8231-79c20f07cd24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:25.416495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b06b4d92-9ee4-4b90-8231-79c20f07cd24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:25.522915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b4d92-9ee4-4b90-8231-79c20f07cd24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:25.524404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b4d92-9ee4-4b90-8231-79c20f07cd24 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:25.541746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 739/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:27.755329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb89687-8ca1-458b-b2d2-731d5d1919ae None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:27.755911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb89687-8ca1-458b-b2d2-731d5d1919ae None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:27.755911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb89687-8ca1-458b-b2d2-731d5d1919ae None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:27.757233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:27.763237 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b1b04-b642-4dee-92e6-8658684d2f96 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:27.763669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b1b04-b642-4dee-92e6-8658684d2f96 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:27.763781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b1b04-b642-4dee-92e6-8658684d2f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:27.828077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0c3b1b04-b642-4dee-92e6-8658684d2f96 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:27.829276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0c3b1b04-b642-4dee-92e6-8658684d2f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:27.876988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:27.925071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:28.206757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb89687-8ca1-458b-b2d2-731d5d1919ae None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:28.208337 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dbb89687-8ca1-458b-b2d2-731d5d1919ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:28.309347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb89687-8ca1-458b-b2d2-731d5d1919ae None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:28.356173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:28.380464 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef4812-2a9d-4556-ba9d-7eaf699440f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:28.381062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef4812-2a9d-4556-ba9d-7eaf699440f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:28.381337 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef4812-2a9d-4556-ba9d-7eaf699440f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:28.381605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef4812-2a9d-4556-ba9d-7eaf699440f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:28.383186 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-89ef4812-2a9d-4556-ba9d-7eaf699440f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:28.489730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef4812-2a9d-4556-ba9d-7eaf699440f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:28.491081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef4812-2a9d-4556-ba9d-7eaf699440f1 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:28.510307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 730/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:28:38.144155 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=22 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:38.508088 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=66 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:48.443465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c566b3-6412-43f2-b743-88213b4142b8 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:48.444109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c566b3-6412-43f2-b743-88213b4142b8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:48.444109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c566b3-6412-43f2-b743-88213b4142b8 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:48.445406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 741/1471] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:48.450717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd941-72d8-4719-965d-e61e4f1fe120 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:48.451156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd941-72d8-4719-965d-e61e4f1fe120 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:48.451260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd941-72d8-4719-965d-e61e4f1fe120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:48.516668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b6ebd941-72d8-4719-965d-e61e4f1fe120 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:48.517914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b6ebd941-72d8-4719-965d-e61e4f1fe120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:48.613972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 731/1472] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:48.913818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cec5b-3eba-4b99-8278-836774563b9b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:48.913818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cec5b-3eba-4b99-8278-836774563b9b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:48.913818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cec5b-3eba-4b99-8278-836774563b9b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:48.913818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 742/1473] 10.222.0.33 () {54 vars in 962 bytes} [Tue Oct 4 10:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:48.918652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c960c26-621e-4527-b4bd-dd9c422e155f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:48.923323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c960c26-621e-4527-b4bd-dd9c422e155f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:48.923323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c960c26-621e-4527-b4bd-dd9c422e155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:48.994363 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5c960c26-621e-4527-b4bd-dd9c422e155f None None] MFA Rules not processed for user `6462736c485545d8a26766360ebe0c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:48.995234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5c960c26-621e-4527-b4bd-dd9c422e155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:49.015956 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:49.070531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 732/1474] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Oct 4 10:28:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:49.078210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cec5b-3eba-4b99-8278-836774563b9b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:49.079746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b23cec5b-3eba-4b99-8278-836774563b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:49.181748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cec5b-3eba-4b99-8278-836774563b9b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:49.254909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c42b2f-af01-4e55-aa90-a87794ea72fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6462736c485545d8a26766360ebe0c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:49.255503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c42b2f-af01-4e55-aa90-a87794ea72fb service glance] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:49.255778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c42b2f-af01-4e55-aa90-a87794ea72fb service glance] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:49.256073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c42b2f-af01-4e55-aa90-a87794ea72fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:49.257645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-96c42b2f-af01-4e55-aa90-a87794ea72fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:49.310437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:49.368804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c42b2f-af01-4e55-aa90-a87794ea72fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:49.370218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c42b2f-af01-4e55-aa90-a87794ea72fb service glance] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:49.388692 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 743/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:51.641384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a87c2a-e21d-41b6-8ed5-c18e28b6e883 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:51.641974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a87c2a-e21d-41b6-8ed5-c18e28b6e883 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:51.642088 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a87c2a-e21d-41b6-8ed5-c18e28b6e883 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:51.643386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 733/1476] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:51.649092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90630d-aa63-4ca4-ba0f-65c965267821 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:51.649519 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90630d-aa63-4ca4-ba0f-65c965267821 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:51.649630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90630d-aa63-4ca4-ba0f-65c965267821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:51.714740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-cc90630d-aa63-4ca4-ba0f-65c965267821 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:51.715955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cc90630d-aa63-4ca4-ba0f-65c965267821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:51.810049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 744/1477] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:52.081190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a87c2a-e21d-41b6-8ed5-c18e28b6e883 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:52.082784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-92a87c2a-e21d-41b6-8ed5-c18e28b6e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:52.205667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a87c2a-e21d-41b6-8ed5-c18e28b6e883 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:52.254702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:52.298783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42184c-8993-4a1b-bae9-6d81ccbda63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:52.299656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42184c-8993-4a1b-bae9-6d81ccbda63c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:52.299933 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42184c-8993-4a1b-bae9-6d81ccbda63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:52.300241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42184c-8993-4a1b-bae9-6d81ccbda63c admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:52.300876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42184c-8993-4a1b-bae9-6d81ccbda63c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:52.302592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: WARNING py.warnings [None req-cd42184c-8993-4a1b-bae9-6d81ccbda63c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:28:52.302592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: warnings.warn(msg) Oct 04 10:28:52.302592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: Oct 04 10:28:52.303731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42184c-8993-4a1b-bae9-6d81ccbda63c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:52.322264 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 734/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 10:28:52 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:28:54.485686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783d40f-4bf1-4f7c-8880-4ba1bec60368 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:54.486273 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783d40f-4bf1-4f7c-8880-4ba1bec60368 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:54.486273 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783d40f-4bf1-4f7c-8880-4ba1bec60368 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:54.487605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 745/1479] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:28:54.492998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d7a74-e920-4df9-850f-16161b94a6dd None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:54.497533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d7a74-e920-4df9-850f-16161b94a6dd None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:54.497533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d7a74-e920-4df9-850f-16161b94a6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:54.560319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-996d7a74-e920-4df9-850f-16161b94a6dd None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:54.561527 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-996d7a74-e920-4df9-850f-16161b94a6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:54.655504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 735/1480] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:54.945768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783d40f-4bf1-4f7c-8880-4ba1bec60368 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:54.947266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6783d40f-4bf1-4f7c-8880-4ba1bec60368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:54.957007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:55.091135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783d40f-4bf1-4f7c-8880-4ba1bec60368 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:55.168717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:55.200584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c666fb5-4a58-4cf3-9f4a-64eab67748da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:55.201191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c666fb5-4a58-4cf3-9f4a-64eab67748da service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:55.201484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c666fb5-4a58-4cf3-9f4a-64eab67748da service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:55.201753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c666fb5-4a58-4cf3-9f4a-64eab67748da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:55.203337 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7c666fb5-4a58-4cf3-9f4a-64eab67748da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:55.289937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c666fb5-4a58-4cf3-9f4a-64eab67748da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:55.291493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c666fb5-4a58-4cf3-9f4a-64eab67748da service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:55.309995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 746/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:28:57.629322 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903cfe8-e713-4164-9cb3-be1110717f90 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:57.629865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903cfe8-e713-4164-9cb3-be1110717f90 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:57.629865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903cfe8-e713-4164-9cb3-be1110717f90 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:57.631179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 736/1482] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:28:57.636935 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ebd2c-f124-4039-aceb-c00fb2cdb5f9 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:57.637388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ebd2c-f124-4039-aceb-c00fb2cdb5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:57.637498 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ebd2c-f124-4039-aceb-c00fb2cdb5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:57.706820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5e5ebd2c-f124-4039-aceb-c00fb2cdb5f9 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:28:57.708052 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5e5ebd2c-f124-4039-aceb-c00fb2cdb5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:57.756481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:57.804995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 747/1483] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:28:58.090988 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903cfe8-e713-4164-9cb3-be1110717f90 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:28:58.092588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c903cfe8-e713-4164-9cb3-be1110717f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:58.116495 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:58.193847 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903cfe8-e713-4164-9cb3-be1110717f90 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:28:58.267074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706db74c-0a68-4585-b939-3057abfc530b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:28:58.267673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db74c-0a68-4585-b939-3057abfc530b service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:28:58.267972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db74c-0a68-4585-b939-3057abfc530b service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:28:58.268247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db74c-0a68-4585-b939-3057abfc530b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:28:58.269834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-706db74c-0a68-4585-b939-3057abfc530b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:28:58.342666 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:28:58.377479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706db74c-0a68-4585-b939-3057abfc530b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:28:58.378892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706db74c-0a68-4585-b939-3057abfc530b service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:28:58.396892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 737/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:29:00.577605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c9b7-4ff8-4365-ad64-8835ff9f5379 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:29:00.578170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c9b7-4ff8-4365-ad64-8835ff9f5379 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:29:00.578170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c9b7-4ff8-4365-ad64-8835ff9f5379 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:29:00.579477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 748/1485] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:29:00.584782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff7b0c-5ea7-413d-96ae-5841402f0698 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:29:00.585205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff7b0c-5ea7-413d-96ae-5841402f0698 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:29:00.585303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff7b0c-5ea7-413d-96ae-5841402f0698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:29:00.650098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a1ff7b0c-5ea7-413d-96ae-5841402f0698 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:29:00.651283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a1ff7b0c-5ea7-413d-96ae-5841402f0698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:29:00.744994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 738/1486] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:29:01.034881 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c9b7-4ff8-4365-ad64-8835ff9f5379 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:29:01.036466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5893c9b7-4ff8-4365-ad64-8835ff9f5379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:29:01.137905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c9b7-4ff8-4365-ad64-8835ff9f5379 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:29:01.212068 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:29:01.213464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27e811-4171-48e5-93e0-e6d121eb4b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:29:01.214061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27e811-4171-48e5-93e0-e6d121eb4b58 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:29:01.214334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27e811-4171-48e5-93e0-e6d121eb4b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:29:01.214601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27e811-4171-48e5-93e0-e6d121eb4b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:29:01.216215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2b27e811-4171-48e5-93e0-e6d121eb4b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:29:01.321579 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27e811-4171-48e5-93e0-e6d121eb4b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:29:01.322977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27e811-4171-48e5-93e0-e6d121eb4b58 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:29:01.340653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 749/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:29:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:29:03.638934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb9942-dc89-47bf-a360-4978e6f7bc60 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:29:03.639537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb9942-dc89-47bf-a360-4978e6f7bc60 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:29:03.639537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb9942-dc89-47bf-a360-4978e6f7bc60 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:29:03.640854 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 739/1488] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:29:03.646238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4bbd5-4429-4dae-8e22-880b7f5b0332 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:29:03.646644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4bbd5-4429-4dae-8e22-880b7f5b0332 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:29:03.646795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4bbd5-4429-4dae-8e22-880b7f5b0332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:29:03.711457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-41d4bbd5-4429-4dae-8e22-880b7f5b0332 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:29:03.712805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-41d4bbd5-4429-4dae-8e22-880b7f5b0332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:29:03.764927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:29:03.807793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 750/1489] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:29:04.099031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb9942-dc89-47bf-a360-4978e6f7bc60 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:29:04.100686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-eedb9942-dc89-47bf-a360-4978e6f7bc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:29:04.137400 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:29:04.203199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb9942-dc89-47bf-a360-4978e6f7bc60 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:29:04.274630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200cf4f-cb46-4995-8ae4-600ccef7eea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:29:04.275254 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200cf4f-cb46-4995-8ae4-600ccef7eea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:29:04.275530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200cf4f-cb46-4995-8ae4-600ccef7eea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:29:04.275792 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200cf4f-cb46-4995-8ae4-600ccef7eea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:29:04.278055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a200cf4f-cb46-4995-8ae4-600ccef7eea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:29:04.357705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:29:04.385378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200cf4f-cb46-4995-8ae4-600ccef7eea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:29:04.387674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200cf4f-cb46-4995-8ae4-600ccef7eea1 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:29:04.405982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 740/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:29:06.996562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30de33-54aa-4cc1-ba08-eb2442702be5 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:29:06.997111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30de33-54aa-4cc1-ba08-eb2442702be5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:29:06.997111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30de33-54aa-4cc1-ba08-eb2442702be5 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:29:06.998450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 751/1491] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 10:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:29:07.003884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f3d1-ebef-4d88-8cf9-ec69a0b2f0f3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:29:07.004340 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f3d1-ebef-4d88-8cf9-ec69a0b2f0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:29:07.004492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f3d1-ebef-4d88-8cf9-ec69a0b2f0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:29:07.070133 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e088f3d1-ebef-4d88-8cf9-ec69a0b2f0f3 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:29:07.071367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e088f3d1-ebef-4d88-8cf9-ec69a0b2f0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:29:07.166245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 741/1492] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 10:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:29:07.452948 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30de33-54aa-4cc1-ba08-eb2442702be5 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:29:07.454544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ef30de33-54aa-4cc1-ba08-eb2442702be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:29:07.558304 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30de33-54aa-4cc1-ba08-eb2442702be5 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:29:07.631443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256cfc4-8d16-4d49-9ac0-9dbafed28321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:29:07.632065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256cfc4-8d16-4d49-9ac0-9dbafed28321 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:29:07.632342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256cfc4-8d16-4d49-9ac0-9dbafed28321 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:29:07.632607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256cfc4-8d16-4d49-9ac0-9dbafed28321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:29:07.634189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7256cfc4-8d16-4d49-9ac0-9dbafed28321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:29:07.643221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:29:07.739583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256cfc4-8d16-4d49-9ac0-9dbafed28321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:29:07.740946 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256cfc4-8d16-4d49-9ac0-9dbafed28321 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:29:07.759637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 752/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:29:17.164685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=82 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:29:17.757286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=50 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:30:52.287874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff5c5e-22e1-43d4-9da6-413d039cbe9c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:52.288469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff5c5e-22e1-43d4-9da6-413d039cbe9c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:52.288469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff5c5e-22e1-43d4-9da6-413d039cbe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:52.366812 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-31ff5c5e-22e1-43d4-9da6-413d039cbe9c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:30:52.368048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-31ff5c5e-22e1-43d4-9da6-413d039cbe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:30:52.470296 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 742/1494] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:30:52.478401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b162c74-0fcb-4123-9ef7-c6408cd94de4 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:52.480261 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b162c74-0fcb-4123-9ef7-c6408cd94de4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:52.480261 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b162c74-0fcb-4123-9ef7-c6408cd94de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:52.498505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0b162c74-0fcb-4123-9ef7-c6408cd94de4 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:30:52.499690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0b162c74-0fcb-4123-9ef7-c6408cd94de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:30:52.508065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 753/1495] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:30:52.512640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff5c5e-22e1-43d4-9da6-413d039cbe9c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:30:52.522698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff5c5e-22e1-43d4-9da6-413d039cbe9c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:30:52.527263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799986a-9681-414c-96e2-829228d568a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:30:52.527856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799986a-9681-414c-96e2-829228d568a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:52.528171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799986a-9681-414c-96e2-829228d568a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:52.528444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799986a-9681-414c-96e2-829228d568a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:52.529081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799986a-9681-414c-96e2-829228d568a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:30:52.529442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799986a-9681-414c-96e2-829228d568a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:30:52.531047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: WARNING py.warnings [None req-d799986a-9681-414c-96e2-829228d568a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:30:52.531047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: warnings.warn(msg) Oct 04 10:30:52.531047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: Oct 04 10:30:52.531922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799986a-9681-414c-96e2-829228d568a8 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:30:52.543225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 743/1496] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:30:52.553151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b162c74-0fcb-4123-9ef7-c6408cd94de4 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:30:52.562175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b162c74-0fcb-4123-9ef7-c6408cd94de4 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:30:52.566752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af29c36-59d1-42be-bcd6-cf47243276cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:30:52.567333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af29c36-59d1-42be-bcd6-cf47243276cc admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:52.567608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af29c36-59d1-42be-bcd6-cf47243276cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:52.567876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af29c36-59d1-42be-bcd6-cf47243276cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:52.568536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af29c36-59d1-42be-bcd6-cf47243276cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:30:52.570293 dv-cinder-859193-3-smb devstack@keystone.service[81577]: WARNING py.warnings [None req-0af29c36-59d1-42be-bcd6-cf47243276cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:30:52.570293 dv-cinder-859193-3-smb devstack@keystone.service[81577]: warnings.warn(msg) Oct 04 10:30:52.570293 dv-cinder-859193-3-smb devstack@keystone.service[81577]: Oct 04 10:30:52.571502 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af29c36-59d1-42be-bcd6-cf47243276cc admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:30:52.677496 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 754/1497] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:30:52 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:30:52.681666 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799986a-9681-414c-96e2-829228d568a8 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:30:52.691444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799986a-9681-414c-96e2-829228d568a8 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:30:52.740306 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:30:52.747193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9692-e5bd-4adf-8bf8-22b1fcb010c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:30:52.747782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9692-e5bd-4adf-8bf8-22b1fcb010c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:52.748081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9692-e5bd-4adf-8bf8-22b1fcb010c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:52.748876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9692-e5bd-4adf-8bf8-22b1fcb010c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:52.749486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e9692-e5bd-4adf-8bf8-22b1fcb010c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:30:52.750483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: WARNING py.warnings [None req-b22e9692-e5bd-4adf-8bf8-22b1fcb010c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:30:52.750483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: warnings.warn(msg) Oct 04 10:30:52.750483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: Oct 04 10:30:52.751670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e9692-e5bd-4adf-8bf8-22b1fcb010c8 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:30:52.843703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 744/1498] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:30:52 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:30:52.845821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af29c36-59d1-42be-bcd6-cf47243276cc admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:30:52.856149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af29c36-59d1-42be-bcd6-cf47243276cc admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:30:52.860774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de7f6-c193-486b-8e4a-bc37c06f5021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:30:52.861356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de7f6-c193-486b-8e4a-bc37c06f5021 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:52.864020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de7f6-c193-486b-8e4a-bc37c06f5021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:52.864020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de7f6-c193-486b-8e4a-bc37c06f5021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:52.864020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271de7f6-c193-486b-8e4a-bc37c06f5021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:30:52.864020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: WARNING py.warnings [None req-271de7f6-c193-486b-8e4a-bc37c06f5021 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:30:52.864020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: warnings.warn(msg) Oct 04 10:30:52.864020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: Oct 04 10:30:52.864559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271de7f6-c193-486b-8e4a-bc37c06f5021 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:30:52.877138 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 755/1499] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:30:52.880869 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9692-e5bd-4adf-8bf8-22b1fcb010c8 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:30:52.891849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9692-e5bd-4adf-8bf8-22b1fcb010c8 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:30:52.896465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382d254-90a4-46ff-b01a-d12a2e7f3ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:30:52.897056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382d254-90a4-46ff-b01a-d12a2e7f3ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:52.897334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382d254-90a4-46ff-b01a-d12a2e7f3ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:52.897603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382d254-90a4-46ff-b01a-d12a2e7f3ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:52.898245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382d254-90a4-46ff-b01a-d12a2e7f3ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:30:52.899241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: WARNING py.warnings [None req-0382d254-90a4-46ff-b01a-d12a2e7f3ce2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:30:52.899241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: warnings.warn(msg) Oct 04 10:30:52.899241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: Oct 04 10:30:52.900139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382d254-90a4-46ff-b01a-d12a2e7f3ce2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:30:52.913628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 745/1500] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:30:52.917758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de7f6-c193-486b-8e4a-bc37c06f5021 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:30:52.927412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de7f6-c193-486b-8e4a-bc37c06f5021 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:30:52.932037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ee659-7fd1-4750-8a54-55e6b0258ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:30:52.932672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ee659-7fd1-4750-8a54-55e6b0258ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:52.932948 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ee659-7fd1-4750-8a54-55e6b0258ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:52.933218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ee659-7fd1-4750-8a54-55e6b0258ec3 admin admin] PATH_INFO: `/v3/projects/cdc0aee1444d4d66a9c962d757bb2983/users/e24b4f0091bb4a4fb5177b979bc701d8/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:52.947879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ee659-7fd1-4750-8a54-55e6b0258ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc0aee1444d4d66a9c962d757bb2983, user_id=e24b4f0091bb4a4fb5177b979bc701d8, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:30:52.948941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: WARNING py.warnings [None req-136ee659-7fd1-4750-8a54-55e6b0258ec3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:30:52.948941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: warnings.warn(msg) Oct 04 10:30:52.948941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: Oct 04 10:30:52.950828 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ee659-7fd1-4750-8a54-55e6b0258ec3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:30:53.012564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 756/1501] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:30:52 2022] PUT /identity/v3/projects/cdc0aee1444d4d66a9c962d757bb2983/users/e24b4f0091bb4a4fb5177b979bc701d8/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:30:53.025334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b02f4-aa27-402e-b6ba-b1fb2f09eb6f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:53.025616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b02f4-aa27-402e-b6ba-b1fb2f09eb6f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:53.025890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b02f4-aa27-402e-b6ba-b1fb2f09eb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:53.053159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9b0b02f4-aa27-402e-b6ba-b1fb2f09eb6f None None] MFA Rules not processed for user `e24b4f0091bb4a4fb5177b979bc701d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:30:53.054361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9b0b02f4-aa27-402e-b6ba-b1fb2f09eb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:30:53.116989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 746/1502] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:30:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:30:53.130591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52854f-3494-4979-bed8-412c51d3b891 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:53.130872 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52854f-3494-4979-bed8-412c51d3b891 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:53.131140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52854f-3494-4979-bed8-412c51d3b891 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:53.132506 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 757/1503] 10.222.0.33 () {54 vars in 963 bytes} [Tue Oct 4 10:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:30:53.137230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc455ed-0267-4f7d-b881-03cb30c0dc83 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:53.137511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc455ed-0267-4f7d-b881-03cb30c0dc83 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:53.137781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc455ed-0267-4f7d-b881-03cb30c0dc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:53.196386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4bc455ed-0267-4f7d-b881-03cb30c0dc83 None None] MFA Rules not processed for user `2bf4d6e392fd4f8dadb37527f1750fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:30:53.197567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4bc455ed-0267-4f7d-b881-03cb30c0dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:30:53.271172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 747/1504] 10.222.0.33 () {58 vars in 1060 bytes} [Tue Oct 4 10:30:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:30:53.278962 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52854f-3494-4979-bed8-412c51d3b891 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:30:53.289280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52854f-3494-4979-bed8-412c51d3b891 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:30:53.292953 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56693f08-a62e-46a3-a2fb-ca57842a315a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:30:53.293536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56693f08-a62e-46a3-a2fb-ca57842a315a service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:53.293811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56693f08-a62e-46a3-a2fb-ca57842a315a service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:53.294106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56693f08-a62e-46a3-a2fb-ca57842a315a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:53.302819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56693f08-a62e-46a3-a2fb-ca57842a315a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:30:53.304236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56693f08-a62e-46a3-a2fb-ca57842a315a service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:30:53.315287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 758/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:30:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:30:53.359582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e4a7-792d-44ac-a8b7-07af03ad9cbd None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:53.360015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e4a7-792d-44ac-a8b7-07af03ad9cbd None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:53.360154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e4a7-792d-44ac-a8b7-07af03ad9cbd None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:53.361397 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 748/1506] 10.222.0.33 () {52 vars in 830 bytes} [Tue Oct 4 10:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:30:53.364806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56693f08-a62e-46a3-a2fb-ca57842a315a service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:30:53.424722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56693f08-a62e-46a3-a2fb-ca57842a315a service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:30:53.429237 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:30:53.429844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:53.430120 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:53.430388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] PATH_INFO: `/v3/users/e24b4f0091bb4a4fb5177b979bc701d8` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:53.431503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24b4f0091bb4a4fb5177b979bc701d8)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:30:53.432522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: WARNING py.warnings [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:30:53.432522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: warnings.warn(msg) Oct 04 10:30:53.432522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: Oct 04 10:30:53.433699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:30:53.664358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24b4f0091bb4a4fb5177b979bc701d8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:30:53.680035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24b4f0091bb4a4fb5177b979bc701d8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:30:53.680035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24b4f0091bb4a4fb5177b979bc701d8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:30:53.680035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24b4f0091bb4a4fb5177b979bc701d8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:30:53.755729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24b4f0091bb4a4fb5177b979bc701d8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:30:53.777938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:30:53.788068 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 759/1507] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:30:53 2022] DELETE /identity/v3/users/e24b4f0091bb4a4fb5177b979bc701d8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:30:53.792524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a8819-f170-4729-bda9-cdf2f083ef34 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:53.798033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a8819-f170-4729-bda9-cdf2f083ef34 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:53.798033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a8819-f170-4729-bda9-cdf2f083ef34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:53.812181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5f8a8819-f170-4729-bda9-cdf2f083ef34 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:30:53.813360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5f8a8819-f170-4729-bda9-cdf2f083ef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:30:53.823846 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:30:53.872743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 749/1508] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:30:53.883795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:30:53.885253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:30:53.963110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6c1fa-700e-4fe7-afd1-e5ae380ff390 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:30:53.966625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd45117-e4d9-4ee2-a3d2-f7c187e0c922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:30:53.967805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd45117-e4d9-4ee2-a3d2-f7c187e0c922 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:53.968106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd45117-e4d9-4ee2-a3d2-f7c187e0c922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:53.968372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd45117-e4d9-4ee2-a3d2-f7c187e0c922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:53.977464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd45117-e4d9-4ee2-a3d2-f7c187e0c922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:30:53.978866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd45117-e4d9-4ee2-a3d2-f7c187e0c922 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:30:53.988024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 760/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:30:54.494784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a8819-f170-4729-bda9-cdf2f083ef34 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:30:54.496279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5f8a8819-f170-4729-bda9-cdf2f083ef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:30:54.509195 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a8819-f170-4729-bda9-cdf2f083ef34 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:30:54.515370 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:30:54.516104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:30:54.516388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:30:54.516659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] PATH_INFO: `/v3/projects/cdc0aee1444d4d66a9c962d757bb2983` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:30:54.517874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc0aee1444d4d66a9c962d757bb2983)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:30:54.519727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: WARNING py.warnings [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:30:54.519727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: warnings.warn(msg) Oct 04 10:30:54.519727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: Oct 04 10:30:54.521122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:30:54.631720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc0aee1444d4d66a9c962d757bb2983', 'request_id': 'req-2a03a71b-90c8-4b09-8076-05a455b092a5'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:30:54.638884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc0aee1444d4d66a9c962d757bb2983', 'request_id': 'req-2a03a71b-90c8-4b09-8076-05a455b092a5'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:30:54.653127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc0aee1444d4d66a9c962d757bb2983', 'request_id': 'req-2a03a71b-90c8-4b09-8076-05a455b092a5'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:30:54.776453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] The token cache is being invalidate because project cdc0aee1444d4d66a9c962d757bb2983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:30:54.776712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:30:54.777338 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-2a03a71b-90c8-4b09-8076-05a455b092a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:30:54.778940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 750/1510] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:30:54 2022] DELETE /identity/v3/projects/cdc0aee1444d4d66a9c962d757bb2983 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:31:03.983974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:31:04.772811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:32:28.631604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4aa94-04a9-46af-b5bf-bb8c2124cf88 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:28.632235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4aa94-04a9-46af-b5bf-bb8c2124cf88 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:28.632235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4aa94-04a9-46af-b5bf-bb8c2124cf88 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:28.633508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 10:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:32:28.638253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15af1ca-2022-4381-ba4f-87e7f23825ff None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:28.638664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15af1ca-2022-4381-ba4f-87e7f23825ff None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:28.638793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15af1ca-2022-4381-ba4f-87e7f23825ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:28.658174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e15af1ca-2022-4381-ba4f-87e7f23825ff None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:32:28.659359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e15af1ca-2022-4381-ba4f-87e7f23825ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:28.716989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 10:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:32:28.923163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4aa94-04a9-46af-b5bf-bb8c2124cf88 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:32:28.924944 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-19f4aa94-04a9-46af-b5bf-bb8c2124cf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:29.032087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4aa94-04a9-46af-b5bf-bb8c2124cf88 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:32:29.037774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9d710-6184-4902-a4db-d2f335290297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:32:29.038367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9d710-6184-4902-a4db-d2f335290297 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:29.038668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9d710-6184-4902-a4db-d2f335290297 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:29.038935 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9d710-6184-4902-a4db-d2f335290297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:29.047136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9d710-6184-4902-a4db-d2f335290297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:32:29.048743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9d710-6184-4902-a4db-d2f335290297 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:32:29.057984 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 762/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:32:30.150548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52693c9-79e5-45aa-a096-85397dd0b6cf None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:30.151086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52693c9-79e5-45aa-a096-85397dd0b6cf None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:30.151086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52693c9-79e5-45aa-a096-85397dd0b6cf None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:30.152487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 10:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:32:30.159116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9651f14-c879-4dc5-970f-22265fe206ee None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:30.159582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9651f14-c879-4dc5-970f-22265fe206ee None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:30.159682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9651f14-c879-4dc5-970f-22265fe206ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:30.179443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c9651f14-c879-4dc5-970f-22265fe206ee None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:32:30.180605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c9651f14-c879-4dc5-970f-22265fe206ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:30.188265 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 10:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:32:30.342312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52693c9-79e5-45aa-a096-85397dd0b6cf None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:32:30.357694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52693c9-79e5-45aa-a096-85397dd0b6cf None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:32:30.363200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f21f9f-5165-4d97-9a5c-2fc75b8582ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:32:30.363793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f21f9f-5165-4d97-9a5c-2fc75b8582ab service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:30.364104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f21f9f-5165-4d97-9a5c-2fc75b8582ab service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:30.364376 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f21f9f-5165-4d97-9a5c-2fc75b8582ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:30.373051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f21f9f-5165-4d97-9a5c-2fc75b8582ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:32:30.374975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f21f9f-5165-4d97-9a5c-2fc75b8582ab service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:32:30.388324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 753/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:32:30.806377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e112e-3070-46e2-b814-c15510c06fc8 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:30.806655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e112e-3070-46e2-b814-c15510c06fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:30.806928 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e112e-3070-46e2-b814-c15510c06fc8 None None] PATH_INFO: `/v3` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:30.808253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 764/1517] 10.222.0.43 () {54 vars in 925 bytes} [Tue Oct 4 10:32:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:32:30.820778 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202a189-4e5b-48e4-88fc-866ff7e18279 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:30.821068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202a189-4e5b-48e4-88fc-866ff7e18279 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:30.821344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202a189-4e5b-48e4-88fc-866ff7e18279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:30.872075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3202a189-4e5b-48e4-88fc-866ff7e18279 None None] MFA Rules not processed for user `505c7c48b0d14dc9af8006cc7e8eea53`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:32:30.873275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3202a189-4e5b-48e4-88fc-866ff7e18279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:30.950210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 754/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Oct 4 10:32:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:32:34.768994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032f0fc-134c-420d-bcd7-7769b317d110 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:34.769428 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032f0fc-134c-420d-bcd7-7769b317d110 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:34.769551 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032f0fc-134c-420d-bcd7-7769b317d110 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:34.770857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 765/1519] 10.222.0.33 () {54 vars in 961 bytes} [Tue Oct 4 10:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:32:34.775903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8bfcf-3b06-4ba5-96fd-fb440e748a89 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:34.776333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8bfcf-3b06-4ba5-96fd-fb440e748a89 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:34.776478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8bfcf-3b06-4ba5-96fd-fb440e748a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:34.796160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1be8bfcf-3b06-4ba5-96fd-fb440e748a89 None None] MFA Rules not processed for user `505c7c48b0d14dc9af8006cc7e8eea53`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:32:34.797362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1be8bfcf-3b06-4ba5-96fd-fb440e748a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:34.805800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 755/1520] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Oct 4 10:32:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:32:34.813594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032f0fc-134c-420d-bcd7-7769b317d110 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:32:34.826582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032f0fc-134c-420d-bcd7-7769b317d110 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:32:34.831965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1748c-8aa9-4f7a-a025-46226ddc62b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:32:34.832555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1748c-8aa9-4f7a-a025-46226ddc62b1 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:34.832833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1748c-8aa9-4f7a-a025-46226ddc62b1 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:34.833107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1748c-8aa9-4f7a-a025-46226ddc62b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:34.841274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1748c-8aa9-4f7a-a025-46226ddc62b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:32:34.842897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1748c-8aa9-4f7a-a025-46226ddc62b1 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:32:34.853276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 766/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:32:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:32:41.867785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea3044-611f-42bf-a301-896618f3cbf2 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:41.868421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea3044-611f-42bf-a301-896618f3cbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:41.868421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea3044-611f-42bf-a301-896618f3cbf2 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:41.869727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 10:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:32:41.875736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e299b1c-62d2-4651-b691-13d6a71bcdef None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:41.876186 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e299b1c-62d2-4651-b691-13d6a71bcdef None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:41.876296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e299b1c-62d2-4651-b691-13d6a71bcdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:41.895357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1e299b1c-62d2-4651-b691-13d6a71bcdef None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:32:41.896579 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1e299b1c-62d2-4651-b691-13d6a71bcdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:41.904291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 10:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:32:42.057390 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea3044-611f-42bf-a301-896618f3cbf2 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:32:42.072374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea3044-611f-42bf-a301-896618f3cbf2 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:32:42.078004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23088ec-f12c-479f-ba1c-36f751a6507d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:32:42.078688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23088ec-f12c-479f-ba1c-36f751a6507d service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:42.078937 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23088ec-f12c-479f-ba1c-36f751a6507d service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:42.079199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23088ec-f12c-479f-ba1c-36f751a6507d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:42.087522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23088ec-f12c-479f-ba1c-36f751a6507d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:32:42.089122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23088ec-f12c-479f-ba1c-36f751a6507d service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:32:42.099064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 757/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:32:43.157356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6e26a-d34b-4332-9bda-b2c68e6256e3 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:43.157926 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6e26a-d34b-4332-9bda-b2c68e6256e3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:43.157926 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6e26a-d34b-4332-9bda-b2c68e6256e3 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:43.159215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 10:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:32:43.165329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbcd37-361a-4e52-b05c-b4ad0ae62317 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:43.165732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbcd37-361a-4e52-b05c-b4ad0ae62317 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:43.165831 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbcd37-361a-4e52-b05c-b4ad0ae62317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:43.184577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d8cbcd37-361a-4e52-b05c-b4ad0ae62317 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:32:43.185767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d8cbcd37-361a-4e52-b05c-b4ad0ae62317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:43.193518 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:32:43.343874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6e26a-d34b-4332-9bda-b2c68e6256e3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:32:43.358455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6e26a-d34b-4332-9bda-b2c68e6256e3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:32:43.363779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f489bd-0950-4c79-9836-f7ec7961932f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:32:43.364408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f489bd-0950-4c79-9836-f7ec7961932f service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:43.364712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f489bd-0950-4c79-9836-f7ec7961932f service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:43.364987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f489bd-0950-4c79-9836-f7ec7961932f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:43.373022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f489bd-0950-4c79-9836-f7ec7961932f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:32:43.374581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f489bd-0950-4c79-9836-f7ec7961932f service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:32:43.384377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 769/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:32:47.328240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9b0c-63fa-4ab4-bdbb-494c69139875 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:47.328769 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9b0c-63fa-4ab4-bdbb-494c69139875 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:47.328876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9b0c-63fa-4ab4-bdbb-494c69139875 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:47.330167 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:32:47.335626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf4a9c-9aab-4025-87a2-815f1e800eaa None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:47.336073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf4a9c-9aab-4025-87a2-815f1e800eaa None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:47.336260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf4a9c-9aab-4025-87a2-815f1e800eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:47.356454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b1cf4a9c-9aab-4025-87a2-815f1e800eaa None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:32:47.357664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b1cf4a9c-9aab-4025-87a2-815f1e800eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:47.366011 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:32:47.656078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9b0c-63fa-4ab4-bdbb-494c69139875 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:32:47.658288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-784f9b0c-63fa-4ab4-bdbb-494c69139875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:47.685310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:32:47.714539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9b0c-63fa-4ab4-bdbb-494c69139875 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:32:47.718398 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c1914-6e18-40c2-bf6e-722228208e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:32:47.719613 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c1914-6e18-40c2-bf6e-722228208e87 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:47.719896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c1914-6e18-40c2-bf6e-722228208e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:47.720199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c1914-6e18-40c2-bf6e-722228208e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:47.729730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c1914-6e18-40c2-bf6e-722228208e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:32:47.731143 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c1914-6e18-40c2-bf6e-722228208e87 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:32:47.740512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 760/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:32:49.857096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111e42c-6828-4acd-b4d0-b760ae3728aa None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:49.857677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111e42c-6828-4acd-b4d0-b760ae3728aa None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:49.857677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111e42c-6828-4acd-b4d0-b760ae3728aa None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:49.858964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:32:49.864173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95d379-cf61-432f-94bf-bb65aef26599 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:49.864641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95d379-cf61-432f-94bf-bb65aef26599 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:49.864748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95d379-cf61-432f-94bf-bb65aef26599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:49.883572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-2a95d379-cf61-432f-94bf-bb65aef26599 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:32:49.884787 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2a95d379-cf61-432f-94bf-bb65aef26599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:49.892936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:32:50.179335 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111e42c-6828-4acd-b4d0-b760ae3728aa None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:32:50.189936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111e42c-6828-4acd-b4d0-b760ae3728aa None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:32:50.193362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd2e57-0ff4-49d3-aa00-8082c41dc705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:32:50.193939 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd2e57-0ff4-49d3-aa00-8082c41dc705 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:50.194212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd2e57-0ff4-49d3-aa00-8082c41dc705 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:50.194481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd2e57-0ff4-49d3-aa00-8082c41dc705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:50.203068 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd2e57-0ff4-49d3-aa00-8082c41dc705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:32:50.204500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd2e57-0ff4-49d3-aa00-8082c41dc705 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:32:50.213878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 772/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:32:54.078599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614617b-fb86-4a1a-8ca4-d7af051c721d None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:54.079163 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614617b-fb86-4a1a-8ca4-d7af051c721d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:54.079163 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614617b-fb86-4a1a-8ca4-d7af051c721d None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:54.080507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:32:54.085600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcb3ca-3dca-469d-9465-bcd39c294e96 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:54.086002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcb3ca-3dca-469d-9465-bcd39c294e96 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:54.086139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcb3ca-3dca-469d-9465-bcd39c294e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:54.093585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=74 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:32:54.105928 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f5fcb3ca-3dca-469d-9465-bcd39c294e96 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:32:54.107291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f5fcb3ca-3dca-469d-9465-bcd39c294e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:54.115170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:32:54.420902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614617b-fb86-4a1a-8ca4-d7af051c721d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:32:54.423099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d614617b-fb86-4a1a-8ca4-d7af051c721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:54.479711 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614617b-fb86-4a1a-8ca4-d7af051c721d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:32:54.483216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8d650-b888-4a28-bed4-c62a70a5f8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:32:54.483820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d650-b888-4a28-bed4-c62a70a5f8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:54.484722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d650-b888-4a28-bed4-c62a70a5f8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:54.485023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d650-b888-4a28-bed4-c62a70a5f8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:54.493749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8d650-b888-4a28-bed4-c62a70a5f8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:32:54.495155 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8d650-b888-4a28-bed4-c62a70a5f8f3 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:32:54.504991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 763/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:32:56.650969 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2509-52ee-42bc-a9f4-780bf7c51459 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:56.651537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2509-52ee-42bc-a9f4-780bf7c51459 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:56.651537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2509-52ee-42bc-a9f4-780bf7c51459 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:56.652896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 10:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:32:56.658636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d99258-1e27-408a-a8e6-9e9017c7e875 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:56.659064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d99258-1e27-408a-a8e6-9e9017c7e875 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:56.659171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d99258-1e27-408a-a8e6-9e9017c7e875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:56.678254 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-19d99258-1e27-408a-a8e6-9e9017c7e875 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:32:56.679445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-19d99258-1e27-408a-a8e6-9e9017c7e875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:56.687102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 10:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:32:56.994137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e2509-52ee-42bc-a9f4-780bf7c51459 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:32:56.995800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-685e2509-52ee-42bc-a9f4-780bf7c51459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:32:57.008731 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e2509-52ee-42bc-a9f4-780bf7c51459 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:32:57.012494 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413b10d-236b-4ed1-aee0-175baa7bc6de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:32:57.013095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413b10d-236b-4ed1-aee0-175baa7bc6de service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:32:57.013372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413b10d-236b-4ed1-aee0-175baa7bc6de service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:32:57.013673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413b10d-236b-4ed1-aee0-175baa7bc6de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:32:57.022502 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413b10d-236b-4ed1-aee0-175baa7bc6de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:32:57.023901 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413b10d-236b-4ed1-aee0-175baa7bc6de service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:32:57.033538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 775/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:33:06.672996 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=47 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:33:07.029018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=8 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:26.053303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667fbdb-3382-4b66-8934-adcfd55eeb28 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.054577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667fbdb-3382-4b66-8934-adcfd55eeb28 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.054577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667fbdb-3382-4b66-8934-adcfd55eeb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.085275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f667fbdb-3382-4b66-8934-adcfd55eeb28 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.086531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f667fbdb-3382-4b66-8934-adcfd55eeb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.101500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 765/1540] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.110537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8182f8b-f270-457b-88cb-c2a2acefc13c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.111165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8182f8b-f270-457b-88cb-c2a2acefc13c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.111165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8182f8b-f270-457b-88cb-c2a2acefc13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.138105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f8182f8b-f270-457b-88cb-c2a2acefc13c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.139467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f8182f8b-f270-457b-88cb-c2a2acefc13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.151797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 776/1541] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.156327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667fbdb-3382-4b66-8934-adcfd55eeb28 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.169404 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667fbdb-3382-4b66-8934-adcfd55eeb28 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.176419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860845-48a1-4e01-9996-3f398963a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.176968 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860845-48a1-4e01-9996-3f398963a461 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.177423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860845-48a1-4e01-9996-3f398963a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.177698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860845-48a1-4e01-9996-3f398963a461 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.178357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860845-48a1-4e01-9996-3f398963a461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:26.178654 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860845-48a1-4e01-9996-3f398963a461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.181114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860845-48a1-4e01-9996-3f398963a461 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.195878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 766/1542] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:26.203893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8182f8b-f270-457b-88cb-c2a2acefc13c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.216086 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8182f8b-f270-457b-88cb-c2a2acefc13c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.221469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c1e24-a0c2-4a2c-bce8-ad433d06fa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.222085 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c1e24-a0c2-4a2c-bce8-ad433d06fa3e admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.222418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c1e24-a0c2-4a2c-bce8-ad433d06fa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.222686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c1e24-a0c2-4a2c-bce8-ad433d06fa3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.223318 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c1e24-a0c2-4a2c-bce8-ad433d06fa3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.225231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c1e24-a0c2-4a2c-bce8-ad433d06fa3e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.329630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 777/1543] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:26.337959 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860845-48a1-4e01-9996-3f398963a461 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.350177 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860845-48a1-4e01-9996-3f398963a461 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.365257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094918d-31de-420c-8027-450b22336021 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.366038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094918d-31de-420c-8027-450b22336021 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.367072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094918d-31de-420c-8027-450b22336021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.402481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a094918d-31de-420c-8027-450b22336021 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.404111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a094918d-31de-420c-8027-450b22336021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.465198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5a153-7b1b-4fad-82a8-d55294e08b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.466091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5a153-7b1b-4fad-82a8-d55294e08b95 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.466534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5a153-7b1b-4fad-82a8-d55294e08b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.466973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5a153-7b1b-4fad-82a8-d55294e08b95 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.467782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5a153-7b1b-4fad-82a8-d55294e08b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.471135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5a153-7b1b-4fad-82a8-d55294e08b95 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.501386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 778/1544] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.509023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ef4b5-ec4f-4c5b-bdde-1aadf41f6a4d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.509023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ef4b5-ec4f-4c5b-bdde-1aadf41f6a4d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.509023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ef4b5-ec4f-4c5b-bdde-1aadf41f6a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.524759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8e8ef4b5-ec4f-4c5b-bdde-1aadf41f6a4d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.525964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8e8ef4b5-ec4f-4c5b-bdde-1aadf41f6a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.533957 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 779/1545] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.535113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801387a-0c0a-4872-964a-52fa39620af2 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.535395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801387a-0c0a-4872-964a-52fa39620af2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.536892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801387a-0c0a-4872-964a-52fa39620af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.555493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4801387a-0c0a-4872-964a-52fa39620af2 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.556708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4801387a-0c0a-4872-964a-52fa39620af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.564744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 767/1546] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:26.564744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c7886-954c-41f4-b4b1-810bbdf2a0fd None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.564744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c7886-954c-41f4-b4b1-810bbdf2a0fd None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.564744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c7886-954c-41f4-b4b1-810bbdf2a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.568081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 780/1547] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.569647 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1633-9c9f-4816-a59a-1f9c3b71f2c1 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.570654 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1633-9c9f-4816-a59a-1f9c3b71f2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.570935 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1633-9c9f-4816-a59a-1f9c3b71f2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.583614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-7f0c7886-954c-41f4-b4b1-810bbdf2a0fd None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.584833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7f0c7886-954c-41f4-b4b1-810bbdf2a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.590145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1cca1633-9c9f-4816-a59a-1f9c3b71f2c1 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.591304 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1cca1633-9c9f-4816-a59a-1f9c3b71f2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.593122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 768/1548] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.594549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43d9b-1d51-462e-83cf-c96d1d1fa671 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.594829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43d9b-1d51-462e-83cf-c96d1d1fa671 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.595108 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43d9b-1d51-462e-83cf-c96d1d1fa671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.606559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 781/1549] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.607843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ab47-7175-48a9-8606-44d3a8a0fca4 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.608165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ab47-7175-48a9-8606-44d3a8a0fca4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.608436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ab47-7175-48a9-8606-44d3a8a0fca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.615742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-afe43d9b-1d51-462e-83cf-c96d1d1fa671 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.617566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-afe43d9b-1d51-462e-83cf-c96d1d1fa671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.625597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 769/1550] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.632799 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5cd2f-a37e-49c5-81da-2a71f0696ebb None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.632799 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5cd2f-a37e-49c5-81da-2a71f0696ebb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.632799 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5cd2f-a37e-49c5-81da-2a71f0696ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.633085 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5785ab47-7175-48a9-8606-44d3a8a0fca4 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.633085 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5785ab47-7175-48a9-8606-44d3a8a0fca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.639357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 782/1551] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.640834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f023e-eb75-41cc-a667-21eef9b2f65c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.641303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f023e-eb75-41cc-a667-21eef9b2f65c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.641577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f023e-eb75-41cc-a667-21eef9b2f65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.652220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1bc5cd2f-a37e-49c5-81da-2a71f0696ebb None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.653418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1bc5cd2f-a37e-49c5-81da-2a71f0696ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.660601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4a7f023e-eb75-41cc-a667-21eef9b2f65c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.667237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 770/1552] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.667367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4a7f023e-eb75-41cc-a667-21eef9b2f65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.667473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5cd2f-a37e-49c5-81da-2a71f0696ebb None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.671889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 783/1553] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.672550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5cd2f-a37e-49c5-81da-2a71f0696ebb None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.673165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18481f5e-b30d-482f-8dd9-e84b69958c1d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.673380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18481f5e-b30d-482f-8dd9-e84b69958c1d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.673648 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18481f5e-b30d-482f-8dd9-e84b69958c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.677227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3973b-1560-4a4b-a934-dd0a1e67862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.677853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3973b-1560-4a4b-a934-dd0a1e67862b admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.678160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3973b-1560-4a4b-a934-dd0a1e67862b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.678429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3973b-1560-4a4b-a934-dd0a1e67862b admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.679623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3973b-1560-4a4b-a934-dd0a1e67862b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.681248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3973b-1560-4a4b-a934-dd0a1e67862b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.691681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 771/1554] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:26.692913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e408dc-4af6-4c5c-9c99-4b16988992ce None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.693192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e408dc-4af6-4c5c-9c99-4b16988992ce None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.693465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e408dc-4af6-4c5c-9c99-4b16988992ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.696344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-18481f5e-b30d-482f-8dd9-e84b69958c1d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.697605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-18481f5e-b30d-482f-8dd9-e84b69958c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.705445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 784/1555] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.706683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f804cc0-0ab8-4f73-b3e8-1b31c63cb104 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.706968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f804cc0-0ab8-4f73-b3e8-1b31c63cb104 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.707241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f804cc0-0ab8-4f73-b3e8-1b31c63cb104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.712468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-07e408dc-4af6-4c5c-9c99-4b16988992ce None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.713657 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-07e408dc-4af6-4c5c-9c99-4b16988992ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.725263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 772/1556] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.725263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835afd4-f9cf-493a-baee-1d829a9d011d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.725263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835afd4-f9cf-493a-baee-1d829a9d011d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.725263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835afd4-f9cf-493a-baee-1d829a9d011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.732535 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3f804cc0-0ab8-4f73-b3e8-1b31c63cb104 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.733800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3f804cc0-0ab8-4f73-b3e8-1b31c63cb104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.742563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 785/1557] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.744108 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d73b9b-5471-475a-94c5-8b183ca23560 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.744387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d73b9b-5471-475a-94c5-8b183ca23560 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.744659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d73b9b-5471-475a-94c5-8b183ca23560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.747289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0835afd4-f9cf-493a-baee-1d829a9d011d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.748735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0835afd4-f9cf-493a-baee-1d829a9d011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.760431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 773/1558] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.760431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835afd4-f9cf-493a-baee-1d829a9d011d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.763896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-92d73b9b-5471-475a-94c5-8b183ca23560 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:26.765100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-92d73b9b-5471-475a-94c5-8b183ca23560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:26.767499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835afd4-f9cf-493a-baee-1d829a9d011d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.772154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c54a21-f3c6-4715-a1de-9e096ab1a8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.772829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c54a21-f3c6-4715-a1de-9e096ab1a8ac admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.776410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c54a21-f3c6-4715-a1de-9e096ab1a8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.776526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 786/1559] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:26.776649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c54a21-f3c6-4715-a1de-9e096ab1a8ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.776755 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d73b9b-5471-475a-94c5-8b183ca23560 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.776864 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c54a21-f3c6-4715-a1de-9e096ab1a8ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:26.776864 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c54a21-f3c6-4715-a1de-9e096ab1a8ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.776864 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c54a21-f3c6-4715-a1de-9e096ab1a8ac admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.783162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d73b9b-5471-475a-94c5-8b183ca23560 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.787640 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d9b46-407a-4871-b33a-5830fd4d4d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.788147 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 774/1560] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:26.788784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d9b46-407a-4871-b33a-5830fd4d4d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.789013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d9b46-407a-4871-b33a-5830fd4d4d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.789286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d9b46-407a-4871-b33a-5830fd4d4d5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.789581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c54a21-f3c6-4715-a1de-9e096ab1a8ac admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.789952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d9b46-407a-4871-b33a-5830fd4d4d5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:26.790207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d9b46-407a-4871-b33a-5830fd4d4d5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.791204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: WARNING py.warnings [None req-cc5d9b46-407a-4871-b33a-5830fd4d4d5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:34:26.791204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: warnings.warn(msg) Oct 04 10:34:26.791204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: Oct 04 10:34:26.792116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d9b46-407a-4871-b33a-5830fd4d4d5a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.799616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c54a21-f3c6-4715-a1de-9e096ab1a8ac admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.805020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 787/1561] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:26.805153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc871d69-26ec-4ec9-8a8b-4626464c874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.805265 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d9b46-407a-4871-b33a-5830fd4d4d5a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.810732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc871d69-26ec-4ec9-8a8b-4626464c874d admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.810732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc871d69-26ec-4ec9-8a8b-4626464c874d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.810732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc871d69-26ec-4ec9-8a8b-4626464c874d admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.810732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc871d69-26ec-4ec9-8a8b-4626464c874d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.810732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc871d69-26ec-4ec9-8a8b-4626464c874d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.814464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d9b46-407a-4871-b33a-5830fd4d4d5a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.818357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 775/1562] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:26.819183 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc871d69-26ec-4ec9-8a8b-4626464c874d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.823368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fb8c2-f85a-4f00-b7a1-fc04723ba673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.823975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fb8c2-f85a-4f00-b7a1-fc04723ba673 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.824259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fb8c2-f85a-4f00-b7a1-fc04723ba673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.824522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fb8c2-f85a-4f00-b7a1-fc04723ba673 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.825152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fb8c2-f85a-4f00-b7a1-fc04723ba673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:26.825450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fb8c2-f85a-4f00-b7a1-fc04723ba673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.827069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fb8c2-f85a-4f00-b7a1-fc04723ba673 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.831599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc871d69-26ec-4ec9-8a8b-4626464c874d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.836322 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74ba2c-ed97-4fe1-980a-2576d9b804b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.836905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74ba2c-ed97-4fe1-980a-2576d9b804b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.837185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74ba2c-ed97-4fe1-980a-2576d9b804b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.837461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74ba2c-ed97-4fe1-980a-2576d9b804b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.838112 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74ba2c-ed97-4fe1-980a-2576d9b804b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:26.838400 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74ba2c-ed97-4fe1-980a-2576d9b804b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.839082 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 788/1563] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:26.839861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fb8c2-f85a-4f00-b7a1-fc04723ba673 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.844953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74ba2c-ed97-4fe1-980a-2576d9b804b0 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.851449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fb8c2-f85a-4f00-b7a1-fc04723ba673 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.856219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bad3e9-a345-458c-9854-67420bc6a43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.856800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bad3e9-a345-458c-9854-67420bc6a43b admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.857072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bad3e9-a345-458c-9854-67420bc6a43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.857339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bad3e9-a345-458c-9854-67420bc6a43b admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.860924 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 776/1564] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:26.861070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bad3e9-a345-458c-9854-67420bc6a43b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:26.861070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bad3e9-a345-458c-9854-67420bc6a43b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.861251 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74ba2c-ed97-4fe1-980a-2576d9b804b0 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.861334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bad3e9-a345-458c-9854-67420bc6a43b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.870637 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74ba2c-ed97-4fe1-980a-2576d9b804b0 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.872092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 789/1565] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:26.872914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bad3e9-a345-458c-9854-67420bc6a43b admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.875526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a75db-afaa-4cdb-b812-edb0e1465eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.876163 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a75db-afaa-4cdb-b812-edb0e1465eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.876444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a75db-afaa-4cdb-b812-edb0e1465eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.876715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a75db-afaa-4cdb-b812-edb0e1465eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.877482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a75db-afaa-4cdb-b812-edb0e1465eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:26.877791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a75db-afaa-4cdb-b812-edb0e1465eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.879517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a75db-afaa-4cdb-b812-edb0e1465eaa admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.883363 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bad3e9-a345-458c-9854-67420bc6a43b admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.887929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa67563-591e-4747-946a-158e8c2e80e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.888542 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa67563-591e-4747-946a-158e8c2e80e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.888827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa67563-591e-4747-946a-158e8c2e80e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.889094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa67563-591e-4747-946a-158e8c2e80e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.889752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa67563-591e-4747-946a-158e8c2e80e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:26.890054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa67563-591e-4747-946a-158e8c2e80e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.897127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 777/1566] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:26.897249 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa67563-591e-4747-946a-158e8c2e80e9 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.897351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a75db-afaa-4cdb-b812-edb0e1465eaa admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.903293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a75db-afaa-4cdb-b812-edb0e1465eaa admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.908540 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 790/1567] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:26.908669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d3575-ba6f-4b2d-b556-0b50b6e70962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.908669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d3575-ba6f-4b2d-b556-0b50b6e70962 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.908832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa67563-591e-4747-946a-158e8c2e80e9 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:26.908941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d3575-ba6f-4b2d-b556-0b50b6e70962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.909021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d3575-ba6f-4b2d-b556-0b50b6e70962 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.909632 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d3575-ba6f-4b2d-b556-0b50b6e70962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.910663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: WARNING py.warnings [None req-315d3575-ba6f-4b2d-b556-0b50b6e70962 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:34:26.910663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: warnings.warn(msg) Oct 04 10:34:26.910663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: Oct 04 10:34:26.915079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d3575-ba6f-4b2d-b556-0b50b6e70962 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:26.924885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa67563-591e-4747-946a-158e8c2e80e9 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:26.930266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76d4b-c302-4889-8d4c-996371fe879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:26.931071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76d4b-c302-4889-8d4c-996371fe879c admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:26.931350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76d4b-c302-4889-8d4c-996371fe879c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:26.931620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76d4b-c302-4889-8d4c-996371fe879c admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:26.932295 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76d4b-c302-4889-8d4c-996371fe879c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:26.934211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76d4b-c302-4889-8d4c-996371fe879c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:27.043175 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 778/1568] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/projects => generated 391 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:27.044104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d3575-ba6f-4b2d-b556-0b50b6e70962 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:27.056731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:27.076796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 791/1569] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:26 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:27.078936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76d4b-c302-4889-8d4c-996371fe879c admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:27.086853 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:27.105193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d3575-ba6f-4b2d-b556-0b50b6e70962 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:27.142698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76d4b-c302-4889-8d4c-996371fe879c admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:27.147483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6640-ab2f-40ce-89a7-605a0a09900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:27.148742 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6640-ab2f-40ce-89a7-605a0a09900f admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:27.149013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6640-ab2f-40ce-89a7-605a0a09900f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:27.149281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6640-ab2f-40ce-89a7-605a0a09900f admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:27.149901 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d6640-ab2f-40ce-89a7-605a0a09900f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:27.151770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d6640-ab2f-40ce-89a7-605a0a09900f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:27.159484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7b7d3-92e7-4833-a1ab-760e707e9363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:27.160174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b7d3-92e7-4833-a1ab-760e707e9363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:27.160453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b7d3-92e7-4833-a1ab-760e707e9363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:27.160724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b7d3-92e7-4833-a1ab-760e707e9363 admin admin] PATH_INFO: `/v3/projects/c3985f30465442f0b1ac65f7edea53d1/users/65fa45f900c346ff8a6fb3e7dde4d489/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:27.176576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7b7d3-92e7-4833-a1ab-760e707e9363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3985f30465442f0b1ac65f7edea53d1, user_id=65fa45f900c346ff8a6fb3e7dde4d489, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:27.177628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: WARNING py.warnings [None req-cba7b7d3-92e7-4833-a1ab-760e707e9363 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:34:27.177628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: warnings.warn(msg) Oct 04 10:34:27.177628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: Oct 04 10:34:27.179596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7b7d3-92e7-4833-a1ab-760e707e9363 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:27.253443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 792/1570] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:27 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:27.254306 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6640-ab2f-40ce-89a7-605a0a09900f admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:27.282312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 779/1571] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:27 2022] PUT /identity/v3/projects/c3985f30465442f0b1ac65f7edea53d1/users/65fa45f900c346ff8a6fb3e7dde4d489/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:27.283123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7b7d3-92e7-4833-a1ab-760e707e9363 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:27.327223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6640-ab2f-40ce-89a7-605a0a09900f admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:27.346470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7b7d3-92e7-4833-a1ab-760e707e9363 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:27.351861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159afec-20ea-4a2b-a719-f36c17cabdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:27.352505 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159afec-20ea-4a2b-a719-f36c17cabdef admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:27.352780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159afec-20ea-4a2b-a719-f36c17cabdef admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:27.353047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159afec-20ea-4a2b-a719-f36c17cabdef admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:27.353671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159afec-20ea-4a2b-a719-f36c17cabdef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:27.355993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159afec-20ea-4a2b-a719-f36c17cabdef admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:27.382891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a29e2-c864-4e00-86f1-ba2f54f352da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:27.383486 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a29e2-c864-4e00-86f1-ba2f54f352da admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:27.383761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a29e2-c864-4e00-86f1-ba2f54f352da admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:27.384054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a29e2-c864-4e00-86f1-ba2f54f352da admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:27.384737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a29e2-c864-4e00-86f1-ba2f54f352da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:27.386598 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a29e2-c864-4e00-86f1-ba2f54f352da admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:27.454395 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 780/1572] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:27 2022] POST /identity/v3/projects => generated 403 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:27.454813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159afec-20ea-4a2b-a719-f36c17cabdef admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:27.484910 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:27.494401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 793/1573] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:27 2022] POST /identity/v3/projects => generated 367 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:27.496811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a29e2-c864-4e00-86f1-ba2f54f352da admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:27.515497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159afec-20ea-4a2b-a719-f36c17cabdef admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:27.521259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:27.556748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a29e2-c864-4e00-86f1-ba2f54f352da admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:27.561382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8340ab-3201-4bff-b9ab-a843829f4fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:27.561975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8340ab-3201-4bff-b9ab-a843829f4fab admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:27.562250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8340ab-3201-4bff-b9ab-a843829f4fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:27.562514 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8340ab-3201-4bff-b9ab-a843829f4fab admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:27.563133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8340ab-3201-4bff-b9ab-a843829f4fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:27.565040 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8340ab-3201-4bff-b9ab-a843829f4fab admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:27.571973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831fe7f-e1f6-41f1-82ec-2e90fe79f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:27.572660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831fe7f-e1f6-41f1-82ec-2e90fe79f13b admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:27.572940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831fe7f-e1f6-41f1-82ec-2e90fe79f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:27.573215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831fe7f-e1f6-41f1-82ec-2e90fe79f13b admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:27.573873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831fe7f-e1f6-41f1-82ec-2e90fe79f13b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:27.575752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831fe7f-e1f6-41f1-82ec-2e90fe79f13b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:27.664978 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 781/1574] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:27 2022] POST /identity/v3/projects => generated 375 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:27.665376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 794/1575] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:27 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:27.666020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831fe7f-e1f6-41f1-82ec-2e90fe79f13b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:27.666535 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8340ab-3201-4bff-b9ab-a843829f4fab admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:27.729840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831fe7f-e1f6-41f1-82ec-2e90fe79f13b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:27.730541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8340ab-3201-4bff-b9ab-a843829f4fab admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:27.734553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d79a9-5bcc-47ca-aea6-35b0524c318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:27.735183 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d79a9-5bcc-47ca-aea6-35b0524c318e admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:27.735443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffad3b4-eea6-4523-89d7-49f6ba469284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:27.735555 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d79a9-5bcc-47ca-aea6-35b0524c318e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:27.735708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d79a9-5bcc-47ca-aea6-35b0524c318e admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:27.736097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffad3b4-eea6-4523-89d7-49f6ba469284 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:27.736379 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffad3b4-eea6-4523-89d7-49f6ba469284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:27.736609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d79a9-5bcc-47ca-aea6-35b0524c318e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:27.736714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffad3b4-eea6-4523-89d7-49f6ba469284 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:27.737262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffad3b4-eea6-4523-89d7-49f6ba469284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:27.738260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: WARNING py.warnings [None req-fffad3b4-eea6-4523-89d7-49f6ba469284 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:34:27.738260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: warnings.warn(msg) Oct 04 10:34:27.738260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: Oct 04 10:34:27.738515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d79a9-5bcc-47ca-aea6-35b0524c318e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:27.739654 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffad3b4-eea6-4523-89d7-49f6ba469284 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:27.824530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 782/1576] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:27 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:27.825428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d79a9-5bcc-47ca-aea6-35b0524c318e admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:27.834736 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d79a9-5bcc-47ca-aea6-35b0524c318e admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:27.839284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208ff5a-599f-4924-87ca-ecb7e3223b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:27.839855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ff5a-599f-4924-87ca-ecb7e3223b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:27.840158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ff5a-599f-4924-87ca-ecb7e3223b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:27.840425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ff5a-599f-4924-87ca-ecb7e3223b42 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:27.841032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208ff5a-599f-4924-87ca-ecb7e3223b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:27.842949 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208ff5a-599f-4924-87ca-ecb7e3223b42 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:27.850507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 795/1577] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:27 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:27.856846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104fa4f-c9f1-4990-a400-d6c607b57bf1 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:27.856846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104fa4f-c9f1-4990-a400-d6c607b57bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:27.856846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104fa4f-c9f1-4990-a400-d6c607b57bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:27.879610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7104fa4f-c9f1-4990-a400-d6c607b57bf1 None None] MFA Rules not processed for user `65fa45f900c346ff8a6fb3e7dde4d489`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:27.883457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7104fa4f-c9f1-4990-a400-d6c607b57bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:27.946794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 796/1578] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:27.947629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104fa4f-c9f1-4990-a400-d6c607b57bf1 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:27.961657 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104fa4f-c9f1-4990-a400-d6c607b57bf1 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:27.964567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 783/1579] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:27 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:27.967591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f052ee-7f08-444b-850e-203f03d5c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:27.967591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f052ee-7f08-444b-850e-203f03d5c761 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:27.967591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f052ee-7f08-444b-850e-203f03d5c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:27.967591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f052ee-7f08-444b-850e-203f03d5c761 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:27.967982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f052ee-7f08-444b-850e-203f03d5c761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:27.968972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208ff5a-599f-4924-87ca-ecb7e3223b42 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:27.969405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f052ee-7f08-444b-850e-203f03d5c761 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:27.980658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208ff5a-599f-4924-87ca-ecb7e3223b42 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:27.985678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574c9fb-2429-4e58-84c9-4fc222f0494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:27.986288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574c9fb-2429-4e58-84c9-4fc222f0494d admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:27.986570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574c9fb-2429-4e58-84c9-4fc222f0494d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:27.986874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574c9fb-2429-4e58-84c9-4fc222f0494d admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:27.987485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574c9fb-2429-4e58-84c9-4fc222f0494d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:27.989534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574c9fb-2429-4e58-84c9-4fc222f0494d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.083379 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 797/1580] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:27 2022] POST /identity/v3/users => generated 302 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:28.084280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f052ee-7f08-444b-850e-203f03d5c761 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.093541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f052ee-7f08-444b-850e-203f03d5c761 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.098436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4d3cf-946b-4686-b1ab-5293d652c53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.099041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4d3cf-946b-4686-b1ab-5293d652c53d admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.099339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4d3cf-946b-4686-b1ab-5293d652c53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.099605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4d3cf-946b-4686-b1ab-5293d652c53d admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.100248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4d3cf-946b-4686-b1ab-5293d652c53d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.102661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4d3cf-946b-4686-b1ab-5293d652c53d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.111707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:28.145351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 784/1581] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:27 2022] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:28.146310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574c9fb-2429-4e58-84c9-4fc222f0494d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.155766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574c9fb-2429-4e58-84c9-4fc222f0494d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.160412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ee976-91d4-4d40-adbc-c1b6961b701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.160975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ee976-91d4-4d40-adbc-c1b6961b701a admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.161249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ee976-91d4-4d40-adbc-c1b6961b701a admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.161515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ee976-91d4-4d40-adbc-c1b6961b701a admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.162204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ee976-91d4-4d40-adbc-c1b6961b701a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.164611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ee976-91d4-4d40-adbc-c1b6961b701a admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.208816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 798/1582] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:28 2022] POST /identity/v3/users => generated 282 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:28.209612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4d3cf-946b-4686-b1ab-5293d652c53d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.218760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4d3cf-946b-4686-b1ab-5293d652c53d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.223289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c9cb3-96f3-4124-9392-61465c78f1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.223843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c9cb3-96f3-4124-9392-61465c78f1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.224165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c9cb3-96f3-4124-9392-61465c78f1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.224432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c9cb3-96f3-4124-9392-61465c78f1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.225059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c9cb3-96f3-4124-9392-61465c78f1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.227095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c9cb3-96f3-4124-9392-61465c78f1d5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.237381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 799/1583] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.238133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c9cb3-96f3-4124-9392-61465c78f1d5 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.247619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c9cb3-96f3-4124-9392-61465c78f1d5 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.252169 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852b260-9f6c-4e88-b6b4-4ff18346c6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.252709 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852b260-9f6c-4e88-b6b4-4ff18346c6de admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.253024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852b260-9f6c-4e88-b6b4-4ff18346c6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.253299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852b260-9f6c-4e88-b6b4-4ff18346c6de admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.253896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852b260-9f6c-4e88-b6b4-4ff18346c6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.255387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852b260-9f6c-4e88-b6b4-4ff18346c6de admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.264726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 800/1584] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.265497 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852b260-9f6c-4e88-b6b4-4ff18346c6de admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.275056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852b260-9f6c-4e88-b6b4-4ff18346c6de admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.279510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc09df-1524-4d7c-86df-4aa40a508216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.280084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc09df-1524-4d7c-86df-4aa40a508216 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.280359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc09df-1524-4d7c-86df-4aa40a508216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.280626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc09df-1524-4d7c-86df-4aa40a508216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.281240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc09df-1524-4d7c-86df-4aa40a508216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.282756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc09df-1524-4d7c-86df-4aa40a508216 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.289730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:28.292762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 801/1585] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.293979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff12cd-93ad-4119-869d-a2fd61e06b00 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.294258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff12cd-93ad-4119-869d-a2fd61e06b00 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.294532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff12cd-93ad-4119-869d-a2fd61e06b00 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.295717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 802/1586] 10.222.0.33 () {54 vars in 961 bytes} [Tue Oct 4 10:34:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:34:28.296471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff12cd-93ad-4119-869d-a2fd61e06b00 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.302448 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 785/1587] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:28 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:28.302448 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ee976-91d4-4d40-adbc-c1b6961b701a admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.312294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff12cd-93ad-4119-869d-a2fd61e06b00 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.312435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ee976-91d4-4d40-adbc-c1b6961b701a admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.316787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d32c-273b-4b82-995d-77a905c9f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.317039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcb275-7a99-4471-b674-0f9d69263d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.317361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d32c-273b-4b82-995d-77a905c9f157 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.317635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d32c-273b-4b82-995d-77a905c9f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.317733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcb275-7a99-4471-b674-0f9d69263d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.317902 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22d32c-273b-4b82-995d-77a905c9f157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.318008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcb275-7a99-4471-b674-0f9d69263d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.318215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcb275-7a99-4471-b674-0f9d69263d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.318524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d32c-273b-4b82-995d-77a905c9f157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.318866 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcb275-7a99-4471-b674-0f9d69263d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.320181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22d32c-273b-4b82-995d-77a905c9f157 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.320549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcb275-7a99-4471-b674-0f9d69263d8c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.330404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 803/1588] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.333850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 786/1589] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.334000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d32c-273b-4b82-995d-77a905c9f157 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.334101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcb275-7a99-4471-b674-0f9d69263d8c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.342695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22d32c-273b-4b82-995d-77a905c9f157 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.345710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcb275-7a99-4471-b674-0f9d69263d8c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.347300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3024c55-416e-4460-9ef8-581d908fd133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.347430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf5224-0eec-4a78-a424-41861745eb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.347875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3024c55-416e-4460-9ef8-581d908fd133 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.348035 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf5224-0eec-4a78-a424-41861745eb05 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.348177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3024c55-416e-4460-9ef8-581d908fd133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.348286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf5224-0eec-4a78-a424-41861745eb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.348447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3024c55-416e-4460-9ef8-581d908fd133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.348551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf5224-0eec-4a78-a424-41861745eb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.349066 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3024c55-416e-4460-9ef8-581d908fd133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.349182 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf5224-0eec-4a78-a424-41861745eb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.350608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3024c55-416e-4460-9ef8-581d908fd133 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.351274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf5224-0eec-4a78-a424-41861745eb05 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.361104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 804/1590] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.364985 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 787/1591] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.365124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3024c55-416e-4460-9ef8-581d908fd133 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.365252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf5224-0eec-4a78-a424-41861745eb05 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.374240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf5224-0eec-4a78-a424-41861745eb05 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.374497 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3024c55-416e-4460-9ef8-581d908fd133 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.378963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e09df-ceb5-453e-b945-847d96e4427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.385723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e09df-ceb5-453e-b945-847d96e4427c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.385867 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6941a16-3a1b-49c8-9909-09245f972e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.385984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e09df-ceb5-453e-b945-847d96e4427c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.385984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e09df-ceb5-453e-b945-847d96e4427c admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.386173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6941a16-3a1b-49c8-9909-09245f972e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.386173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6941a16-3a1b-49c8-9909-09245f972e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.386362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e09df-ceb5-453e-b945-847d96e4427c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.386460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6941a16-3a1b-49c8-9909-09245f972e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.386460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6941a16-3a1b-49c8-9909-09245f972e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.386641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e09df-ceb5-453e-b945-847d96e4427c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.386751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6941a16-3a1b-49c8-9909-09245f972e1a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.392506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 788/1592] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.396059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 805/1593] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.396192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3f668-d9c6-478e-b40b-39474a56e1d0 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.396310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6941a16-3a1b-49c8-9909-09245f972e1a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.396425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3f668-d9c6-478e-b40b-39474a56e1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.396425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3f668-d9c6-478e-b40b-39474a56e1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.405342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6941a16-3a1b-49c8-9909-09245f972e1a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.409975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58408b31-4930-4a6d-88f8-408cbc5d2434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.410549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58408b31-4930-4a6d-88f8-408cbc5d2434 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.410826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58408b31-4930-4a6d-88f8-408cbc5d2434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.411093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58408b31-4930-4a6d-88f8-408cbc5d2434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.411721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58408b31-4930-4a6d-88f8-408cbc5d2434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.413888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58408b31-4930-4a6d-88f8-408cbc5d2434 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.423941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 806/1594] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.437448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58408b31-4930-4a6d-88f8-408cbc5d2434 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.437620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-87b3f668-d9c6-478e-b40b-39474a56e1d0 None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:28.437620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-87b3f668-d9c6-478e-b40b-39474a56e1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:28.437825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58408b31-4930-4a6d-88f8-408cbc5d2434 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.439850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279abe2-17b5-49da-9ee1-679ccf9a49a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.440446 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279abe2-17b5-49da-9ee1-679ccf9a49a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.440721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279abe2-17b5-49da-9ee1-679ccf9a49a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.440989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279abe2-17b5-49da-9ee1-679ccf9a49a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.441667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279abe2-17b5-49da-9ee1-679ccf9a49a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.443214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279abe2-17b5-49da-9ee1-679ccf9a49a3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.456233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 807/1595] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.456233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279abe2-17b5-49da-9ee1-679ccf9a49a3 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.463735 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279abe2-17b5-49da-9ee1-679ccf9a49a3 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.468608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3126d-f580-458d-afdd-2ea3792aacb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.469300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3126d-f580-458d-afdd-2ea3792aacb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.469787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3126d-f580-458d-afdd-2ea3792aacb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.470230 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3126d-f580-458d-afdd-2ea3792aacb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.470932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3126d-f580-458d-afdd-2ea3792aacb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.473200 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3126d-f580-458d-afdd-2ea3792aacb2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.484045 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 808/1596] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.494002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3126d-f580-458d-afdd-2ea3792aacb2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.496230 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3126d-f580-458d-afdd-2ea3792aacb2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.500834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42c58d-966c-4bf5-829c-3c1749068b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.501426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42c58d-966c-4bf5-829c-3c1749068b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.501702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42c58d-966c-4bf5-829c-3c1749068b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.501972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42c58d-966c-4bf5-829c-3c1749068b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.502590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42c58d-966c-4bf5-829c-3c1749068b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.504157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42c58d-966c-4bf5-829c-3c1749068b57 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.506051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 789/1597] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Oct 4 10:34:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:28.506753 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3f668-d9c6-478e-b40b-39474a56e1d0 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.516487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 809/1598] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.516713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3f668-d9c6-478e-b40b-39474a56e1d0 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.517859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42c58d-966c-4bf5-829c-3c1749068b57 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.521247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d528b0d-fa16-4232-a6c2-d00cf83d59aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.521942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d528b0d-fa16-4232-a6c2-d00cf83d59aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.522444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d528b0d-fa16-4232-a6c2-d00cf83d59aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.523417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d528b0d-fa16-4232-a6c2-d00cf83d59aa admin admin] PATH_INFO: `/v3/projects/2eb6a7e2d5d4417c8485e2675eab521f/users/eac479fab6e84174857d9bea3be6f423/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.528287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42c58d-966c-4bf5-829c-3c1749068b57 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.534579 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded740cb-60b6-49bd-9d9c-021fe9539f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.535206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded740cb-60b6-49bd-9d9c-021fe9539f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.535487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded740cb-60b6-49bd-9d9c-021fe9539f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.535749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded740cb-60b6-49bd-9d9c-021fe9539f62 admin admin] PATH_INFO: `/v3/projects/4d362ff0a81d4a84950e1f9b3e856ac1/users/58a89d6843d34c37814ec5508a7f1da4/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.539486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d528b0d-fa16-4232-a6c2-d00cf83d59aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb6a7e2d5d4417c8485e2675eab521f, user_id=eac479fab6e84174857d9bea3be6f423, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.542157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d528b0d-fa16-4232-a6c2-d00cf83d59aa admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.551022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded740cb-60b6-49bd-9d9c-021fe9539f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d362ff0a81d4a84950e1f9b3e856ac1, user_id=58a89d6843d34c37814ec5508a7f1da4, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.553738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded740cb-60b6-49bd-9d9c-021fe9539f62 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.705257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 790/1599] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:28 2022] PUT /identity/v3/projects/2eb6a7e2d5d4417c8485e2675eab521f/users/eac479fab6e84174857d9bea3be6f423/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:28.706299 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d528b0d-fa16-4232-a6c2-d00cf83d59aa admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.730160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 810/1600] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:28 2022] PUT /identity/v3/projects/4d362ff0a81d4a84950e1f9b3e856ac1/users/58a89d6843d34c37814ec5508a7f1da4/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:28.731000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded740cb-60b6-49bd-9d9c-021fe9539f62 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.772435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d528b0d-fa16-4232-a6c2-d00cf83d59aa admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.794418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded740cb-60b6-49bd-9d9c-021fe9539f62 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.797568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:28.798991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08fdc9-d0a6-4860-afa1-691a7dd6a42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.799586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08fdc9-d0a6-4860-afa1-691a7dd6a42c admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.799864 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08fdc9-d0a6-4860-afa1-691a7dd6a42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.800161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08fdc9-d0a6-4860-afa1-691a7dd6a42c admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.800801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08fdc9-d0a6-4860-afa1-691a7dd6a42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.802381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08fdc9-d0a6-4860-afa1-691a7dd6a42c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.812333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 811/1601] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:28.813121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08fdc9-d0a6-4860-afa1-691a7dd6a42c admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.825015 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08fdc9-d0a6-4860-afa1-691a7dd6a42c admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:28.829526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090329e-614f-464c-964f-87ae842892fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.829942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb81336-c205-4efd-a903-861b4e480874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:28.830162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090329e-614f-464c-964f-87ae842892fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.830436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090329e-614f-464c-964f-87ae842892fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.830596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb81336-c205-4efd-a903-861b4e480874 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:28.830788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090329e-614f-464c-964f-87ae842892fb admin admin] PATH_INFO: `/v3/projects/eb2b490782304c1f8b5a617117f29023/users/5e60eebf27fa4ba2825c010710d0ba0c/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.830894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb81336-c205-4efd-a903-861b4e480874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:28.831131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb81336-c205-4efd-a903-861b4e480874 admin admin] PATH_INFO: `/v3/projects/cc785435a1794272b4b96620abbcf412/users/becdc04dc32a469c89bca633b4173162/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:28.841915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:28.845664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090329e-614f-464c-964f-87ae842892fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2b490782304c1f8b5a617117f29023, user_id=5e60eebf27fa4ba2825c010710d0ba0c, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.845802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb81336-c205-4efd-a903-861b4e480874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc785435a1794272b4b96620abbcf412, user_id=becdc04dc32a469c89bca633b4173162, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:28.848308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090329e-614f-464c-964f-87ae842892fb admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.848440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb81336-c205-4efd-a903-861b4e480874 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:28.927252 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 812/1602] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:28 2022] PUT /identity/v3/projects/eb2b490782304c1f8b5a617117f29023/users/5e60eebf27fa4ba2825c010710d0ba0c/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:28.928142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090329e-614f-464c-964f-87ae842892fb admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.950685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 791/1603] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:28 2022] PUT /identity/v3/projects/cc785435a1794272b4b96620abbcf412/users/becdc04dc32a469c89bca633b4173162/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:28.951772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb81336-c205-4efd-a903-861b4e480874 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:28.990696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090329e-614f-464c-964f-87ae842892fb admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:29.023402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb81336-c205-4efd-a903-861b4e480874 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:29.028989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fe6e0-f8bb-43d2-b7e6-31f20d0577fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:29.029621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fe6e0-f8bb-43d2-b7e6-31f20d0577fb service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.029896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fe6e0-f8bb-43d2-b7e6-31f20d0577fb service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.030168 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fe6e0-f8bb-43d2-b7e6-31f20d0577fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.047668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11f85f-d458-41bd-babd-b37d51fd72e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:29.048374 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11f85f-d458-41bd-babd-b37d51fd72e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.048655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11f85f-d458-41bd-babd-b37d51fd72e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.048932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11f85f-d458-41bd-babd-b37d51fd72e9 admin admin] PATH_INFO: `/v3/projects/f625a04ba0b34478b5fef33dc7fad0e5/users/11a28894c38b4aeebeadc4f42908af46/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.063209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11f85f-d458-41bd-babd-b37d51fd72e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f625a04ba0b34478b5fef33dc7fad0e5, user_id=11a28894c38b4aeebeadc4f42908af46, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:29.065876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11f85f-d458-41bd-babd-b37d51fd72e9 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:29.086541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fe6e0-f8bb-43d2-b7e6-31f20d0577fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:29.088551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fe6e0-f8bb-43d2-b7e6-31f20d0577fb service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:29.096872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 792/1604] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:29.097615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fe6e0-f8bb-43d2-b7e6-31f20d0577fb service nova] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:29.107190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fe6e0-f8bb-43d2-b7e6-31f20d0577fb service nova] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:29.112082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1c7ae-218d-4bed-a50e-dbc8c8210b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:29.112337 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1c7ae-218d-4bed-a50e-dbc8c8210b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.112611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1c7ae-218d-4bed-a50e-dbc8c8210b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.112877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1c7ae-218d-4bed-a50e-dbc8c8210b19 admin admin] PATH_INFO: `/v3/projects/f78bad19f3c641868a1b32927d8b7da4/users/7f7372bb4495486a8fbd7332e9dffa34/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.128358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1c7ae-218d-4bed-a50e-dbc8c8210b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78bad19f3c641868a1b32927d8b7da4, user_id=7f7372bb4495486a8fbd7332e9dffa34, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:29.131058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1c7ae-218d-4bed-a50e-dbc8c8210b19 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:29.134017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 813/1605] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:28 2022] PUT /identity/v3/projects/f625a04ba0b34478b5fef33dc7fad0e5/users/11a28894c38b4aeebeadc4f42908af46/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:29.135474 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8182570-bb4d-4828-bee4-67e3e0683f3e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.135913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8182570-bb4d-4828-bee4-67e3e0683f3e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.136215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8182570-bb4d-4828-bee4-67e3e0683f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.155847 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b8182570-bb4d-4828-bee4-67e3e0683f3e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:29.157490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b8182570-bb4d-4828-bee4-67e3e0683f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:29.204365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 793/1606] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:29 2022] PUT /identity/v3/projects/f78bad19f3c641868a1b32927d8b7da4/users/7f7372bb4495486a8fbd7332e9dffa34/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:29.205776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682213bb-064c-4970-a71c-e8cec03d5348 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.206161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682213bb-064c-4970-a71c-e8cec03d5348 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.206559 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682213bb-064c-4970-a71c-e8cec03d5348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.227632 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-682213bb-064c-4970-a71c-e8cec03d5348 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:29.228597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 814/1607] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:29.229257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8182570-bb4d-4828-bee4-67e3e0683f3e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:29.233390 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-682213bb-064c-4970-a71c-e8cec03d5348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:29.239766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8182570-bb4d-4828-bee4-67e3e0683f3e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:29.253597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:29.258340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:29.298982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81a198-d1f6-44af-ba7c-642a27bd8e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:29.299650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a198-d1f6-44af-ba7c-642a27bd8e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.299932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a198-d1f6-44af-ba7c-642a27bd8e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.300236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a198-d1f6-44af-ba7c-642a27bd8e42 admin admin] PATH_INFO: `/v3/projects/3b40ed66232b4e99abf1107009fcd9f9/users/f040e47e66d145589b4233fe98c93507/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.302731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 794/1608] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:29.308249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55bd51-64ab-4688-aff6-0c2ce31ef838 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.308539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55bd51-64ab-4688-aff6-0c2ce31ef838 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.308819 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55bd51-64ab-4688-aff6-0c2ce31ef838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.318162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81a198-d1f6-44af-ba7c-642a27bd8e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b40ed66232b4e99abf1107009fcd9f9, user_id=f040e47e66d145589b4233fe98c93507, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:29.321015 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81a198-d1f6-44af-ba7c-642a27bd8e42 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:29.339520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-aa55bd51-64ab-4688-aff6-0c2ce31ef838 None None] MFA Rules not processed for user `5e60eebf27fa4ba2825c010710d0ba0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:29.340880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-aa55bd51-64ab-4688-aff6-0c2ce31ef838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:29.400941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 815/1609] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:29 2022] PUT /identity/v3/projects/3b40ed66232b4e99abf1107009fcd9f9/users/f040e47e66d145589b4233fe98c93507/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:29.400941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c78b70-fa91-4b57-8fc6-a2126da5f2dc None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.400941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c78b70-fa91-4b57-8fc6-a2126da5f2dc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.400941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c78b70-fa91-4b57-8fc6-a2126da5f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.406597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 795/1610] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:29.408616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b182-a566-474d-a65f-5f2ebb399d96 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.408616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b182-a566-474d-a65f-5f2ebb399d96 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.408616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b182-a566-474d-a65f-5f2ebb399d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.422487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-05c78b70-fa91-4b57-8fc6-a2126da5f2dc None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:29.423707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-05c78b70-fa91-4b57-8fc6-a2126da5f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:29.436345 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6ee6b182-a566-474d-a65f-5f2ebb399d96 None None] MFA Rules not processed for user `11a28894c38b4aeebeadc4f42908af46`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:29.437678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6ee6b182-a566-474d-a65f-5f2ebb399d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:29.484791 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 816/1611] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:29.486167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd2c34-4bff-43ca-b4d4-7a34500cd526 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.486449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd2c34-4bff-43ca-b4d4-7a34500cd526 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.486716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd2c34-4bff-43ca-b4d4-7a34500cd526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.510465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 796/1612] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:29.511691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6b182-a566-474d-a65f-5f2ebb399d96 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:29.514162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-60bd2c34-4bff-43ca-b4d4-7a34500cd526 None None] MFA Rules not processed for user `7f7372bb4495486a8fbd7332e9dffa34`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:29.515361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-60bd2c34-4bff-43ca-b4d4-7a34500cd526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:29.561029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:29.572026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6b182-a566-474d-a65f-5f2ebb399d96 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:29.575713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02715a65-d68b-46e9-9c86-548d1a4eb711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:29.576358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02715a65-d68b-46e9-9c86-548d1a4eb711 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.576640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02715a65-d68b-46e9-9c86-548d1a4eb711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.576913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02715a65-d68b-46e9-9c86-548d1a4eb711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.582226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 817/1613] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:29.583071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd2c34-4bff-43ca-b4d4-7a34500cd526 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:29.586911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02715a65-d68b-46e9-9c86-548d1a4eb711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:29.588445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02715a65-d68b-46e9-9c86-548d1a4eb711 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:29.592454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd2c34-4bff-43ca-b4d4-7a34500cd526 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:29.596184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288ed63-251e-4964-9a3a-26cc054022e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:29.596803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288ed63-251e-4964-9a3a-26cc054022e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.597080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288ed63-251e-4964-9a3a-26cc054022e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.597351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288ed63-251e-4964-9a3a-26cc054022e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.598900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 797/1614] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:29.600404 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de4fa-32bc-437e-a354-3921498451ec None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.600706 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de4fa-32bc-437e-a354-3921498451ec None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.601051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de4fa-32bc-437e-a354-3921498451ec None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.602365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 798/1615] 10.222.0.33 () {54 vars in 912 bytes} [Tue Oct 4 10:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:34:29.607506 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288ed63-251e-4964-9a3a-26cc054022e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:29.607840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ca217-9795-42db-8707-6ce9c37a5f77 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.608230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ca217-9795-42db-8707-6ce9c37a5f77 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.608417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ca217-9795-42db-8707-6ce9c37a5f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.608967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288ed63-251e-4964-9a3a-26cc054022e5 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:29.620067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 818/1616] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:29.621075 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288ed63-251e-4964-9a3a-26cc054022e5 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:29.630006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9b5ca217-9795-42db-8707-6ce9c37a5f77 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:29.631142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288ed63-251e-4964-9a3a-26cc054022e5 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:29.631303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9b5ca217-9795-42db-8707-6ce9c37a5f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:29.636397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1ba4a-13a4-43e9-93dc-4dc26c397b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:29.637115 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1ba4a-13a4-43e9-93dc-4dc26c397b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.637397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1ba4a-13a4-43e9-93dc-4dc26c397b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.637669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1ba4a-13a4-43e9-93dc-4dc26c397b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.638295 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1ba4a-13a4-43e9-93dc-4dc26c397b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:29.640958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 799/1617] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:29.641506 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1ba4a-13a4-43e9-93dc-4dc26c397b84 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:29.642198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ca217-9795-42db-8707-6ce9c37a5f77 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:29.655294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ca217-9795-42db-8707-6ce9c37a5f77 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:29.659518 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7584a-9577-4540-bb7e-0e35eca0c3cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:29.660190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7584a-9577-4540-bb7e-0e35eca0c3cc service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.660466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7584a-9577-4540-bb7e-0e35eca0c3cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.660737 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7584a-9577-4540-bb7e-0e35eca0c3cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.669971 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7584a-9577-4540-bb7e-0e35eca0c3cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:29.671382 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7584a-9577-4540-bb7e-0e35eca0c3cc service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:29.680803 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 800/1618] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:29.681664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7584a-9577-4540-bb7e-0e35eca0c3cc service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:29.735730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7584a-9577-4540-bb7e-0e35eca0c3cc service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:29.739623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539cda5-411c-4058-83d8-67aab55b8242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:29.740283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539cda5-411c-4058-83d8-67aab55b8242 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.740568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539cda5-411c-4058-83d8-67aab55b8242 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.740841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539cda5-411c-4058-83d8-67aab55b8242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.744999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:29.750331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539cda5-411c-4058-83d8-67aab55b8242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:29.751821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539cda5-411c-4058-83d8-67aab55b8242 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:29.759031 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 819/1619] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:29 2022] POST /identity/v3/projects => generated 403 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:29.760794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1ba4a-13a4-43e9-93dc-4dc26c397b84 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:29.764971 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 801/1620] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:29.766223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c05dc-9c0b-44d3-b2a6-bc6452f8882e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.766865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c05dc-9c0b-44d3-b2a6-bc6452f8882e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.767289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c05dc-9c0b-44d3-b2a6-bc6452f8882e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.789846 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-7e4c05dc-9c0b-44d3-b2a6-bc6452f8882e None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:29.791223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7e4c05dc-9c0b-44d3-b2a6-bc6452f8882e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:29.849042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1ba4a-13a4-43e9-93dc-4dc26c397b84 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:29.856146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83dd74-0a4c-49dd-be55-398d6b74b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:29.856852 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83dd74-0a4c-49dd-be55-398d6b74b6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.857372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83dd74-0a4c-49dd-be55-398d6b74b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.857507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83dd74-0a4c-49dd-be55-398d6b74b6c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.858203 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83dd74-0a4c-49dd-be55-398d6b74b6c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:29.860603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83dd74-0a4c-49dd-be55-398d6b74b6c6 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:29.887660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 802/1621] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:29.888573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c05dc-9c0b-44d3-b2a6-bc6452f8882e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:29.962235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c05dc-9c0b-44d3-b2a6-bc6452f8882e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:29.966818 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac528f-d343-445d-a894-3add15b60da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:29.967693 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac528f-d343-445d-a894-3add15b60da0 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:29.967832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac528f-d343-445d-a894-3add15b60da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:29.968050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 820/1622] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:29 2022] POST /identity/v3/projects => generated 359 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:29.968171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac528f-d343-445d-a894-3add15b60da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:29.969565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83dd74-0a4c-49dd-be55-398d6b74b6c6 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:29.982641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac528f-d343-445d-a894-3add15b60da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:29.984429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac528f-d343-445d-a894-3add15b60da0 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:30.000795 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 803/1623] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:30.003483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac528f-d343-445d-a894-3add15b60da0 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:30.014616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:30.067123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83dd74-0a4c-49dd-be55-398d6b74b6c6 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:30.073003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123a54d-605d-4244-81df-c4f9bcda88bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:30.078158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a54d-605d-4244-81df-c4f9bcda88bc admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.078158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a54d-605d-4244-81df-c4f9bcda88bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.078158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a54d-605d-4244-81df-c4f9bcda88bc admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.078158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123a54d-605d-4244-81df-c4f9bcda88bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:30.078567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123a54d-605d-4244-81df-c4f9bcda88bc admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:30.099187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac528f-d343-445d-a894-3add15b60da0 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:30.150763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14743599-7e2e-4ad2-b87e-ea629a165f67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:30.151368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14743599-7e2e-4ad2-b87e-ea629a165f67 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.151642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14743599-7e2e-4ad2-b87e-ea629a165f67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.151912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14743599-7e2e-4ad2-b87e-ea629a165f67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.178957 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 821/1624] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:29 2022] POST /identity/v3/users => generated 308 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:30.179865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123a54d-605d-4244-81df-c4f9bcda88bc admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:30.213406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123a54d-605d-4244-81df-c4f9bcda88bc admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:30.222051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7c25d-c8c2-440d-920b-451e7500f7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:30.222867 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7c25d-c8c2-440d-920b-451e7500f7ac admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.223305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7c25d-c8c2-440d-920b-451e7500f7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.223722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7c25d-c8c2-440d-920b-451e7500f7ac admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.224558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7c25d-c8c2-440d-920b-451e7500f7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:30.227704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7c25d-c8c2-440d-920b-451e7500f7ac admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:30.232676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14743599-7e2e-4ad2-b87e-ea629a165f67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:30.234106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14743599-7e2e-4ad2-b87e-ea629a165f67 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:30.245938 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 804/1625] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:30.248244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14743599-7e2e-4ad2-b87e-ea629a165f67 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:30.258632 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14743599-7e2e-4ad2-b87e-ea629a165f67 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:30.263781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb4714-e25e-46b0-85c0-9d41b8853d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:30.264357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb4714-e25e-46b0-85c0-9d41b8853d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.264950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb4714-e25e-46b0-85c0-9d41b8853d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.265056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb4714-e25e-46b0-85c0-9d41b8853d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.265695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb4714-e25e-46b0-85c0-9d41b8853d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:30.267289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb4714-e25e-46b0-85c0-9d41b8853d0b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:30.282173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 805/1626] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:30.283437 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb4714-e25e-46b0-85c0-9d41b8853d0b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:30.296235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb4714-e25e-46b0-85c0-9d41b8853d0b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:30.306221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28761ae-5c46-401b-bdbc-d2497c721b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:30.306221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28761ae-5c46-401b-bdbc-d2497c721b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.306221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28761ae-5c46-401b-bdbc-d2497c721b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.306221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28761ae-5c46-401b-bdbc-d2497c721b17 admin admin] PATH_INFO: `/v3/projects/d17af63858e040efbaf7b47f1a338ed9/users/e64a304198bf488a96ea8a125c58871a/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.321719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28761ae-5c46-401b-bdbc-d2497c721b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17af63858e040efbaf7b47f1a338ed9, user_id=e64a304198bf488a96ea8a125c58871a, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:30.324740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 822/1627] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:30 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:30.325285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28761ae-5c46-401b-bdbc-d2497c721b17 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:30.330406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7c25d-c8c2-440d-920b-451e7500f7ac admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:30.342678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7c25d-c8c2-440d-920b-451e7500f7ac admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:30.348242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac304a7-a218-4ba1-b283-9bffb57a7ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:30.349062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac304a7-a218-4ba1-b283-9bffb57a7ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.349647 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac304a7-a218-4ba1-b283-9bffb57a7ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.350103 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac304a7-a218-4ba1-b283-9bffb57a7ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.351460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac304a7-a218-4ba1-b283-9bffb57a7ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:30.353468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac304a7-a218-4ba1-b283-9bffb57a7ab5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:30.369428 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 823/1628] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:30.370995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac304a7-a218-4ba1-b283-9bffb57a7ab5 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:30.383330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac304a7-a218-4ba1-b283-9bffb57a7ab5 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:30.388500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98726a-8b05-47ee-b044-8b9eee0b4970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:30.389205 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98726a-8b05-47ee-b044-8b9eee0b4970 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.389482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98726a-8b05-47ee-b044-8b9eee0b4970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.389752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98726a-8b05-47ee-b044-8b9eee0b4970 admin admin] PATH_INFO: `/v3/projects/ac611851c08e48779d4aad5f7dc4c05d/users/7e8f35badd3d4873ab85e33828bf502d/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.406044 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 806/1629] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:30 2022] PUT /identity/v3/projects/d17af63858e040efbaf7b47f1a338ed9/users/e64a304198bf488a96ea8a125c58871a/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:34:30.410125 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28761ae-5c46-401b-bdbc-d2497c721b17 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:30.429661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98726a-8b05-47ee-b044-8b9eee0b4970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac611851c08e48779d4aad5f7dc4c05d, user_id=7e8f35badd3d4873ab85e33828bf502d, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:30.432347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98726a-8b05-47ee-b044-8b9eee0b4970 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:30.461206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:30.528225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28761ae-5c46-401b-bdbc-d2497c721b17 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:30.535912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa0faf-f32f-4d3b-bc34-baaef35ceb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:30.536609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0faf-f32f-4d3b-bc34-baaef35ceb26 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.536948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0faf-f32f-4d3b-bc34-baaef35ceb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.537226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0faf-f32f-4d3b-bc34-baaef35ceb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.537921 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa0faf-f32f-4d3b-bc34-baaef35ceb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:30.540934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa0faf-f32f-4d3b-bc34-baaef35ceb26 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:30.547433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 824/1630] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:30 2022] PUT /identity/v3/projects/ac611851c08e48779d4aad5f7dc4c05d/users/7e8f35badd3d4873ab85e33828bf502d/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:34:30.552078 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98726a-8b05-47ee-b044-8b9eee0b4970 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:30.558559 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 807/1631] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:34:30.559656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa0faf-f32f-4d3b-bc34-baaef35ceb26 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:30.572903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa0faf-f32f-4d3b-bc34-baaef35ceb26 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:30.584282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:30.653489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98726a-8b05-47ee-b044-8b9eee0b4970 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:30.659715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33cbf5-a88f-40cb-a5f8-4fb182b63673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:30.660636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33cbf5-a88f-40cb-a5f8-4fb182b63673 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.661109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33cbf5-a88f-40cb-a5f8-4fb182b63673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.661555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33cbf5-a88f-40cb-a5f8-4fb182b63673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.662368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33cbf5-a88f-40cb-a5f8-4fb182b63673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:30.665055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33cbf5-a88f-40cb-a5f8-4fb182b63673 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:30.677286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 825/1632] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:34:30.682546 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33cbf5-a88f-40cb-a5f8-4fb182b63673 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:30.692582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926c9fe-75f0-41b4-9a77-459d847fc3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:30.695162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926c9fe-75f0-41b4-9a77-459d847fc3ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.695746 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926c9fe-75f0-41b4-9a77-459d847fc3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.695931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33cbf5-a88f-40cb-a5f8-4fb182b63673 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:30.696755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926c9fe-75f0-41b4-9a77-459d847fc3ef admin admin] PATH_INFO: `/v3/projects/d17af63858e040efbaf7b47f1a338ed9/users/e64a304198bf488a96ea8a125c58871a/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.700062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926c9fe-75f0-41b4-9a77-459d847fc3ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17af63858e040efbaf7b47f1a338ed9, user_id=e64a304198bf488a96ea8a125c58871a, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:30.702065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e5933-bd0e-48fb-b545-86ba593c5850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:30.704526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e5933-bd0e-48fb-b545-86ba593c5850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.704526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e5933-bd0e-48fb-b545-86ba593c5850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.704526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e5933-bd0e-48fb-b545-86ba593c5850 admin admin] PATH_INFO: `/v3/projects/ac611851c08e48779d4aad5f7dc4c05d/users/7e8f35badd3d4873ab85e33828bf502d/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.705399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926c9fe-75f0-41b4-9a77-459d847fc3ef admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:30.705800 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e5933-bd0e-48fb-b545-86ba593c5850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac611851c08e48779d4aad5f7dc4c05d, user_id=7e8f35badd3d4873ab85e33828bf502d, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:30.709015 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e5933-bd0e-48fb-b545-86ba593c5850 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:30.721202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 808/1633] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:30 2022] PUT /identity/v3/projects/d17af63858e040efbaf7b47f1a338ed9/users/e64a304198bf488a96ea8a125c58871a/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:30.738761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 826/1634] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:30 2022] PUT /identity/v3/projects/ac611851c08e48779d4aad5f7dc4c05d/users/7e8f35badd3d4873ab85e33828bf502d/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:30.739003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01937c84-f278-40d5-b951-7aed4ccc1074 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.739003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01937c84-f278-40d5-b951-7aed4ccc1074 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.739003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01937c84-f278-40d5-b951-7aed4ccc1074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.741839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85490d6-72d0-4192-a32a-f5b1abd8eb3e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:30.742273 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85490d6-72d0-4192-a32a-f5b1abd8eb3e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:30.742650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85490d6-72d0-4192-a32a-f5b1abd8eb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:30.781102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-01937c84-f278-40d5-b951-7aed4ccc1074 None None] MFA Rules not processed for user `e64a304198bf488a96ea8a125c58871a`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:30.782632 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-01937c84-f278-40d5-b951-7aed4ccc1074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:30.783513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a85490d6-72d0-4192-a32a-f5b1abd8eb3e None None] MFA Rules not processed for user `7e8f35badd3d4873ab85e33828bf502d`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:30.785505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a85490d6-72d0-4192-a32a-f5b1abd8eb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:30.873593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 827/1635] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:30.926255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 809/1636] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:30 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:30.957247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85490d6-72d0-4192-a32a-f5b1abd8eb3e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:31.019475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85490d6-72d0-4192-a32a-f5b1abd8eb3e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:31.024760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b331f42-a48b-496e-9388-eefeebe94908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:31.025380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b331f42-a48b-496e-9388-eefeebe94908 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:31.025904 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b331f42-a48b-496e-9388-eefeebe94908 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:31.025904 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b331f42-a48b-496e-9388-eefeebe94908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:31.036901 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b331f42-a48b-496e-9388-eefeebe94908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:31.039503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b331f42-a48b-496e-9388-eefeebe94908 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:31.050075 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 828/1637] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:31.431586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01937c84-f278-40d5-b951-7aed4ccc1074 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:31.431586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01937c84-f278-40d5-b951-7aed4ccc1074 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:31.431586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834439c3-26c7-4b1b-8490-bcbd72a60a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:31.431586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834439c3-26c7-4b1b-8490-bcbd72a60a83 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:31.433164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834439c3-26c7-4b1b-8490-bcbd72a60a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:31.433164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834439c3-26c7-4b1b-8490-bcbd72a60a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:31.433164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834439c3-26c7-4b1b-8490-bcbd72a60a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:31.433164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834439c3-26c7-4b1b-8490-bcbd72a60a83 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:31.433164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 810/1638] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:31 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:31.645348 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b331f42-a48b-496e-9388-eefeebe94908 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:31.657595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b331f42-a48b-496e-9388-eefeebe94908 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:31.664876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f0088-6e09-45c6-8699-6dd259bd57b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:31.665770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f0088-6e09-45c6-8699-6dd259bd57b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:31.666325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f0088-6e09-45c6-8699-6dd259bd57b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:31.666732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f0088-6e09-45c6-8699-6dd259bd57b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:31.713880 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:31.751575 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f0088-6e09-45c6-8699-6dd259bd57b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:31.753322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f0088-6e09-45c6-8699-6dd259bd57b7 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:31.764676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 829/1639] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:31.863614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834439c3-26c7-4b1b-8490-bcbd72a60a83 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:31.899051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:31.977760 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834439c3-26c7-4b1b-8490-bcbd72a60a83 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:31.987671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:31.988570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:31.988911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:31.989285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] PATH_INFO: `/v3/users/5e60eebf27fa4ba2825c010710d0ba0c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:31.993779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e60eebf27fa4ba2825c010710d0ba0c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:31.994914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: WARNING py.warnings [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:34:31.994914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: warnings.warn(msg) Oct 04 10:34:31.994914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: Oct 04 10:34:31.998637 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:32.093302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dde72-83e4-46c9-9cac-8257589fe4bd None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:32.094250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dde72-83e4-46c9-9cac-8257589fe4bd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:32.094851 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dde72-83e4-46c9-9cac-8257589fe4bd None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:32.096827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 830/1640] 10.222.0.33 () {54 vars in 961 bytes} [Tue Oct 4 10:34:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:34:32.107300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddb25d-aa5b-4e8b-980c-d3b75aab99ce None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:32.107595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddb25d-aa5b-4e8b-980c-d3b75aab99ce None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:32.107844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddb25d-aa5b-4e8b-980c-d3b75aab99ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:32.132690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a2ddb25d-aa5b-4e8b-980c-d3b75aab99ce None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:32.134106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a2ddb25d-aa5b-4e8b-980c-d3b75aab99ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:32.224039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 831/1641] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Oct 4 10:34:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:32.232123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065ea78-aaa0-41eb-b3b8-46df6434bae4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:32.232539 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065ea78-aaa0-41eb-b3b8-46df6434bae4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:32.232935 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065ea78-aaa0-41eb-b3b8-46df6434bae4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:32.235020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 832/1642] 10.222.0.33 () {54 vars in 912 bytes} [Tue Oct 4 10:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:34:32.240759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87b3c-2f11-4f7d-89dc-1f23c68c5f5c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:32.241031 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87b3c-2f11-4f7d-89dc-1f23c68c5f5c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:32.241438 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87b3c-2f11-4f7d-89dc-1f23c68c5f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:32.284604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fcb87b3c-2f11-4f7d-89dc-1f23c68c5f5c None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:32.286058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fcb87b3c-2f11-4f7d-89dc-1f23c68c5f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:32.321425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e60eebf27fa4ba2825c010710d0ba0c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:32.335622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 833/1643] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:34:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:34:32.342910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb87b3c-2f11-4f7d-89dc-1f23c68c5f5c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:32.359823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e60eebf27fa4ba2825c010710d0ba0c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:32.360594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb87b3c-2f11-4f7d-89dc-1f23c68c5f5c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:32.360703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e60eebf27fa4ba2825c010710d0ba0c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:32.367375 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47710b-cfd0-4b9d-bf33-815de0e40778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:32.368228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47710b-cfd0-4b9d-bf33-815de0e40778 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:32.368638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47710b-cfd0-4b9d-bf33-815de0e40778 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:32.369038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47710b-cfd0-4b9d-bf33-815de0e40778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:32.371447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9e47710b-cfd0-4b9d-bf33-815de0e40778 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:32.390601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47710b-cfd0-4b9d-bf33-815de0e40778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:32.393169 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47710b-cfd0-4b9d-bf33-815de0e40778 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:32.410526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 834/1644] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:32.473313 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e60eebf27fa4ba2825c010710d0ba0c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:32.556612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e60eebf27fa4ba2825c010710d0ba0c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:32.563783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 811/1645] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:34:31 2022] DELETE /identity/v3/users/5e60eebf27fa4ba2825c010710d0ba0c => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:32.568621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452e495-9fd1-4a2d-a775-7e7220449d92 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:32.569091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452e495-9fd1-4a2d-a775-7e7220449d92 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:32.569621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452e495-9fd1-4a2d-a775-7e7220449d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:32.616600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f452e495-9fd1-4a2d-a775-7e7220449d92 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:32.620220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f452e495-9fd1-4a2d-a775-7e7220449d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:32.698020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 835/1646] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:34:32.719916 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:32.722175 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:32.792610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5baf5-45a9-4010-a6a2-bb054254329b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:32.797433 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b228ff-5086-410e-b430-a04438565897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:32.797768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b228ff-5086-410e-b430-a04438565897 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:32.798123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b228ff-5086-410e-b430-a04438565897 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:32.798399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b228ff-5086-410e-b430-a04438565897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:32.808759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b228ff-5086-410e-b430-a04438565897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:32.810205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b228ff-5086-410e-b430-a04438565897 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:32.821911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 812/1647] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:33.768017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452e495-9fd1-4a2d-a775-7e7220449d92 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:33.769513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f452e495-9fd1-4a2d-a775-7e7220449d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:33.781987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452e495-9fd1-4a2d-a775-7e7220449d92 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:33.786853 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:33.787493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:33.787772 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:33.788089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] PATH_INFO: `/v3/projects/eb2b490782304c1f8b5a617117f29023` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:33.789286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2b490782304c1f8b5a617117f29023)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:33.790303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: WARNING py.warnings [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 10:34:33.790303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: warnings.warn(msg) Oct 04 10:34:33.790303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: Oct 04 10:34:33.791491 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:33.984841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:34.034520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2b490782304c1f8b5a617117f29023', 'request_id': 'req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.046288 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2b490782304c1f8b5a617117f29023', 'request_id': 'req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.077126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b228ff-5086-410e-b430-a04438565897 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:34.080770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f3b228ff-5086-410e-b430-a04438565897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:34.104687 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b228ff-5086-410e-b430-a04438565897 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:34.151441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2b490782304c1f8b5a617117f29023', 'request_id': 'req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.182104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] The token cache is being invalidate because project eb2b490782304c1f8b5a617117f29023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:34:34.182398 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.183888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.188833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 836/1648] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:34:33 2022] DELETE /identity/v3/projects/eb2b490782304c1f8b5a617117f29023 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:34.190295 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:34.191390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:34.193950 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:34.209821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe1ab2-2b8c-436b-b102-4ef984dd3bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:34.211075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe1ab2-2b8c-436b-b102-4ef984dd3bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:34.212396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe1ab2-2b8c-436b-b102-4ef984dd3bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:34.212797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe1ab2-2b8c-436b-b102-4ef984dd3bfe admin admin] PATH_INFO: `/v3/users/65fa45f900c346ff8a6fb3e7dde4d489` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:34.214780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe1ab2-2b8c-436b-b102-4ef984dd3bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=65fa45f900c346ff8a6fb3e7dde4d489)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:34.217265 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe1ab2-2b8c-436b-b102-4ef984dd3bfe admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:34.312311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcea208-d4bb-479a-9f72-cba5fa8a0c1f admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:34.318848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:34.319542 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:34.319812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:34.320121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] PATH_INFO: `/v3/users/e64a304198bf488a96ea8a125c58871a` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:34.322687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64a304198bf488a96ea8a125c58871a)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:34.325222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:34.462967 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c7fe1ab2-2b8c-436b-b102-4ef984dd3bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65fa45f900c346ff8a6fb3e7dde4d489'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.470070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c7fe1ab2-2b8c-436b-b102-4ef984dd3bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65fa45f900c346ff8a6fb3e7dde4d489'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.470774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c7fe1ab2-2b8c-436b-b102-4ef984dd3bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65fa45f900c346ff8a6fb3e7dde4d489'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.544833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64a304198bf488a96ea8a125c58871a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.557753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64a304198bf488a96ea8a125c58871a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.559642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64a304198bf488a96ea8a125c58871a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.561271 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64a304198bf488a96ea8a125c58871a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.567141 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c7fe1ab2-2b8c-436b-b102-4ef984dd3bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65fa45f900c346ff8a6fb3e7dde4d489'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.599215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c7fe1ab2-2b8c-436b-b102-4ef984dd3bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65fa45f900c346ff8a6fb3e7dde4d489'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.615740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 813/1649] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:34:34 2022] DELETE /identity/v3/users/65fa45f900c346ff8a6fb3e7dde4d489 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:34:34.618214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dece3-1910-42ee-bc5a-276adcf219d8 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:34.618507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dece3-1910-42ee-bc5a-276adcf219d8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:34.618785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dece3-1910-42ee-bc5a-276adcf219d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:34.667344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64a304198bf488a96ea8a125c58871a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:34.670344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f28dece3-1910-42ee-bc5a-276adcf219d8 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:34.671627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f28dece3-1910-42ee-bc5a-276adcf219d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:34.708044 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 837/1650] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:34:34 2022] DELETE /identity/v3/users/e64a304198bf488a96ea8a125c58871a => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:34.790122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 814/1651] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:34.809205 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:34.813667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:34.949318 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2e46d-6f9b-447a-b1b3-54fd58edcaae admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:34.953844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1846a-d7a9-4a16-a547-ca6cf04f2a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:34.957438 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1846a-d7a9-4a16-a547-ca6cf04f2a89 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:34.957940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1846a-d7a9-4a16-a547-ca6cf04f2a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:34.965353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1846a-d7a9-4a16-a547-ca6cf04f2a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:35.215996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1846a-d7a9-4a16-a547-ca6cf04f2a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:35.217531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1846a-d7a9-4a16-a547-ca6cf04f2a89 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:35.254464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 838/1652] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:35.439035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:35.545450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dece3-1910-42ee-bc5a-276adcf219d8 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:35.548350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f28dece3-1910-42ee-bc5a-276adcf219d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:35.575651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dece3-1910-42ee-bc5a-276adcf219d8 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:35.592358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:35.594458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:35.594926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:35.598393 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e admin admin] PATH_INFO: `/v3/projects/d17af63858e040efbaf7b47f1a338ed9` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:35.601296 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17af63858e040efbaf7b47f1a338ed9)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:35.605993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:35.779764 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17af63858e040efbaf7b47f1a338ed9', 'request_id': 'req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:35.786783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17af63858e040efbaf7b47f1a338ed9', 'request_id': 'req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:35.801298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17af63858e040efbaf7b47f1a338ed9', 'request_id': 'req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:35.909388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e admin admin] The token cache is being invalidate because project d17af63858e040efbaf7b47f1a338ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:34:35.909695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:35.911317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-57ff3c9e-6281-4f23-b4e0-cdb511f8854e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:35.912934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 815/1653] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:34:35 2022] DELETE /identity/v3/projects/d17af63858e040efbaf7b47f1a338ed9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:35.918515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb493df-afb7-473d-b0c1-516883fc9c7b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:35.919435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb493df-afb7-473d-b0c1-516883fc9c7b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:35.920006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb493df-afb7-473d-b0c1-516883fc9c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:35.949214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-abb493df-afb7-473d-b0c1-516883fc9c7b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:35.950722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-abb493df-afb7-473d-b0c1-516883fc9c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:36.037937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 839/1654] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:36.047212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f1a80-b33d-4c76-b7c6-6bdbe5df202b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:36.047513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f1a80-b33d-4c76-b7c6-6bdbe5df202b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:36.047706 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f1a80-b33d-4c76-b7c6-6bdbe5df202b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:36.106083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-924f1a80-b33d-4c76-b7c6-6bdbe5df202b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:36.113424 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-924f1a80-b33d-4c76-b7c6-6bdbe5df202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:36.136751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 816/1655] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:36.142440 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb493df-afb7-473d-b0c1-516883fc9c7b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:36.166086 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb493df-afb7-473d-b0c1-516883fc9c7b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:36.190369 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f94f1e-b5f4-4e44-92df-d8b875a08a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:36.191063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f94f1e-b5f4-4e44-92df-d8b875a08a87 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:36.191340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f94f1e-b5f4-4e44-92df-d8b875a08a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:36.191614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f94f1e-b5f4-4e44-92df-d8b875a08a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:36.194669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f94f1e-b5f4-4e44-92df-d8b875a08a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:36.194984 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f94f1e-b5f4-4e44-92df-d8b875a08a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:36.200553 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f94f1e-b5f4-4e44-92df-d8b875a08a87 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:36.230533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 840/1656] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:36.233745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f1a80-b33d-4c76-b7c6-6bdbe5df202b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:36.249387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f1a80-b33d-4c76-b7c6-6bdbe5df202b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:36.262946 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6f584-42fe-4597-82ea-959b14d0c232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:36.263758 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6f584-42fe-4597-82ea-959b14d0c232 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:36.264070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6f584-42fe-4597-82ea-959b14d0c232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:36.264347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6f584-42fe-4597-82ea-959b14d0c232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:36.265008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6f584-42fe-4597-82ea-959b14d0c232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:36.268675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6f584-42fe-4597-82ea-959b14d0c232 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:36.362323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f94f1e-b5f4-4e44-92df-d8b875a08a87 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:36.364132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a9f94f1e-b5f4-4e44-92df-d8b875a08a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:36.390122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f94f1e-b5f4-4e44-92df-d8b875a08a87 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:36.400997 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6835d-285b-4eb2-a311-90f2f1c278ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:36.402018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6835d-285b-4eb2-a311-90f2f1c278ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:36.402518 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6835d-285b-4eb2-a311-90f2f1c278ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:36.402864 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6835d-285b-4eb2-a311-90f2f1c278ed admin admin] PATH_INFO: `/v3/users/7f7372bb4495486a8fbd7332e9dffa34` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:36.405532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6835d-285b-4eb2-a311-90f2f1c278ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7372bb4495486a8fbd7332e9dffa34)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:36.410460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6835d-285b-4eb2-a311-90f2f1c278ed admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:36.412579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 817/1657] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:36 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:36.418255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6f584-42fe-4597-82ea-959b14d0c232 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:36.433188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:36.532713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6f584-42fe-4597-82ea-959b14d0c232 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:36.540709 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed044a-38c5-426e-a5fb-b44caefd5d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:36.541657 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed044a-38c5-426e-a5fb-b44caefd5d18 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:36.542205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed044a-38c5-426e-a5fb-b44caefd5d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:36.542547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed044a-38c5-426e-a5fb-b44caefd5d18 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:36.543319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed044a-38c5-426e-a5fb-b44caefd5d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:36.545608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed044a-38c5-426e-a5fb-b44caefd5d18 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:36.634400 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-43b6835d-285b-4eb2-a311-90f2f1c278ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7372bb4495486a8fbd7332e9dffa34'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:36.643894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-43b6835d-285b-4eb2-a311-90f2f1c278ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7372bb4495486a8fbd7332e9dffa34'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:36.650766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-43b6835d-285b-4eb2-a311-90f2f1c278ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7372bb4495486a8fbd7332e9dffa34'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:36.651420 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-43b6835d-285b-4eb2-a311-90f2f1c278ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7372bb4495486a8fbd7332e9dffa34'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:36.662716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 818/1658] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:36 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:36.668041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed044a-38c5-426e-a5fb-b44caefd5d18 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:36.670669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-aeed044a-38c5-426e-a5fb-b44caefd5d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:36.688483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed044a-38c5-426e-a5fb-b44caefd5d18 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:36.693729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e73848-ee5f-40c3-9802-89daa536b763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:36.694373 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e73848-ee5f-40c3-9802-89daa536b763 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:36.694700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e73848-ee5f-40c3-9802-89daa536b763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:36.694976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e73848-ee5f-40c3-9802-89daa536b763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:36.695636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e73848-ee5f-40c3-9802-89daa536b763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:36.697311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e73848-ee5f-40c3-9802-89daa536b763 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:36.712237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 819/1659] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:34:36.713174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e73848-ee5f-40c3-9802-89daa536b763 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:36.724660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e73848-ee5f-40c3-9802-89daa536b763 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:36.733135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de1c72-e17e-487d-aae8-19a983ff8336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:36.733765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de1c72-e17e-487d-aae8-19a983ff8336 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:36.734047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de1c72-e17e-487d-aae8-19a983ff8336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:36.736489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de1c72-e17e-487d-aae8-19a983ff8336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:36.736489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de1c72-e17e-487d-aae8-19a983ff8336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:36.736991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de1c72-e17e-487d-aae8-19a983ff8336 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:36.744217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-43b6835d-285b-4eb2-a311-90f2f1c278ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7372bb4495486a8fbd7332e9dffa34'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:36.753022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 820/1660] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:36.757649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de1c72-e17e-487d-aae8-19a983ff8336 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:36.770121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de1c72-e17e-487d-aae8-19a983ff8336 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:36.776767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaf40b-ccea-4bb3-81ec-ee55d4b7bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:36.777965 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaf40b-ccea-4bb3-81ec-ee55d4b7bbf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:36.778438 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaf40b-ccea-4bb3-81ec-ee55d4b7bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:36.778993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaf40b-ccea-4bb3-81ec-ee55d4b7bbf1 admin admin] PATH_INFO: `/v3/projects/0b1416e20c584dd2b11f25ee9e0b5fd3/users/f738ceaeb2cc4c0e8f173db34f5e3e51/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:36.779098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 841/1661] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:34:36 2022] DELETE /identity/v3/users/7f7372bb4495486a8fbd7332e9dffa34 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:34:36.786244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e0133-7b6e-4b6e-988e-bc153f71841c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:36.786562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e0133-7b6e-4b6e-988e-bc153f71841c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:36.786843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e0133-7b6e-4b6e-988e-bc153f71841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:36.800150 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaf40b-ccea-4bb3-81ec-ee55d4b7bbf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1416e20c584dd2b11f25ee9e0b5fd3, user_id=f738ceaeb2cc4c0e8f173db34f5e3e51, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:36.807376 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaf40b-ccea-4bb3-81ec-ee55d4b7bbf1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:36.831300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-db7e0133-7b6e-4b6e-988e-bc153f71841c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:36.832222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-db7e0133-7b6e-4b6e-988e-bc153f71841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:36.977181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 842/1662] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:37.011388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 821/1663] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:36 2022] PUT /identity/v3/projects/0b1416e20c584dd2b11f25ee9e0b5fd3/users/f738ceaeb2cc4c0e8f173db34f5e3e51/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:34:37.021995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a032ca-2a33-450e-8fb5-ae3e058b7277 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:37.023330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a032ca-2a33-450e-8fb5-ae3e058b7277 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:37.023811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a032ca-2a33-450e-8fb5-ae3e058b7277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:37.027049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaf40b-ccea-4bb3-81ec-ee55d4b7bbf1 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:37.029246 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4bcaf40b-ccea-4bb3-81ec-ee55d4b7bbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:37.116401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-15a032ca-2a33-450e-8fb5-ae3e058b7277 None None] MFA Rules not processed for user `f738ceaeb2cc4c0e8f173db34f5e3e51`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:37.119194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-15a032ca-2a33-450e-8fb5-ae3e058b7277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:37.126024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaf40b-ccea-4bb3-81ec-ee55d4b7bbf1 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:37.131374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b29394-4fc1-4fec-9cc2-3e7fb4e4fde2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:37.133180 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b29394-4fc1-4fec-9cc2-3e7fb4e4fde2 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:37.133465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b29394-4fc1-4fec-9cc2-3e7fb4e4fde2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:37.133736 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b29394-4fc1-4fec-9cc2-3e7fb4e4fde2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:37.217039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 843/1664] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:37.222495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a032ca-2a33-450e-8fb5-ae3e058b7277 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:37.384192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b29394-4fc1-4fec-9cc2-3e7fb4e4fde2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:37.387124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b29394-4fc1-4fec-9cc2-3e7fb4e4fde2 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:37.397142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a032ca-2a33-450e-8fb5-ae3e058b7277 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:37.406743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abebe14-2ba8-4697-ae50-9874ff8e3423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:37.408306 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abebe14-2ba8-4697-ae50-9874ff8e3423 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:37.410897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abebe14-2ba8-4697-ae50-9874ff8e3423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:37.411348 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abebe14-2ba8-4697-ae50-9874ff8e3423 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:37.413854 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abebe14-2ba8-4697-ae50-9874ff8e3423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:37.420162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abebe14-2ba8-4697-ae50-9874ff8e3423 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:37.434323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 822/1665] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:34:37.572659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 844/1666] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:37 2022] POST /identity/v3/projects => generated 371 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:37.578976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b29394-4fc1-4fec-9cc2-3e7fb4e4fde2 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:37.597568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b29394-4fc1-4fec-9cc2-3e7fb4e4fde2 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:37.661289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:37.824606 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50eb8a-49ab-43ad-9dd6-264fe4c637c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:37.834867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50eb8a-49ab-43ad-9dd6-264fe4c637c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:37.835288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50eb8a-49ab-43ad-9dd6-264fe4c637c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:37.835572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50eb8a-49ab-43ad-9dd6-264fe4c637c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:37.836316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50eb8a-49ab-43ad-9dd6-264fe4c637c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:37.840883 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50eb8a-49ab-43ad-9dd6-264fe4c637c7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:38.032708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 823/1667] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:37 2022] POST /identity/v3/users => generated 292 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:38.036384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abebe14-2ba8-4697-ae50-9874ff8e3423 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:38.050580 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abebe14-2ba8-4697-ae50-9874ff8e3423 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:38.064056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa07150-a5b9-44bc-b03e-8113f505aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:38.064958 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa07150-a5b9-44bc-b03e-8113f505aee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:38.065382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa07150-a5b9-44bc-b03e-8113f505aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:38.065821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa07150-a5b9-44bc-b03e-8113f505aee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:38.066811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa07150-a5b9-44bc-b03e-8113f505aee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:38.071514 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa07150-a5b9-44bc-b03e-8113f505aee6 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:38.098966 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 845/1668] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:38.103680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50eb8a-49ab-43ad-9dd6-264fe4c637c7 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:38.116284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa07150-a5b9-44bc-b03e-8113f505aee6 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:38.118628 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ffa07150-a5b9-44bc-b03e-8113f505aee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:38.133059 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50eb8a-49ab-43ad-9dd6-264fe4c637c7 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:38.149656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87983f-8408-4eb6-806e-e957ab9d46be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:38.150587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87983f-8408-4eb6-806e-e957ab9d46be admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:38.159190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87983f-8408-4eb6-806e-e957ab9d46be admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:38.159190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87983f-8408-4eb6-806e-e957ab9d46be admin admin] PATH_INFO: `/v3/projects/09096ff4c39b4751b850f296f06c9a23/users/1ebb1dc523b84f5c8bf7d0f3bdb74061/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:38.159464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa07150-a5b9-44bc-b03e-8113f505aee6 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:38.168145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4db98-b2b7-43d5-a661-f5d1978fdf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:38.169885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4db98-b2b7-43d5-a661-f5d1978fdf19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:38.170772 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4db98-b2b7-43d5-a661-f5d1978fdf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:38.171260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4db98-b2b7-43d5-a661-f5d1978fdf19 admin admin] PATH_INFO: `/v3/projects/c3985f30465442f0b1ac65f7edea53d1` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:38.174931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4db98-b2b7-43d5-a661-f5d1978fdf19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3985f30465442f0b1ac65f7edea53d1)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:38.182286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4db98-b2b7-43d5-a661-f5d1978fdf19 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:38.204230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87983f-8408-4eb6-806e-e957ab9d46be admin admin] RBAC: Authorizing `identity:create_grant(project_id=09096ff4c39b4751b850f296f06c9a23, user_id=1ebb1dc523b84f5c8bf7d0f3bdb74061, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:38.212155 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87983f-8408-4eb6-806e-e957ab9d46be admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:38.330440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 824/1669] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:38 2022] PUT /identity/v3/projects/09096ff4c39b4751b850f296f06c9a23/users/1ebb1dc523b84f5c8bf7d0f3bdb74061/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:38.333930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87983f-8408-4eb6-806e-e957ab9d46be admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:38.358256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-56a4db98-b2b7-43d5-a661-f5d1978fdf19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3985f30465442f0b1ac65f7edea53d1', 'request_id': 'req-56a4db98-b2b7-43d5-a661-f5d1978fdf19'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:38.371653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-56a4db98-b2b7-43d5-a661-f5d1978fdf19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3985f30465442f0b1ac65f7edea53d1', 'request_id': 'req-56a4db98-b2b7-43d5-a661-f5d1978fdf19'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:38.483615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-56a4db98-b2b7-43d5-a661-f5d1978fdf19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3985f30465442f0b1ac65f7edea53d1', 'request_id': 'req-56a4db98-b2b7-43d5-a661-f5d1978fdf19'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:38.501341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-56a4db98-b2b7-43d5-a661-f5d1978fdf19 admin admin] The token cache is being invalidate because project c3985f30465442f0b1ac65f7edea53d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:34:38.502175 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87983f-8408-4eb6-806e-e957ab9d46be admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:38.502498 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-56a4db98-b2b7-43d5-a661-f5d1978fdf19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:38.505149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-56a4db98-b2b7-43d5-a661-f5d1978fdf19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:38.510234 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 846/1670] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:34:38 2022] DELETE /identity/v3/projects/c3985f30465442f0b1ac65f7edea53d1 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:34:38.515640 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246ae42-a74c-42ef-9814-627f7272cd95 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:38.516032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246ae42-a74c-42ef-9814-627f7272cd95 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:38.516378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246ae42-a74c-42ef-9814-627f7272cd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:38.568278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5246ae42-a74c-42ef-9814-627f7272cd95 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:38.571356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5246ae42-a74c-42ef-9814-627f7272cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:38.637790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248485a7-ed13-4549-b650-c5757ce3b624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:38.650993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248485a7-ed13-4549-b650-c5757ce3b624 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:38.651391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248485a7-ed13-4549-b650-c5757ce3b624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:38.651678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248485a7-ed13-4549-b650-c5757ce3b624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:38.652430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248485a7-ed13-4549-b650-c5757ce3b624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:38.659167 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248485a7-ed13-4549-b650-c5757ce3b624 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:38.666599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:INSERT=6,keystone:DELETE=1,keystone:SELECT=93 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:38.691010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 825/1671] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:38.692397 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248485a7-ed13-4549-b650-c5757ce3b624 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:38.702506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-248485a7-ed13-4549-b650-c5757ce3b624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:38.719524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 847/1672] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:38.729199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248485a7-ed13-4549-b650-c5757ce3b624 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:38.731238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e75cb-832a-4ad6-aa59-d3c7a572f0fb None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:38.731524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e75cb-832a-4ad6-aa59-d3c7a572f0fb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:38.731869 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e75cb-832a-4ad6-aa59-d3c7a572f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:38.747036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ab986-6d4a-408c-a9df-c5ba1ec81c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:38.747750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ab986-6d4a-408c-a9df-c5ba1ec81c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:38.748065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ab986-6d4a-408c-a9df-c5ba1ec81c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:38.748350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ab986-6d4a-408c-a9df-c5ba1ec81c90 admin admin] PATH_INFO: `/v3/projects/09096ff4c39b4751b850f296f06c9a23/users/1ebb1dc523b84f5c8bf7d0f3bdb74061/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:38.760636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ab986-6d4a-408c-a9df-c5ba1ec81c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09096ff4c39b4751b850f296f06c9a23, user_id=1ebb1dc523b84f5c8bf7d0f3bdb74061, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:38.763413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ab986-6d4a-408c-a9df-c5ba1ec81c90 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:38.781130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d23e75cb-832a-4ad6-aa59-d3c7a572f0fb None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:38.787468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d23e75cb-832a-4ad6-aa59-d3c7a572f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:38.801103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 826/1673] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:38 2022] PUT /identity/v3/projects/09096ff4c39b4751b850f296f06c9a23/users/1ebb1dc523b84f5c8bf7d0f3bdb74061/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:38.802843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4bf1e-adc0-4a35-ba6b-7f47dc1a4a0e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:38.803208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4bf1e-adc0-4a35-ba6b-7f47dc1a4a0e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:38.803523 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4bf1e-adc0-4a35-ba6b-7f47dc1a4a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:38.869798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5eb4bf1e-adc0-4a35-ba6b-7f47dc1a4a0e None None] MFA Rules not processed for user `1ebb1dc523b84f5c8bf7d0f3bdb74061`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:38.871075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5eb4bf1e-adc0-4a35-ba6b-7f47dc1a4a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:38.978351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 848/1674] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:38.981277 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e75cb-832a-4ad6-aa59-d3c7a572f0fb None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:39.002004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e75cb-832a-4ad6-aa59-d3c7a572f0fb None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:39.016745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfa5c3-55f8-4294-9ab7-0dde9051397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:39.019860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa5c3-55f8-4294-9ab7-0dde9051397c admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:39.021753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa5c3-55f8-4294-9ab7-0dde9051397c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:39.022063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa5c3-55f8-4294-9ab7-0dde9051397c admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:39.025676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfa5c3-55f8-4294-9ab7-0dde9051397c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:39.025995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfa5c3-55f8-4294-9ab7-0dde9051397c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:39.027641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfa5c3-55f8-4294-9ab7-0dde9051397c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:39.059229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 849/1675] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:39.065581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfa5c3-55f8-4294-9ab7-0dde9051397c admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:39.073564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 827/1676] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:34:39.086835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfa5c3-55f8-4294-9ab7-0dde9051397c admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:39.090237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4bf1e-adc0-4a35-ba6b-7f47dc1a4a0e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:39.091729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5eb4bf1e-adc0-4a35-ba6b-7f47dc1a4a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:39.107287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:39.110620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f62ee-7139-4e00-9666-b33bc6bea4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:39.111383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f62ee-7139-4e00-9666-b33bc6bea4bf admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:39.111710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f62ee-7139-4e00-9666-b33bc6bea4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:39.112261 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f62ee-7139-4e00-9666-b33bc6bea4bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:39.117525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f62ee-7139-4e00-9666-b33bc6bea4bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:39.117525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f62ee-7139-4e00-9666-b33bc6bea4bf admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:39.264824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 850/1677] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:39 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:39.266325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f62ee-7139-4e00-9666-b33bc6bea4bf admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:39.272991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4bf1e-adc0-4a35-ba6b-7f47dc1a4a0e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:39.393979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508e499-199a-4eb1-8d4c-df5a15e8eb12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:39.395139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508e499-199a-4eb1-8d4c-df5a15e8eb12 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:39.395441 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508e499-199a-4eb1-8d4c-df5a15e8eb12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:39.395735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508e499-199a-4eb1-8d4c-df5a15e8eb12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:39.456545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f62ee-7139-4e00-9666-b33bc6bea4bf admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:39.468080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654645-4553-402e-ad00-c702e7d597f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:39.468709 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654645-4553-402e-ad00-c702e7d597f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:39.469061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654645-4553-402e-ad00-c702e7d597f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:39.469341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654645-4553-402e-ad00-c702e7d597f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:39.470111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654645-4553-402e-ad00-c702e7d597f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:39.472681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654645-4553-402e-ad00-c702e7d597f0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:39.538152 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508e499-199a-4eb1-8d4c-df5a15e8eb12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:39.542215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508e499-199a-4eb1-8d4c-df5a15e8eb12 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:39.568588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 828/1678] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:34:39.596480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 851/1679] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:39 2022] POST /identity/v3/users => generated 284 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:39.600914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508e499-199a-4eb1-8d4c-df5a15e8eb12 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:39.611336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654645-4553-402e-ad00-c702e7d597f0 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:39.636028 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b4654645-4553-402e-ad00-c702e7d597f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:39.647396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508e499-199a-4eb1-8d4c-df5a15e8eb12 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:39.670430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b38bc1-5dbf-4724-a14d-9dda74ab7a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:39.671322 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b38bc1-5dbf-4724-a14d-9dda74ab7a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:39.673364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b38bc1-5dbf-4724-a14d-9dda74ab7a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:39.674048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b38bc1-5dbf-4724-a14d-9dda74ab7a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:39.675205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b38bc1-5dbf-4724-a14d-9dda74ab7a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:39.707213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654645-4553-402e-ad00-c702e7d597f0 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:39.707691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b38bc1-5dbf-4724-a14d-9dda74ab7a8f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:39.731479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:39.760301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772567c-d744-4ce6-a8c7-48fef6f3e25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:39.764373 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772567c-d744-4ce6-a8c7-48fef6f3e25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:39.764671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772567c-d744-4ce6-a8c7-48fef6f3e25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:39.766809 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772567c-d744-4ce6-a8c7-48fef6f3e25a admin admin] PATH_INFO: `/v3/projects/f78bad19f3c641868a1b32927d8b7da4` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:39.770912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772567c-d744-4ce6-a8c7-48fef6f3e25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78bad19f3c641868a1b32927d8b7da4)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:39.774736 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 829/1680] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:39.779327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772567c-d744-4ce6-a8c7-48fef6f3e25a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:39.783003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b38bc1-5dbf-4724-a14d-9dda74ab7a8f admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:39.803268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b38bc1-5dbf-4724-a14d-9dda74ab7a8f admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:39.813681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d36b13-f253-4d53-b149-2fd452adc4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:39.814357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d36b13-f253-4d53-b149-2fd452adc4ec admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:39.817012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d36b13-f253-4d53-b149-2fd452adc4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:39.817338 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d36b13-f253-4d53-b149-2fd452adc4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:39.820762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d36b13-f253-4d53-b149-2fd452adc4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:39.825702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d36b13-f253-4d53-b149-2fd452adc4ec admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:39.850607 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 830/1681] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:39.856570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d36b13-f253-4d53-b149-2fd452adc4ec admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:39.886424 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d36b13-f253-4d53-b149-2fd452adc4ec admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:39.898720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af7d30-c96e-4636-a85d-309101148820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:39.899416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af7d30-c96e-4636-a85d-309101148820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:39.899742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af7d30-c96e-4636-a85d-309101148820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:39.900060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af7d30-c96e-4636-a85d-309101148820 admin admin] PATH_INFO: `/v3/projects/f6d250dab5e24b6ca6b2337b07733976/users/e213281f032f4992a8bfd81035be8623/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:39.939376 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af7d30-c96e-4636-a85d-309101148820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d250dab5e24b6ca6b2337b07733976, user_id=e213281f032f4992a8bfd81035be8623, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:39.942820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af7d30-c96e-4636-a85d-309101148820 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:39.969625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5772567c-d744-4ce6-a8c7-48fef6f3e25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78bad19f3c641868a1b32927d8b7da4', 'request_id': 'req-5772567c-d744-4ce6-a8c7-48fef6f3e25a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:39.978748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5772567c-d744-4ce6-a8c7-48fef6f3e25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78bad19f3c641868a1b32927d8b7da4', 'request_id': 'req-5772567c-d744-4ce6-a8c7-48fef6f3e25a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:40.080608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 831/1682] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:39 2022] PUT /identity/v3/projects/f6d250dab5e24b6ca6b2337b07733976/users/e213281f032f4992a8bfd81035be8623/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:40.080608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af7d30-c96e-4636-a85d-309101148820 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:40.080608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-36af7d30-c96e-4636-a85d-309101148820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:40.101587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5772567c-d744-4ce6-a8c7-48fef6f3e25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78bad19f3c641868a1b32927d8b7da4', 'request_id': 'req-5772567c-d744-4ce6-a8c7-48fef6f3e25a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:40.131367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5772567c-d744-4ce6-a8c7-48fef6f3e25a admin admin] The token cache is being invalidate because project f78bad19f3c641868a1b32927d8b7da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:34:40.131734 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5772567c-d744-4ce6-a8c7-48fef6f3e25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:40.132962 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5772567c-d744-4ce6-a8c7-48fef6f3e25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:40.137607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 852/1683] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:34:39 2022] DELETE /identity/v3/projects/f78bad19f3c641868a1b32927d8b7da4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:40.141597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33e785-8bc5-4bd7-8f2e-c41475fe96db None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:40.144591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33e785-8bc5-4bd7-8f2e-c41475fe96db None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:40.144899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33e785-8bc5-4bd7-8f2e-c41475fe96db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:40.212828 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af7d30-c96e-4636-a85d-309101148820 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:40.223525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9c33e785-8bc5-4bd7-8f2e-c41475fe96db None None] MFA Rules not processed for user `e213281f032f4992a8bfd81035be8623`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:40.224688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d2088-2fc9-438b-901a-3436513890bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:40.225010 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9c33e785-8bc5-4bd7-8f2e-c41475fe96db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:40.225367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d2088-2fc9-438b-901a-3436513890bb service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:40.226179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d2088-2fc9-438b-901a-3436513890bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:40.236939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d2088-2fc9-438b-901a-3436513890bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:40.243190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-862d2088-2fc9-438b-901a-3436513890bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:40.363597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 853/1684] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:40.365158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33e785-8bc5-4bd7-8f2e-c41475fe96db None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:40.368667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9c33e785-8bc5-4bd7-8f2e-c41475fe96db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:40.390649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d2088-2fc9-438b-901a-3436513890bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:40.394748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d2088-2fc9-438b-901a-3436513890bb service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:40.417449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 832/1685] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:40.434614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d2088-2fc9-438b-901a-3436513890bb service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:40.436600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-862d2088-2fc9-438b-901a-3436513890bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:40.566475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33e785-8bc5-4bd7-8f2e-c41475fe96db None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:40.576586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:40.577822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:40.578259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:40.578711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] PATH_INFO: `/v3/users/7e8f35badd3d4873ab85e33828bf502d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:40.580357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8f35badd3d4873ab85e33828bf502d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:40.582564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:40.583754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d2088-2fc9-438b-901a-3436513890bb service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:40.597717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d330fa-4fd2-4a8b-8930-3d3bdcba1fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:40.598351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d330fa-4fd2-4a8b-8930-3d3bdcba1fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:40.598627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d330fa-4fd2-4a8b-8930-3d3bdcba1fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:40.598899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d330fa-4fd2-4a8b-8930-3d3bdcba1fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:40.599539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d330fa-4fd2-4a8b-8930-3d3bdcba1fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:40.606216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d330fa-4fd2-4a8b-8930-3d3bdcba1fa7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:40.734187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 833/1686] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:40 2022] POST /identity/v3/projects => generated 367 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:40.738001 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d330fa-4fd2-4a8b-8930-3d3bdcba1fa7 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:40.807111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:40.836808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8f35badd3d4873ab85e33828bf502d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:40.853561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8f35badd3d4873ab85e33828bf502d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:40.854634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8f35badd3d4873ab85e33828bf502d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:40.856666 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8f35badd3d4873ab85e33828bf502d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:40.873084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d330fa-4fd2-4a8b-8930-3d3bdcba1fa7 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:40.885494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9094d-88d8-4f9a-8242-81aef7ffecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:40.886116 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9094d-88d8-4f9a-8242-81aef7ffecc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:40.887465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9094d-88d8-4f9a-8242-81aef7ffecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:40.887774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9094d-88d8-4f9a-8242-81aef7ffecc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:40.888452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9094d-88d8-4f9a-8242-81aef7ffecc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:40.890834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9094d-88d8-4f9a-8242-81aef7ffecc9 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:40.981853 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8f35badd3d4873ab85e33828bf502d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:40.987640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:40.992855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 834/1687] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:40 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:34:40.998317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9094d-88d8-4f9a-8242-81aef7ffecc9 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:41.000527 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-63d9094d-88d8-4f9a-8242-81aef7ffecc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:41.033668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9094d-88d8-4f9a-8242-81aef7ffecc9 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:41.049299 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c3a85-74bc-4ae6-a4c2-47d7eb8cc609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:41.049913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c3a85-74bc-4ae6-a4c2-47d7eb8cc609 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:41.050199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c3a85-74bc-4ae6-a4c2-47d7eb8cc609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:41.050469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c3a85-74bc-4ae6-a4c2-47d7eb8cc609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:41.051145 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c3a85-74bc-4ae6-a4c2-47d7eb8cc609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:41.052750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c3a85-74bc-4ae6-a4c2-47d7eb8cc609 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:41.064258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 854/1688] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:34:40 2022] DELETE /identity/v3/users/7e8f35badd3d4873ab85e33828bf502d => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:41.087133 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 835/1689] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:41.090896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:41.234596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773459a-9dc2-4e9b-b5eb-c37605ef18f3 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:41.240196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f00067-6fe8-4fef-801e-a65755a9e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:41.240878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f00067-6fe8-4fef-801e-a65755a9e86f admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:41.241663 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f00067-6fe8-4fef-801e-a65755a9e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:41.241995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f00067-6fe8-4fef-801e-a65755a9e86f admin admin] PATH_INFO: `/v3/projects/f642fd8bdd384a06aa6e122004f90c94/users/7a4c42f128d2449eb9762704b4469cfa/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:41.275081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f00067-6fe8-4fef-801e-a65755a9e86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f642fd8bdd384a06aa6e122004f90c94, user_id=7a4c42f128d2449eb9762704b4469cfa, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:41.277564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f00067-6fe8-4fef-801e-a65755a9e86f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:41.408305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 855/1690] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:41 2022] PUT /identity/v3/projects/f642fd8bdd384a06aa6e122004f90c94/users/7a4c42f128d2449eb9762704b4469cfa/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:41.412617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c3a85-74bc-4ae6-a4c2-47d7eb8cc609 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:41.424958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c3a85-74bc-4ae6-a4c2-47d7eb8cc609 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:41.517904 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f501e-e9d9-49a3-b78b-c0540abec5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:41.518582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f501e-e9d9-49a3-b78b-c0540abec5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:41.518813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f501e-e9d9-49a3-b78b-c0540abec5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:41.519079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f501e-e9d9-49a3-b78b-c0540abec5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:41.519735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f501e-e9d9-49a3-b78b-c0540abec5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:41.521426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f501e-e9d9-49a3-b78b-c0540abec5c5 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:41.547562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 836/1691] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:41.552223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f00067-6fe8-4fef-801e-a65755a9e86f admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:41.565189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f00067-6fe8-4fef-801e-a65755a9e86f admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:41.573931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72d08a-fed5-41bf-abc6-e4723e6142f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:41.574618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72d08a-fed5-41bf-abc6-e4723e6142f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:41.574897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72d08a-fed5-41bf-abc6-e4723e6142f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:41.575168 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72d08a-fed5-41bf-abc6-e4723e6142f2 admin admin] PATH_INFO: `/v3/projects/f642fd8bdd384a06aa6e122004f90c94/users/7a4c42f128d2449eb9762704b4469cfa/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:41.579310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72d08a-fed5-41bf-abc6-e4723e6142f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f642fd8bdd384a06aa6e122004f90c94, user_id=7a4c42f128d2449eb9762704b4469cfa, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:41.592550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72d08a-fed5-41bf-abc6-e4723e6142f2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:41.615915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 856/1692] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:41 2022] PUT /identity/v3/projects/f642fd8bdd384a06aa6e122004f90c94/users/7a4c42f128d2449eb9762704b4469cfa/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:41.617694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd010c62-77e0-43a9-9b9f-63f5c1f587bf None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:41.618207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd010c62-77e0-43a9-9b9f-63f5c1f587bf None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:41.618720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd010c62-77e0-43a9-9b9f-63f5c1f587bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:41.687229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-dd010c62-77e0-43a9-9b9f-63f5c1f587bf None None] MFA Rules not processed for user `7a4c42f128d2449eb9762704b4469cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:41.689475 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dd010c62-77e0-43a9-9b9f-63f5c1f587bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:41.868587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 837/1693] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:41.888042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72d08a-fed5-41bf-abc6-e4723e6142f2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:41.891334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5e72d08a-fed5-41bf-abc6-e4723e6142f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:42.037183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72d08a-fed5-41bf-abc6-e4723e6142f2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:42.041737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5755afd-036e-4773-9a2c-20b063d6d46c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:42.042428 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5755afd-036e-4773-9a2c-20b063d6d46c service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:42.042775 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5755afd-036e-4773-9a2c-20b063d6d46c service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:42.043113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5755afd-036e-4773-9a2c-20b063d6d46c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:42.055767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5755afd-036e-4773-9a2c-20b063d6d46c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:42.057956 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5755afd-036e-4773-9a2c-20b063d6d46c service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:42.080642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 857/1694] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:42.317807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:42.349684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd010c62-77e0-43a9-9b9f-63f5c1f587bf None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:42.350316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dd010c62-77e0-43a9-9b9f-63f5c1f587bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:42.506467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:42.563426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea898338-1585-4b2c-8b14-b64804207995 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:42.563426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea898338-1585-4b2c-8b14-b64804207995 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:42.563666 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea898338-1585-4b2c-8b14-b64804207995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:42.585043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd010c62-77e0-43a9-9b9f-63f5c1f587bf None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:42.591315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a742e65-87c0-40c8-a38a-4135ce87b95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:42.592337 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a742e65-87c0-40c8-a38a-4135ce87b95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:42.592617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a742e65-87c0-40c8-a38a-4135ce87b95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:42.592888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a742e65-87c0-40c8-a38a-4135ce87b95e admin admin] PATH_INFO: `/v3/projects/ac611851c08e48779d4aad5f7dc4c05d` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:42.594064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a742e65-87c0-40c8-a38a-4135ce87b95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac611851c08e48779d4aad5f7dc4c05d)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:42.596280 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a742e65-87c0-40c8-a38a-4135ce87b95e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:42.629207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ea898338-1585-4b2c-8b14-b64804207995 None None] MFA Rules not processed for user `f040e47e66d145589b4233fe98c93507`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:42.633079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ea898338-1585-4b2c-8b14-b64804207995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:42.777488 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 858/1695] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:34:42.791368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-1a742e65-87c0-40c8-a38a-4135ce87b95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac611851c08e48779d4aad5f7dc4c05d', 'request_id': 'req-1a742e65-87c0-40c8-a38a-4135ce87b95e'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:42.798698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea898338-1585-4b2c-8b14-b64804207995 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:42.800251 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ea898338-1585-4b2c-8b14-b64804207995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:42.804618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-1a742e65-87c0-40c8-a38a-4135ce87b95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac611851c08e48779d4aad5f7dc4c05d', 'request_id': 'req-1a742e65-87c0-40c8-a38a-4135ce87b95e'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:42.814875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-1a742e65-87c0-40c8-a38a-4135ce87b95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac611851c08e48779d4aad5f7dc4c05d', 'request_id': 'req-1a742e65-87c0-40c8-a38a-4135ce87b95e'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:42.904542 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-1a742e65-87c0-40c8-a38a-4135ce87b95e admin admin] The token cache is being invalidate because project ac611851c08e48779d4aad5f7dc4c05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:34:42.905958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-1a742e65-87c0-40c8-a38a-4135ce87b95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:42.907358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-1a742e65-87c0-40c8-a38a-4135ce87b95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:42.914416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 838/1696] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:34:42 2022] DELETE /identity/v3/projects/ac611851c08e48779d4aad5f7dc4c05d => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:42.918035 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e4ee-1a40-435a-8345-a58c6253771f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:42.918570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e4ee-1a40-435a-8345-a58c6253771f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:42.919151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e4ee-1a40-435a-8345-a58c6253771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:42.960806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6f98e4ee-1a40-435a-8345-a58c6253771f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:42.962558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6f98e4ee-1a40-435a-8345-a58c6253771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:43.030959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea898338-1585-4b2c-8b14-b64804207995 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:43.101758 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 839/1697] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:43.117560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf057dc-f4d0-4fd1-a6b9-45e44149369a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:43.117850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf057dc-f4d0-4fd1-a6b9-45e44149369a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:43.118183 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf057dc-f4d0-4fd1-a6b9-45e44149369a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:43.170562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1cf057dc-f4d0-4fd1-a6b9-45e44149369a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:43.177745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1cf057dc-f4d0-4fd1-a6b9-45e44149369a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:43.192894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 840/1698] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:43.194192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf057dc-f4d0-4fd1-a6b9-45e44149369a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:43.206541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf057dc-f4d0-4fd1-a6b9-45e44149369a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:43.213506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeac752-177e-4a25-8ae0-48ea58bdf017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:43.214178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeac752-177e-4a25-8ae0-48ea58bdf017 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:43.214807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeac752-177e-4a25-8ae0-48ea58bdf017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:43.214807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeac752-177e-4a25-8ae0-48ea58bdf017 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:43.216817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeac752-177e-4a25-8ae0-48ea58bdf017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:43.216817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeac752-177e-4a25-8ae0-48ea58bdf017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:43.217713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeac752-177e-4a25-8ae0-48ea58bdf017 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:43.231572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1165062-cc7d-4321-868f-dbb3b7884336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:43.232565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1165062-cc7d-4321-868f-dbb3b7884336 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:43.233276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1165062-cc7d-4321-868f-dbb3b7884336 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:43.236684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1165062-cc7d-4321-868f-dbb3b7884336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:43.243090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b1165062-cc7d-4321-868f-dbb3b7884336 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:43.250802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 841/1699] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:43.251732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeac752-177e-4a25-8ae0-48ea58bdf017 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:43.277494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeac752-177e-4a25-8ae0-48ea58bdf017 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:43.291610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fea539-225a-43b4-9387-d10928ed677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:43.293698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fea539-225a-43b4-9387-d10928ed677d admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:43.294032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fea539-225a-43b4-9387-d10928ed677d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:43.294318 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fea539-225a-43b4-9387-d10928ed677d admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:43.296242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fea539-225a-43b4-9387-d10928ed677d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:43.300751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fea539-225a-43b4-9387-d10928ed677d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:43.377770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1165062-cc7d-4321-868f-dbb3b7884336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:43.393051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1165062-cc7d-4321-868f-dbb3b7884336 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:43.426379 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 859/1700] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:34:43.466617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1165062-cc7d-4321-868f-dbb3b7884336 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:43.476323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 842/1701] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:43 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:43.513735 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1165062-cc7d-4321-868f-dbb3b7884336 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:43.692522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db23b1c-27ef-46e5-8144-4acf27e1846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:43.694332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db23b1c-27ef-46e5-8144-4acf27e1846d admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:43.695274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db23b1c-27ef-46e5-8144-4acf27e1846d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:43.695484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db23b1c-27ef-46e5-8144-4acf27e1846d admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:43.696281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db23b1c-27ef-46e5-8144-4acf27e1846d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:43.698479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db23b1c-27ef-46e5-8144-4acf27e1846d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:43.784832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:43.920981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 860/1702] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:43 2022] POST /identity/v3/users => generated 293 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:43.925231 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fea539-225a-43b4-9387-d10928ed677d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:43.948519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fea539-225a-43b4-9387-d10928ed677d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:43.974047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db23b1c-27ef-46e5-8144-4acf27e1846d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:43.982175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9db23b1c-27ef-46e5-8144-4acf27e1846d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:43.993628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a7113-e08d-4364-8a89-c6f6bdccc3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:43.993628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a7113-e08d-4364-8a89-c6f6bdccc3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:43.993858 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a7113-e08d-4364-8a89-c6f6bdccc3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:43.994144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a7113-e08d-4364-8a89-c6f6bdccc3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:43.994765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a7113-e08d-4364-8a89-c6f6bdccc3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:44.003468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a7113-e08d-4364-8a89-c6f6bdccc3f7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:44.054309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 843/1703] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:44.058409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db23b1c-27ef-46e5-8144-4acf27e1846d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:44.061123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a7113-e08d-4364-8a89-c6f6bdccc3f7 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:44.068479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa9cfb-ab7f-48cf-b3d4-031554f15910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:44.072993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa9cfb-ab7f-48cf-b3d4-031554f15910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:44.075458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa9cfb-ab7f-48cf-b3d4-031554f15910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:44.076005 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa9cfb-ab7f-48cf-b3d4-031554f15910 admin admin] PATH_INFO: `/v3/users/11a28894c38b4aeebeadc4f42908af46` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:44.079151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa9cfb-ab7f-48cf-b3d4-031554f15910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a28894c38b4aeebeadc4f42908af46)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:44.081324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa9cfb-ab7f-48cf-b3d4-031554f15910 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:44.090278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a7113-e08d-4364-8a89-c6f6bdccc3f7 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:44.121550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197bdb-aef2-4316-9e87-01cc6f62122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:44.122574 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197bdb-aef2-4316-9e87-01cc6f62122c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:44.122574 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197bdb-aef2-4316-9e87-01cc6f62122c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:44.122765 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197bdb-aef2-4316-9e87-01cc6f62122c admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:44.123362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13197bdb-aef2-4316-9e87-01cc6f62122c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:44.133863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13197bdb-aef2-4316-9e87-01cc6f62122c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:44.180880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 844/1704] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:44.186299 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197bdb-aef2-4316-9e87-01cc6f62122c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:44.213520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197bdb-aef2-4316-9e87-01cc6f62122c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:44.231992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153e830-74f2-49f0-abbf-9f4bcaa42fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:44.232970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153e830-74f2-49f0-abbf-9f4bcaa42fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:44.232970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153e830-74f2-49f0-abbf-9f4bcaa42fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:44.233208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153e830-74f2-49f0-abbf-9f4bcaa42fbd admin admin] PATH_INFO: `/v3/projects/64772d476b88454d993c65506b53d369/users/bd247a6da52345189195d8c3afa3e5e9/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:44.284541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153e830-74f2-49f0-abbf-9f4bcaa42fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=64772d476b88454d993c65506b53d369, user_id=bd247a6da52345189195d8c3afa3e5e9, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:44.287188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153e830-74f2-49f0-abbf-9f4bcaa42fbd admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:44.419741 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 845/1705] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:44 2022] PUT /identity/v3/projects/64772d476b88454d993c65506b53d369/users/bd247a6da52345189195d8c3afa3e5e9/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:44.430607 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e6af-f5d3-488e-8d3e-f4c184f7d347 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:44.430890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e6af-f5d3-488e-8d3e-f4c184f7d347 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:44.437332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e6af-f5d3-488e-8d3e-f4c184f7d347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:44.470142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-78fa9cfb-ab7f-48cf-b3d4-031554f15910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a28894c38b4aeebeadc4f42908af46'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:44.488515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-78fa9cfb-ab7f-48cf-b3d4-031554f15910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a28894c38b4aeebeadc4f42908af46'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:44.489258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-78fa9cfb-ab7f-48cf-b3d4-031554f15910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a28894c38b4aeebeadc4f42908af46'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:44.489884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-78fa9cfb-ab7f-48cf-b3d4-031554f15910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a28894c38b4aeebeadc4f42908af46'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:44.508249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-bf72e6af-f5d3-488e-8d3e-f4c184f7d347 None None] MFA Rules not processed for user `bd247a6da52345189195d8c3afa3e5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:44.512240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bf72e6af-f5d3-488e-8d3e-f4c184f7d347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:44.551617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-78fa9cfb-ab7f-48cf-b3d4-031554f15910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a28894c38b4aeebeadc4f42908af46'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:44.610266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 861/1706] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:34:43 2022] DELETE /identity/v3/users/11a28894c38b4aeebeadc4f42908af46 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:34:44.615480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5c472-ce38-4364-9fca-470701f594cd None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:44.624177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5c472-ce38-4364-9fca-470701f594cd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:44.625449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5c472-ce38-4364-9fca-470701f594cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:44.690277 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f4b5c472-ce38-4364-9fca-470701f594cd None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:44.696315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f4b5c472-ce38-4364-9fca-470701f594cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:44.777956 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 846/1707] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:44.785447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e6af-f5d3-488e-8d3e-f4c184f7d347 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:44.787468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bf72e6af-f5d3-488e-8d3e-f4c184f7d347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:44.869179 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:44.915740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 862/1708] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:44.957330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5c472-ce38-4364-9fca-470701f594cd None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:44.959185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f4b5c472-ce38-4364-9fca-470701f594cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:45.020809 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e6af-f5d3-488e-8d3e-f4c184f7d347 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:45.039636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e67bf7-edb5-4a30-b664-a70b27ebfbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:45.040394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e67bf7-edb5-4a30-b664-a70b27ebfbdc admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:45.040697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e67bf7-edb5-4a30-b664-a70b27ebfbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:45.040958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e67bf7-edb5-4a30-b664-a70b27ebfbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:45.041648 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e67bf7-edb5-4a30-b664-a70b27ebfbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:45.046490 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e67bf7-edb5-4a30-b664-a70b27ebfbdc admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:45.160514 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5c472-ce38-4364-9fca-470701f594cd None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:45.162430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 847/1709] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:44 2022] POST /identity/v3/projects => generated 387 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:45.167935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e67bf7-edb5-4a30-b664-a70b27ebfbdc admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:45.312696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afb335-567d-433b-8652-67b53a5d5b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:45.313213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afb335-567d-433b-8652-67b53a5d5b9d service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:45.313500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afb335-567d-433b-8652-67b53a5d5b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:45.313773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afb335-567d-433b-8652-67b53a5d5b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:45.366040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e67bf7-edb5-4a30-b664-a70b27ebfbdc admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:45.377610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:45.387316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37863179-30bb-4595-8066-1accaafafdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:45.387930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37863179-30bb-4595-8066-1accaafafdd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:45.388232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37863179-30bb-4595-8066-1accaafafdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:45.388538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37863179-30bb-4595-8066-1accaafafdd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:45.389321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37863179-30bb-4595-8066-1accaafafdd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:45.397856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37863179-30bb-4595-8066-1accaafafdd8 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:45.496265 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afb335-567d-433b-8652-67b53a5d5b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:45.497792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afb335-567d-433b-8652-67b53a5d5b9d service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:45.524058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 863/1710] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:45.568130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afb335-567d-433b-8652-67b53a5d5b9d service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:45.568741 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 848/1711] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:45 2022] POST /identity/v3/users => generated 300 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:45.583651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afb335-567d-433b-8652-67b53a5d5b9d service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:45.598113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cf5d7-2adc-432a-8d23-5080b433fa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:45.598113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cf5d7-2adc-432a-8d23-5080b433fa86 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:45.598113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cf5d7-2adc-432a-8d23-5080b433fa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:45.598113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cf5d7-2adc-432a-8d23-5080b433fa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:45.598683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cf5d7-2adc-432a-8d23-5080b433fa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:45.600339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cf5d7-2adc-432a-8d23-5080b433fa86 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:45.622171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 864/1712] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:34:45.628696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37863179-30bb-4595-8066-1accaafafdd8 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:45.642360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37863179-30bb-4595-8066-1accaafafdd8 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:45.654546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3f84b-3103-4b6e-b60e-08db2966639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:45.655308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3f84b-3103-4b6e-b60e-08db2966639c admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:45.655591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3f84b-3103-4b6e-b60e-08db2966639c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:45.657266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3f84b-3103-4b6e-b60e-08db2966639c admin admin] PATH_INFO: `/v3/projects/e0c7d4423b2c47df8b52a46490ad858b/users/e5794a18bd0a494fa10d318404103882/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:45.699416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3f84b-3103-4b6e-b60e-08db2966639c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c7d4423b2c47df8b52a46490ad858b, user_id=e5794a18bd0a494fa10d318404103882, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:45.699416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3f84b-3103-4b6e-b60e-08db2966639c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:45.840603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 849/1713] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:45 2022] PUT /identity/v3/projects/e0c7d4423b2c47df8b52a46490ad858b/users/e5794a18bd0a494fa10d318404103882/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:45.846017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cf5d7-2adc-432a-8d23-5080b433fa86 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:45.856883 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cf5d7-2adc-432a-8d23-5080b433fa86 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:46.081389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba67737-075d-460d-8fda-4747817f71a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:46.084183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba67737-075d-460d-8fda-4747817f71a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:46.084819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba67737-075d-460d-8fda-4747817f71a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:46.086100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba67737-075d-460d-8fda-4747817f71a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:46.088143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba67737-075d-460d-8fda-4747817f71a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:46.095063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba67737-075d-460d-8fda-4747817f71a7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:46.133978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 865/1714] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:46.135315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3f84b-3103-4b6e-b60e-08db2966639c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:46.148694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3f84b-3103-4b6e-b60e-08db2966639c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:46.181762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d54632-0889-487d-9978-66f93b71a507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:46.206394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d54632-0889-487d-9978-66f93b71a507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:46.207128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d54632-0889-487d-9978-66f93b71a507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:46.207695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d54632-0889-487d-9978-66f93b71a507 admin admin] PATH_INFO: `/v3/projects/e0c7d4423b2c47df8b52a46490ad858b/users/e5794a18bd0a494fa10d318404103882/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:46.219452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d54632-0889-487d-9978-66f93b71a507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c7d4423b2c47df8b52a46490ad858b, user_id=e5794a18bd0a494fa10d318404103882, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:46.226877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d54632-0889-487d-9978-66f93b71a507 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:46.261132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 850/1715] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:46 2022] PUT /identity/v3/projects/e0c7d4423b2c47df8b52a46490ad858b/users/e5794a18bd0a494fa10d318404103882/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:46.277784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027636ad-8b94-4b53-92cd-3ce28d79a74a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:46.278353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027636ad-8b94-4b53-92cd-3ce28d79a74a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:46.278756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027636ad-8b94-4b53-92cd-3ce28d79a74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:46.367080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-027636ad-8b94-4b53-92cd-3ce28d79a74a None None] MFA Rules not processed for user `e5794a18bd0a494fa10d318404103882`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:46.375523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-027636ad-8b94-4b53-92cd-3ce28d79a74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:46.544984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d54632-0889-487d-9978-66f93b71a507 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:46.556387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-65d54632-0889-487d-9978-66f93b71a507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:46.627295 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 866/1716] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:46.667700 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027636ad-8b94-4b53-92cd-3ce28d79a74a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:46.669478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-027636ad-8b94-4b53-92cd-3ce28d79a74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:46.715857 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d54632-0889-487d-9978-66f93b71a507 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:46.721700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:46.722569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:46.722987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:46.723422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6 admin admin] PATH_INFO: `/v3/projects/f625a04ba0b34478b5fef33dc7fad0e5` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:46.725528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f625a04ba0b34478b5fef33dc7fad0e5)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:46.729104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:46.797393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027636ad-8b94-4b53-92cd-3ce28d79a74a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:46.804404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3d66e-826b-4d71-95ed-55a17c0bf3ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:46.805545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3d66e-826b-4d71-95ed-55a17c0bf3ac service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:46.806073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3d66e-826b-4d71-95ed-55a17c0bf3ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:46.811891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3d66e-826b-4d71-95ed-55a17c0bf3ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:46.818519 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3d66e-826b-4d71-95ed-55a17c0bf3ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:46.820719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3d66e-826b-4d71-95ed-55a17c0bf3ac service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:46.833682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 867/1717] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:34:46.934405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f625a04ba0b34478b5fef33dc7fad0e5', 'request_id': 'req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:46.955546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f625a04ba0b34478b5fef33dc7fad0e5', 'request_id': 'req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:46.970403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3d66e-826b-4d71-95ed-55a17c0bf3ac service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:46.986152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3d66e-826b-4d71-95ed-55a17c0bf3ac service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:46.986851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f625a04ba0b34478b5fef33dc7fad0e5', 'request_id': 'req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:47.119042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6 admin admin] The token cache is being invalidate because project f625a04ba0b34478b5fef33dc7fad0e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:34:47.119510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:47.120531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6c011d70-03e1-48a6-a4ef-ac2fc91835c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:47.126105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 851/1718] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:34:46 2022] DELETE /identity/v3/projects/f625a04ba0b34478b5fef33dc7fad0e5 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:34:47.130307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810eb187-d2f0-4345-9b19-56125c8ba3b2 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:47.130659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810eb187-d2f0-4345-9b19-56125c8ba3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:47.131021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810eb187-d2f0-4345-9b19-56125c8ba3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:47.179660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8c893-a06e-45e5-9d23-8aaede7b2a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:47.179660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8c893-a06e-45e5-9d23-8aaede7b2a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:47.179660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8c893-a06e-45e5-9d23-8aaede7b2a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:47.179660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8c893-a06e-45e5-9d23-8aaede7b2a01 admin admin] PATH_INFO: `/v3/users/bd247a6da52345189195d8c3afa3e5e9` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:47.180989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8c893-a06e-45e5-9d23-8aaede7b2a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd247a6da52345189195d8c3afa3e5e9)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:47.186054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8c893-a06e-45e5-9d23-8aaede7b2a01 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:47.198946 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:47.221529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-810eb187-d2f0-4345-9b19-56125c8ba3b2 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:47.226799 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-810eb187-d2f0-4345-9b19-56125c8ba3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:47.251977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 852/1719] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:34:47.254537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf7a1-3bb3-4494-95bc-79edccd9f8c7 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:47.254827 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf7a1-3bb3-4494-95bc-79edccd9f8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:47.255101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf7a1-3bb3-4494-95bc-79edccd9f8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:47.323657 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-233cf7a1-3bb3-4494-95bc-79edccd9f8c7 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:47.329162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-233cf7a1-3bb3-4494-95bc-79edccd9f8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:47.350958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 853/1720] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:47.358073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cf7a1-3bb3-4494-95bc-79edccd9f8c7 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:47.380309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cf7a1-3bb3-4494-95bc-79edccd9f8c7 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:47.393849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac224e5e-03cc-4228-af8a-79bfe95784b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:47.394520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac224e5e-03cc-4228-af8a-79bfe95784b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:47.394756 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac224e5e-03cc-4228-af8a-79bfe95784b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:47.395047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac224e5e-03cc-4228-af8a-79bfe95784b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:47.396746 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac224e5e-03cc-4228-af8a-79bfe95784b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:47.399485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac224e5e-03cc-4228-af8a-79bfe95784b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:47.403408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac224e5e-03cc-4228-af8a-79bfe95784b3 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:47.452256 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 854/1721] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:34:47.460397 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac224e5e-03cc-4228-af8a-79bfe95784b3 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:47.499158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac224e5e-03cc-4228-af8a-79bfe95784b3 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:47.529023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b4c57-54d9-46d0-bb3d-c9282dfd5c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:47.530338 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b4c57-54d9-46d0-bb3d-c9282dfd5c8f admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:47.530625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b4c57-54d9-46d0-bb3d-c9282dfd5c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:47.530898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b4c57-54d9-46d0-bb3d-c9282dfd5c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:47.531545 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b4c57-54d9-46d0-bb3d-c9282dfd5c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:47.539752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b4c57-54d9-46d0-bb3d-c9282dfd5c8f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:47.546547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-11c8c893-a06e-45e5-9d23-8aaede7b2a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd247a6da52345189195d8c3afa3e5e9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:47.573860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-11c8c893-a06e-45e5-9d23-8aaede7b2a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd247a6da52345189195d8c3afa3e5e9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:47.576477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-11c8c893-a06e-45e5-9d23-8aaede7b2a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd247a6da52345189195d8c3afa3e5e9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:47.577569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-11c8c893-a06e-45e5-9d23-8aaede7b2a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd247a6da52345189195d8c3afa3e5e9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:47.704468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-11c8c893-a06e-45e5-9d23-8aaede7b2a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd247a6da52345189195d8c3afa3e5e9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:47.728390 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 855/1722] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:47 2022] POST /identity/v3/projects => generated 365 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:47.730713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b4c57-54d9-46d0-bb3d-c9282dfd5c8f admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:47.755533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b23b4c57-54d9-46d0-bb3d-c9282dfd5c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:47.765122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 868/1723] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:34:46 2022] DELETE /identity/v3/users/bd247a6da52345189195d8c3afa3e5e9 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:34:47.768667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1082-fc3d-4451-b239-f500d7042f8e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:47.768962 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1082-fc3d-4451-b239-f500d7042f8e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:47.769283 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1082-fc3d-4451-b239-f500d7042f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:47.783889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:47.845000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-220d1082-fc3d-4451-b239-f500d7042f8e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:47.851248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-220d1082-fc3d-4451-b239-f500d7042f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:47.972402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b4c57-54d9-46d0-bb3d-c9282dfd5c8f admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:48.089431 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 869/1724] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:48.090324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d1082-fc3d-4451-b239-f500d7042f8e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:48.100052 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-220d1082-fc3d-4451-b239-f500d7042f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:48.150871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d1082-fc3d-4451-b239-f500d7042f8e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:48.160684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:48.161338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:48.161613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:48.169721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] PATH_INFO: `/v3/users/e213281f032f4992a8bfd81035be8623` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:48.181548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e213281f032f4992a8bfd81035be8623)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:48.192507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:48.195470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c68646-7dfe-40a6-83a7-3e328ebf0ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:48.197148 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c68646-7dfe-40a6-83a7-3e328ebf0ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:48.204617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c68646-7dfe-40a6-83a7-3e328ebf0ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:48.205936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c68646-7dfe-40a6-83a7-3e328ebf0ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:48.209119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c68646-7dfe-40a6-83a7-3e328ebf0ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:48.217175 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c68646-7dfe-40a6-83a7-3e328ebf0ca4 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:48.372868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 856/1725] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:47 2022] POST /identity/v3/users => generated 283 bytes in 645 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:48.373907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c68646-7dfe-40a6-83a7-3e328ebf0ca4 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:48.376973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-16c68646-7dfe-40a6-83a7-3e328ebf0ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:48.531980 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e213281f032f4992a8bfd81035be8623'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:48.546134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c68646-7dfe-40a6-83a7-3e328ebf0ca4 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:48.552239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e213281f032f4992a8bfd81035be8623'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:48.555033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e213281f032f4992a8bfd81035be8623'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:48.555033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e213281f032f4992a8bfd81035be8623'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:48.555200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400e2f2-54a4-4ef1-af44-579e22cfe01e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:48.555200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400e2f2-54a4-4ef1-af44-579e22cfe01e service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:48.555200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400e2f2-54a4-4ef1-af44-579e22cfe01e service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:48.555200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400e2f2-54a4-4ef1-af44-579e22cfe01e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:48.557432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4400e2f2-54a4-4ef1-af44-579e22cfe01e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:48.588198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400e2f2-54a4-4ef1-af44-579e22cfe01e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:48.588198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400e2f2-54a4-4ef1-af44-579e22cfe01e service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:48.612867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 857/1726] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:48.614918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400e2f2-54a4-4ef1-af44-579e22cfe01e service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:48.630082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4400e2f2-54a4-4ef1-af44-579e22cfe01e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:48.641679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400e2f2-54a4-4ef1-af44-579e22cfe01e service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:48.655766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fe1e6-b1b8-41df-b30c-6f77c3b0c76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:48.656495 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fe1e6-b1b8-41df-b30c-6f77c3b0c76c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:48.656852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fe1e6-b1b8-41df-b30c-6f77c3b0c76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:48.657438 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fe1e6-b1b8-41df-b30c-6f77c3b0c76c admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:48.658171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fe1e6-b1b8-41df-b30c-6f77c3b0c76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:48.660793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fe1e6-b1b8-41df-b30c-6f77c3b0c76c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:48.662910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:48.664100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e213281f032f4992a8bfd81035be8623'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:48.697646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 858/1727] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:48.699994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 870/1728] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:34:48 2022] DELETE /identity/v3/users/e213281f032f4992a8bfd81035be8623 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:48.705553 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:48.706151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0085ed2-f95a-4bb2-9004-9294b1103dcd None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:48.706151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0085ed2-f95a-4bb2-9004-9294b1103dcd None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:48.706446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0085ed2-f95a-4bb2-9004-9294b1103dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:48.753223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d0085ed2-f95a-4bb2-9004-9294b1103dcd None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:48.753223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d0085ed2-f95a-4bb2-9004-9294b1103dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:48.874001 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760d680-d9b8-4501-b2bb-9d921e61455d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:48.885581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65146427-f10c-48e6-b3fb-821f445a54d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:48.887009 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65146427-f10c-48e6-b3fb-821f445a54d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:48.888281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65146427-f10c-48e6-b3fb-821f445a54d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:48.893816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65146427-f10c-48e6-b3fb-821f445a54d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:48.893816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65146427-f10c-48e6-b3fb-821f445a54d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:48.894086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 859/1729] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:48.894086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27723670-ee72-4815-913f-b16922e9cf0d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:48.894086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27723670-ee72-4815-913f-b16922e9cf0d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:48.894086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27723670-ee72-4815-913f-b16922e9cf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:48.895551 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65146427-f10c-48e6-b3fb-821f445a54d7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:48.949982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 871/1730] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:48.949982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935695-7c1c-4b3e-9443-c040bbbc4a17 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:48.950522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935695-7c1c-4b3e-9443-c040bbbc4a17 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:48.950593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935695-7c1c-4b3e-9443-c040bbbc4a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:48.970513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-27723670-ee72-4815-913f-b16922e9cf0d None None] MFA Rules not processed for user `58a89d6843d34c37814ec5508a7f1da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:48.978400 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-27723670-ee72-4815-913f-b16922e9cf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:49.035613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2a935695-7c1c-4b3e-9443-c040bbbc4a17 None None] MFA Rules not processed for user `becdc04dc32a469c89bca633b4173162`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:49.040321 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2a935695-7c1c-4b3e-9443-c040bbbc4a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:49.141025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 860/1731] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:49.141025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27723670-ee72-4815-913f-b16922e9cf0d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:49.180573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27723670-ee72-4815-913f-b16922e9cf0d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:49.193962 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a4d66-f67d-40a4-91f2-da3d08d3cd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:49.195339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a4d66-f67d-40a4-91f2-da3d08d3cd3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:49.195684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a4d66-f67d-40a4-91f2-da3d08d3cd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:49.196045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a4d66-f67d-40a4-91f2-da3d08d3cd3e admin admin] PATH_INFO: `/v3/projects/bab6d200d40b4202be77e86748fddc20/users/1902ae886449455aadf4a2f933eeea9f/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:49.219912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 872/1732] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:49.234462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a935695-7c1c-4b3e-9443-c040bbbc4a17 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:49.241197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2a935695-7c1c-4b3e-9443-c040bbbc4a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:49.241824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a4d66-f67d-40a4-91f2-da3d08d3cd3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab6d200d40b4202be77e86748fddc20, user_id=1902ae886449455aadf4a2f933eeea9f, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:49.245433 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a4d66-f67d-40a4-91f2-da3d08d3cd3e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:49.319101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:49.328658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 861/1733] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:49 2022] PUT /identity/v3/projects/bab6d200d40b4202be77e86748fddc20/users/1902ae886449455aadf4a2f933eeea9f/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:49.339312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a4d66-f67d-40a4-91f2-da3d08d3cd3e admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:49.344987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d77a4d66-f67d-40a4-91f2-da3d08d3cd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:49.403604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a935695-7c1c-4b3e-9443-c040bbbc4a17 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:49.535032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a4d66-f67d-40a4-91f2-da3d08d3cd3e admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:49.536683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928fcfe-e38a-420b-85ad-35522bcda894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:49.537325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928fcfe-e38a-420b-85ad-35522bcda894 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:49.537655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928fcfe-e38a-420b-85ad-35522bcda894 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:49.537955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928fcfe-e38a-420b-85ad-35522bcda894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:49.560679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0536ace-f147-4ab9-b58a-5cee14d43930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:49.561311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0536ace-f147-4ab9-b58a-5cee14d43930 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:49.562025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0536ace-f147-4ab9-b58a-5cee14d43930 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:49.564821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0536ace-f147-4ab9-b58a-5cee14d43930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:49.677011 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928fcfe-e38a-420b-85ad-35522bcda894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:49.680599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928fcfe-e38a-420b-85ad-35522bcda894 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:49.688109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0536ace-f147-4ab9-b58a-5cee14d43930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:49.691027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0536ace-f147-4ab9-b58a-5cee14d43930 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:49.696182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 873/1734] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:49.698175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d535d6-f3ad-4111-96a6-c5adba247446 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:49.698606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d535d6-f3ad-4111-96a6-c5adba247446 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:49.699539 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d535d6-f3ad-4111-96a6-c5adba247446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:49.702837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 862/1735] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:49.704634 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b7d94-84d6-4002-9c5f-855bda2e5d5f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:49.705066 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b7d94-84d6-4002-9c5f-855bda2e5d5f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:49.705462 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b7d94-84d6-4002-9c5f-855bda2e5d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:49.753473 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d1d535d6-f3ad-4111-96a6-c5adba247446 None None] MFA Rules not processed for user `becdc04dc32a469c89bca633b4173162`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:49.757560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d1d535d6-f3ad-4111-96a6-c5adba247446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:49.788656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b76b7d94-84d6-4002-9c5f-855bda2e5d5f None None] MFA Rules not processed for user `1902ae886449455aadf4a2f933eeea9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:49.791456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b76b7d94-84d6-4002-9c5f-855bda2e5d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:49.920730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 874/1736] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:49.920730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff439-1a78-4171-956b-b2ea6c2fd725 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:49.920730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff439-1a78-4171-956b-b2ea6c2fd725 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:49.932517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff439-1a78-4171-956b-b2ea6c2fd725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:49.962914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 863/1737] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:49.964101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d763e-ed5e-4442-9df8-d1a8f0511ec3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:49.964387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d763e-ed5e-4442-9df8-d1a8f0511ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:49.964656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d763e-ed5e-4442-9df8-d1a8f0511ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:50.003329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b59ff439-1a78-4171-956b-b2ea6c2fd725 None None] MFA Rules not processed for user `eac479fab6e84174857d9bea3be6f423`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:50.009551 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b59ff439-1a78-4171-956b-b2ea6c2fd725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:50.011717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ab9d763e-ed5e-4442-9df8-d1a8f0511ec3 None None] MFA Rules not processed for user `f040e47e66d145589b4233fe98c93507`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:50.013044 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ab9d763e-ed5e-4442-9df8-d1a8f0511ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:50.088503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 864/1738] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:50.090160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d763e-ed5e-4442-9df8-d1a8f0511ec3 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:50.093781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ab9d763e-ed5e-4442-9df8-d1a8f0511ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:50.106865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 875/1739] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:50.108132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ff439-1a78-4171-956b-b2ea6c2fd725 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:50.111065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d763e-ed5e-4442-9df8-d1a8f0511ec3 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:50.112257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b59ff439-1a78-4171-956b-b2ea6c2fd725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:50.116498 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:50.117705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:50.118177 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:50.118625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] PATH_INFO: `/v3/projects/64772d476b88454d993c65506b53d369` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:50.122379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64772d476b88454d993c65506b53d369)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:50.124648 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:50.150419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ff439-1a78-4171-956b-b2ea6c2fd725 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:50.166437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07a8c5-2eb7-4d6e-b6a4-09de6f7d54e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:50.167331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07a8c5-2eb7-4d6e-b6a4-09de6f7d54e5 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:50.167812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07a8c5-2eb7-4d6e-b6a4-09de6f7d54e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:50.168455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07a8c5-2eb7-4d6e-b6a4-09de6f7d54e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:50.181257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07a8c5-2eb7-4d6e-b6a4-09de6f7d54e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:50.183369 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07a8c5-2eb7-4d6e-b6a4-09de6f7d54e5 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:50.195037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 876/1740] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:50.196300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07a8c5-2eb7-4d6e-b6a4-09de6f7d54e5 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:50.209430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07a8c5-2eb7-4d6e-b6a4-09de6f7d54e5 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:50.214954 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cc351-61c3-445d-a42b-ab578d401528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:50.215799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cc351-61c3-445d-a42b-ab578d401528 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:50.216192 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cc351-61c3-445d-a42b-ab578d401528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:50.218541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cc351-61c3-445d-a42b-ab578d401528 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:50.218541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cc351-61c3-445d-a42b-ab578d401528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:50.219418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cc351-61c3-445d-a42b-ab578d401528 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:50.316768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64772d476b88454d993c65506b53d369', 'request_id': 'req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:50.336194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64772d476b88454d993c65506b53d369', 'request_id': 'req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:50.353182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 877/1741] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:50 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:50.363120 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e9c22-bdf0-44b9-bc44-87960e49dc11 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:50.363120 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e9c22-bdf0-44b9-bc44-87960e49dc11 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:50.367478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e9c22-bdf0-44b9-bc44-87960e49dc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:50.388434 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64772d476b88454d993c65506b53d369', 'request_id': 'req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:50.433169 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-800e9c22-bdf0-44b9-bc44-87960e49dc11 None None] MFA Rules not processed for user `eac479fab6e84174857d9bea3be6f423`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:50.434399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-800e9c22-bdf0-44b9-bc44-87960e49dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:50.527330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] The token cache is being invalidate because project 64772d476b88454d993c65506b53d369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:34:50.527849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:50.533008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:50.535844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 865/1742] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:34:50 2022] DELETE /identity/v3/projects/64772d476b88454d993c65506b53d369 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:50.537423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:50.542247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:50.550657 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 878/1743] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:50.551432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e9c22-bdf0-44b9-bc44-87960e49dc11 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:50.556833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-800e9c22-bdf0-44b9-bc44-87960e49dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:50.701946 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcd73f-453c-433d-b7f6-2fe5551d1dd9 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:50.729401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e9c22-bdf0-44b9-bc44-87960e49dc11 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:50.753531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:50.767939 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:50.768644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:50.768953 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] PATH_INFO: `/v3/users/e5794a18bd0a494fa10d318404103882` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:50.773529 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5794a18bd0a494fa10d318404103882)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:50.780843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:50.802514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310a94c-4804-42dc-a2ff-21488bbba9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:50.808877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310a94c-4804-42dc-a2ff-21488bbba9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:50.809089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310a94c-4804-42dc-a2ff-21488bbba9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:50.809434 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310a94c-4804-42dc-a2ff-21488bbba9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:50.810233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310a94c-4804-42dc-a2ff-21488bbba9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:50.814672 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310a94c-4804-42dc-a2ff-21488bbba9a6 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:50.999636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 866/1744] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:50 2022] POST /identity/v3/users => generated 288 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:51.001701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310a94c-4804-42dc-a2ff-21488bbba9a6 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:51.004794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6310a94c-4804-42dc-a2ff-21488bbba9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:51.025662 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310a94c-4804-42dc-a2ff-21488bbba9a6 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:51.041250 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daf012-9b8a-41fc-82b7-99410d133e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:51.043566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daf012-9b8a-41fc-82b7-99410d133e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:51.043863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daf012-9b8a-41fc-82b7-99410d133e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:51.044186 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daf012-9b8a-41fc-82b7-99410d133e3a admin admin] PATH_INFO: `/v3/projects/f6d250dab5e24b6ca6b2337b07733976` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:51.046596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daf012-9b8a-41fc-82b7-99410d133e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d250dab5e24b6ca6b2337b07733976)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:51.054245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daf012-9b8a-41fc-82b7-99410d133e3a admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:51.111749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5794a18bd0a494fa10d318404103882'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.126486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:51.132523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5794a18bd0a494fa10d318404103882'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.134656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5794a18bd0a494fa10d318404103882'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.135591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5794a18bd0a494fa10d318404103882'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.222312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d4daf012-9b8a-41fc-82b7-99410d133e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d250dab5e24b6ca6b2337b07733976', 'request_id': 'req-d4daf012-9b8a-41fc-82b7-99410d133e3a'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.225592 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5794a18bd0a494fa10d318404103882'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.239136 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d4daf012-9b8a-41fc-82b7-99410d133e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d250dab5e24b6ca6b2337b07733976', 'request_id': 'req-d4daf012-9b8a-41fc-82b7-99410d133e3a'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.254048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d4daf012-9b8a-41fc-82b7-99410d133e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d250dab5e24b6ca6b2337b07733976', 'request_id': 'req-d4daf012-9b8a-41fc-82b7-99410d133e3a'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.267071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 879/1745] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:34:50 2022] DELETE /identity/v3/users/e5794a18bd0a494fa10d318404103882 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:51.268023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:51.270193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:51.306949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:51.342274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d4daf012-9b8a-41fc-82b7-99410d133e3a admin admin] The token cache is being invalidate because project f6d250dab5e24b6ca6b2337b07733976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:34:51.342597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d4daf012-9b8a-41fc-82b7-99410d133e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.343315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d4daf012-9b8a-41fc-82b7-99410d133e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.345635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 867/1746] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:34:51 2022] DELETE /identity/v3/projects/f6d250dab5e24b6ca6b2337b07733976 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:51.348459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779690e2-40bd-4526-ad29-8e489ba0887f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:51.348738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779690e2-40bd-4526-ad29-8e489ba0887f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:51.349006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779690e2-40bd-4526-ad29-8e489ba0887f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:51.353198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 868/1747] 10.222.0.33 () {54 vars in 912 bytes} [Tue Oct 4 10:34:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:34:51.359372 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640690-1607-4e6d-bf98-842b8da12d7f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:51.359727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640690-1607-4e6d-bf98-842b8da12d7f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:51.359917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640690-1607-4e6d-bf98-842b8da12d7f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:51.361911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 869/1748] 10.222.0.33 () {54 vars in 912 bytes} [Tue Oct 4 10:34:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:34:51.362684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06640690-1607-4e6d-bf98-842b8da12d7f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:51.373823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-06640690-1607-4e6d-bf98-842b8da12d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:51.394978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f432d08-ba25-4314-8014-0836e44eb44e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:51.402743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06640690-1607-4e6d-bf98-842b8da12d7f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:51.405016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05668e22-486c-4b97-9896-57a68d292ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:51.405664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668e22-486c-4b97-9896-57a68d292ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:51.407087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668e22-486c-4b97-9896-57a68d292ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:51.407390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668e22-486c-4b97-9896-57a68d292ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:51.407981 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:51.408629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05668e22-486c-4b97-9896-57a68d292ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:51.408752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:51.408911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:51.409156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] PATH_INFO: `/v3/users/7a4c42f128d2449eb9762704b4469cfa` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:51.410294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4c42f128d2449eb9762704b4469cfa)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:51.411807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05668e22-486c-4b97-9896-57a68d292ebe admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:51.412339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:51.446264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 880/1749] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:51.447721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c95ac-6953-49bd-890e-f59540fb61c4 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:51.448071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c95ac-6953-49bd-890e-f59540fb61c4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:51.448352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c95ac-6953-49bd-890e-f59540fb61c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:51.567298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-511c95ac-6953-49bd-890e-f59540fb61c4 None None] MFA Rules not processed for user `b040de20aa6f4e7b8366c7daa54c093c`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:51.568607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-511c95ac-6953-49bd-890e-f59540fb61c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:51.635195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 881/1750] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:34:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:51.648396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd8159-3b08-4fa4-8903-d2639d414a49 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:51.648686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd8159-3b08-4fa4-8903-d2639d414a49 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:51.650735 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd8159-3b08-4fa4-8903-d2639d414a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:51.677410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4c42f128d2449eb9762704b4469cfa'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.694810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c5dd8159-3b08-4fa4-8903-d2639d414a49 None None] MFA Rules not processed for user `b040de20aa6f4e7b8366c7daa54c093c`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:51.696459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c5dd8159-3b08-4fa4-8903-d2639d414a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:51.697148 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4c42f128d2449eb9762704b4469cfa'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.701526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4c42f128d2449eb9762704b4469cfa'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.713248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 882/1751] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:34:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:51.714158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd8159-3b08-4fa4-8903-d2639d414a49 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:51.716152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c5dd8159-3b08-4fa4-8903-d2639d414a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:51.734614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd8159-3b08-4fa4-8903-d2639d414a49 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:51.752841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93810574-0843-49d8-8605-d727d398d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:51.752841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93810574-0843-49d8-8605-d727d398d30e admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:51.752841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93810574-0843-49d8-8605-d727d398d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:51.752841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93810574-0843-49d8-8605-d727d398d30e admin admin] PATH_INFO: `/v3/projects/5de3491437804cd89e682867f5efcede/users/77b8fa3f57864f6b81a51c14846b123f/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:51.773488 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93810574-0843-49d8-8605-d727d398d30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de3491437804cd89e682867f5efcede, user_id=77b8fa3f57864f6b81a51c14846b123f, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:51.780246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93810574-0843-49d8-8605-d727d398d30e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:51.821630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4c42f128d2449eb9762704b4469cfa'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.848255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4c42f128d2449eb9762704b4469cfa'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:51.856605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 870/1752] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:34:51 2022] DELETE /identity/v3/users/7a4c42f128d2449eb9762704b4469cfa => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:51.857469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:51.862145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 883/1753] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:51 2022] PUT /identity/v3/projects/5de3491437804cd89e682867f5efcede/users/77b8fa3f57864f6b81a51c14846b123f/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:51.862145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93810574-0843-49d8-8605-d727d398d30e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:51.862361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:51.865943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-93810574-0843-49d8-8605-d727d398d30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:51.970252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb2c0e-ea25-49bf-a99b-09ea12d60570 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:51.990260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7ee27-4952-42c5-a592-ce415490e8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:51.990260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7ee27-4952-42c5-a592-ce415490e8ab service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:51.990260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7ee27-4952-42c5-a592-ce415490e8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:51.996885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7ee27-4952-42c5-a592-ce415490e8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:52.002001 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a8b7ee27-4952-42c5-a592-ce415490e8ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:52.007822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93810574-0843-49d8-8605-d727d398d30e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:52.012234 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4d179-594c-4f9e-8eac-7ba96728674b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:52.012682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4d179-594c-4f9e-8eac-7ba96728674b service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:52.012987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4d179-594c-4f9e-8eac-7ba96728674b service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:52.013258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4d179-594c-4f9e-8eac-7ba96728674b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:52.031851 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4d179-594c-4f9e-8eac-7ba96728674b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:52.033534 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4d179-594c-4f9e-8eac-7ba96728674b service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:52.045542 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7ee27-4952-42c5-a592-ce415490e8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:52.049082 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 884/1754] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:52.049817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4d179-594c-4f9e-8eac-7ba96728674b service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:52.061604 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7ee27-4952-42c5-a592-ce415490e8ab service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:52.088991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 871/1755] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:52.132332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7ee27-4952-42c5-a592-ce415490e8ab service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:52.135670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a8b7ee27-4952-42c5-a592-ce415490e8ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:52.269673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4d179-594c-4f9e-8eac-7ba96728674b service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:52.282360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9da1f-6976-4575-97a5-299d0190ec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:52.283151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9da1f-6976-4575-97a5-299d0190ec16 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:52.283532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9da1f-6976-4575-97a5-299d0190ec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:52.283906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9da1f-6976-4575-97a5-299d0190ec16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:52.284747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9da1f-6976-4575-97a5-299d0190ec16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:52.287113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7ee27-4952-42c5-a592-ce415490e8ab service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:52.287760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9da1f-6976-4575-97a5-299d0190ec16 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:52.308607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 885/1756] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:52.309872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9428ef6-aac6-4686-99f6-b9b114576fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:52.310719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428ef6-aac6-4686-99f6-b9b114576fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:52.311122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428ef6-aac6-4686-99f6-b9b114576fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:52.312151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428ef6-aac6-4686-99f6-b9b114576fed admin admin] PATH_INFO: `/v3/projects/e0c7d4423b2c47df8b52a46490ad858b` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:52.313206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9da1f-6976-4575-97a5-299d0190ec16 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:52.314105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9428ef6-aac6-4686-99f6-b9b114576fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c7d4423b2c47df8b52a46490ad858b)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:52.316910 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9428ef6-aac6-4686-99f6-b9b114576fed admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:52.327303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9da1f-6976-4575-97a5-299d0190ec16 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:52.335860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474f6e8-dc31-47bf-b654-4b460d9e9ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:52.335860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474f6e8-dc31-47bf-b654-4b460d9e9ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:52.335860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474f6e8-dc31-47bf-b654-4b460d9e9ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:52.335860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474f6e8-dc31-47bf-b654-4b460d9e9ebb admin admin] PATH_INFO: `/v3/projects/5de3491437804cd89e682867f5efcede/users/77b8fa3f57864f6b81a51c14846b123f/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:52.338414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474f6e8-dc31-47bf-b654-4b460d9e9ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de3491437804cd89e682867f5efcede, user_id=77b8fa3f57864f6b81a51c14846b123f, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:52.342424 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474f6e8-dc31-47bf-b654-4b460d9e9ebb admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:52.384373 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 886/1757] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:52 2022] PUT /identity/v3/projects/5de3491437804cd89e682867f5efcede/users/77b8fa3f57864f6b81a51c14846b123f/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:52.386415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70620c84-5a4a-44dc-950e-b092a9d636f5 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:52.386818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70620c84-5a4a-44dc-950e-b092a9d636f5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:52.387159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70620c84-5a4a-44dc-950e-b092a9d636f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:52.446133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-70620c84-5a4a-44dc-950e-b092a9d636f5 None None] MFA Rules not processed for user `77b8fa3f57864f6b81a51c14846b123f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:52.449849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-70620c84-5a4a-44dc-950e-b092a9d636f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:52.620941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e9428ef6-aac6-4686-99f6-b9b114576fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c7d4423b2c47df8b52a46490ad858b', 'request_id': 'req-e9428ef6-aac6-4686-99f6-b9b114576fed'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:52.654389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e9428ef6-aac6-4686-99f6-b9b114576fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c7d4423b2c47df8b52a46490ad858b', 'request_id': 'req-e9428ef6-aac6-4686-99f6-b9b114576fed'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:52.674937 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e9428ef6-aac6-4686-99f6-b9b114576fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c7d4423b2c47df8b52a46490ad858b', 'request_id': 'req-e9428ef6-aac6-4686-99f6-b9b114576fed'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:52.712443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 887/1758] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:52.724000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70620c84-5a4a-44dc-950e-b092a9d636f5 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:52.726634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-70620c84-5a4a-44dc-950e-b092a9d636f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:52.762206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e9428ef6-aac6-4686-99f6-b9b114576fed admin admin] The token cache is being invalidate because project e0c7d4423b2c47df8b52a46490ad858b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:34:52.762704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e9428ef6-aac6-4686-99f6-b9b114576fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:52.764825 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e9428ef6-aac6-4686-99f6-b9b114576fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:52.770049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 872/1759] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:34:52 2022] DELETE /identity/v3/projects/e0c7d4423b2c47df8b52a46490ad858b => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:34:52.771753 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33317612-1135-4de9-8a02-b5762867c91e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:52.772166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33317612-1135-4de9-8a02-b5762867c91e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:52.773095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33317612-1135-4de9-8a02-b5762867c91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:52.822706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70620c84-5a4a-44dc-950e-b092a9d636f5 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:52.823252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-33317612-1135-4de9-8a02-b5762867c91e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:52.824962 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-33317612-1135-4de9-8a02-b5762867c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:52.970490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541853d-5d93-4b7b-bc26-6249c75c8fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:52.971191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541853d-5d93-4b7b-bc26-6249c75c8fdc service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:52.971380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541853d-5d93-4b7b-bc26-6249c75c8fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:52.971650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541853d-5d93-4b7b-bc26-6249c75c8fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:52.974729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 873/1760] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:52.978564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33317612-1135-4de9-8a02-b5762867c91e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:52.979310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0541853d-5d93-4b7b-bc26-6249c75c8fdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:52.981456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-33317612-1135-4de9-8a02-b5762867c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:53.123618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541853d-5d93-4b7b-bc26-6249c75c8fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:53.125874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541853d-5d93-4b7b-bc26-6249c75c8fdc service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:53.164032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 888/1761] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:53.167386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6f065-9987-43bf-88f5-4d76a7f7f7f9 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:53.167677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6f065-9987-43bf-88f5-4d76a7f7f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:53.167983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6f065-9987-43bf-88f5-4d76a7f7f7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:53.181400 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33317612-1135-4de9-8a02-b5762867c91e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:53.196547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320916d2-4f28-4a9c-8298-582e10b456f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:53.198670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320916d2-4f28-4a9c-8298-582e10b456f9 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:53.198670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320916d2-4f28-4a9c-8298-582e10b456f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:53.198670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320916d2-4f28-4a9c-8298-582e10b456f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:53.202693 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-320916d2-4f28-4a9c-8298-582e10b456f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:53.227901 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a1b6f065-9987-43bf-88f5-4d76a7f7f7f9 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:53.231474 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a1b6f065-9987-43bf-88f5-4d76a7f7f7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:53.260404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 889/1762] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:53.260404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6f065-9987-43bf-88f5-4d76a7f7f7f9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:53.260404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a1b6f065-9987-43bf-88f5-4d76a7f7f7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:53.283726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:53.390259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6f065-9987-43bf-88f5-4d76a7f7f7f9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:53.405042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a8286-4bbb-49ca-80ea-7fb93270b400 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:53.406257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8286-4bbb-49ca-80ea-7fb93270b400 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:53.408223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8286-4bbb-49ca-80ea-7fb93270b400 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:53.408595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8286-4bbb-49ca-80ea-7fb93270b400 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:53.419976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-809a8286-4bbb-49ca-80ea-7fb93270b400 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:53.433561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320916d2-4f28-4a9c-8298-582e10b456f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:53.433561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320916d2-4f28-4a9c-8298-582e10b456f9 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:53.447291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a8286-4bbb-49ca-80ea-7fb93270b400 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:53.453144 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a8286-4bbb-49ca-80ea-7fb93270b400 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:53.454601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 874/1763] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:53.455676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320916d2-4f28-4a9c-8298-582e10b456f9 service nova] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:53.470242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320916d2-4f28-4a9c-8298-582e10b456f9 service nova] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:53.476381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d21cdf-599a-48fb-8f4d-e19d42cc3986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:53.477200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d21cdf-599a-48fb-8f4d-e19d42cc3986 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:53.478158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d21cdf-599a-48fb-8f4d-e19d42cc3986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:53.478577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d21cdf-599a-48fb-8f4d-e19d42cc3986 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:53.479396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d21cdf-599a-48fb-8f4d-e19d42cc3986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:53.479841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d21cdf-599a-48fb-8f4d-e19d42cc3986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:53.484553 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 890/1764] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:53.486364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c709cc-89c4-43cc-b42f-fda899b9dced None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:53.486658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c709cc-89c4-43cc-b42f-fda899b9dced None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:53.486986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c709cc-89c4-43cc-b42f-fda899b9dced None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:53.489600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 891/1765] 10.222.0.33 () {54 vars in 961 bytes} [Tue Oct 4 10:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:34:53.490361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c709cc-89c4-43cc-b42f-fda899b9dced None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:53.502196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d9c709cc-89c4-43cc-b42f-fda899b9dced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:53.508760 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d21cdf-599a-48fb-8f4d-e19d42cc3986 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:53.526549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:53.537948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 875/1766] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:53.542930 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c709cc-89c4-43cc-b42f-fda899b9dced None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:53.549936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53891e8e-f0b4-49ce-86ef-bd4589678241 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:53.550343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53891e8e-f0b4-49ce-86ef-bd4589678241 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:53.550618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53891e8e-f0b4-49ce-86ef-bd4589678241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:53.556727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:53.558089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:53.558089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:53.558089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] PATH_INFO: `/v3/projects/f642fd8bdd384a06aa6e122004f90c94` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:53.564151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f642fd8bdd384a06aa6e122004f90c94)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:53.564151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:53.610952 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-53891e8e-f0b4-49ce-86ef-bd4589678241 None None] MFA Rules not processed for user `505c7c48b0d14dc9af8006cc7e8eea53`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:53.614726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-53891e8e-f0b4-49ce-86ef-bd4589678241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:53.647561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 876/1767] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Oct 4 10:34:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:53.648944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53891e8e-f0b4-49ce-86ef-bd4589678241 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:53.674430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53891e8e-f0b4-49ce-86ef-bd4589678241 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:53.685588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc579dc-821a-4df2-946c-8dae5340f887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:53.686394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc579dc-821a-4df2-946c-8dae5340f887 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:53.687018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc579dc-821a-4df2-946c-8dae5340f887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:53.687429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc579dc-821a-4df2-946c-8dae5340f887 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:53.688563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc579dc-821a-4df2-946c-8dae5340f887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:53.694149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc579dc-821a-4df2-946c-8dae5340f887 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:53.775882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f642fd8bdd384a06aa6e122004f90c94', 'request_id': 'req-37590309-834c-48bc-9096-a62b685e3237'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:53.783170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f642fd8bdd384a06aa6e122004f90c94', 'request_id': 'req-37590309-834c-48bc-9096-a62b685e3237'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:53.869212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 877/1768] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:53 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:53.873917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc579dc-821a-4df2-946c-8dae5340f887 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:53.878350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f642fd8bdd384a06aa6e122004f90c94', 'request_id': 'req-37590309-834c-48bc-9096-a62b685e3237'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:53.895041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] The token cache is being invalidate because project f642fd8bdd384a06aa6e122004f90c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:34:53.895338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:53.896855 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:53.901320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 892/1769] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:34:53 2022] DELETE /identity/v3/projects/f642fd8bdd384a06aa6e122004f90c94 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:53.902177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:53.903568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:54.068418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590309-834c-48bc-9096-a62b685e3237 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:54.077091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc579dc-821a-4df2-946c-8dae5340f887 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:54.102631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ed0d0-c9c0-49ff-923b-56dc947e0d81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:54.103732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ed0d0-c9c0-49ff-923b-56dc947e0d81 service placement] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:54.104292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ed0d0-c9c0-49ff-923b-56dc947e0d81 service placement] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:54.106163 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ed0d0-c9c0-49ff-923b-56dc947e0d81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:54.111296 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-444ed0d0-c9c0-49ff-923b-56dc947e0d81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:54.157845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ed0d0-c9c0-49ff-923b-56dc947e0d81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:54.162624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ed0d0-c9c0-49ff-923b-56dc947e0d81 service placement] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:54.177467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53813af5-563c-43ff-b901-3f400a36e3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:54.186496 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53813af5-563c-43ff-b901-3f400a36e3ba admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:54.187765 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53813af5-563c-43ff-b901-3f400a36e3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:54.188320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53813af5-563c-43ff-b901-3f400a36e3ba admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:54.189950 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53813af5-563c-43ff-b901-3f400a36e3ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:54.195003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53813af5-563c-43ff-b901-3f400a36e3ba admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:54.198478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 878/1770] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:54.209188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0de90-4c43-4e8c-b2c1-a4cf4c54c81c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:54.209188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0de90-4c43-4e8c-b2c1-a4cf4c54c81c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:54.209188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0de90-4c43-4e8c-b2c1-a4cf4c54c81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:54.245234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-65c0de90-4c43-4e8c-b2c1-a4cf4c54c81c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:54.245234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-65c0de90-4c43-4e8c-b2c1-a4cf4c54c81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:54.262865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 879/1771] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:54.268836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942dbe-1103-4e03-8b30-a4db22cd1f22 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:54.269339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942dbe-1103-4e03-8b30-a4db22cd1f22 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:54.269794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942dbe-1103-4e03-8b30-a4db22cd1f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:54.300872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-fb942dbe-1103-4e03-8b30-a4db22cd1f22 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:54.302560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fb942dbe-1103-4e03-8b30-a4db22cd1f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:54.336025 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 893/1772] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:53 2022] POST /identity/v3/users => generated 293 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:54.336180 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 880/1773] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:54.338190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53813af5-563c-43ff-b901-3f400a36e3ba admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:54.347600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942dbe-1103-4e03-8b30-a4db22cd1f22 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:54.389193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53813af5-563c-43ff-b901-3f400a36e3ba admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:54.392780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942dbe-1103-4e03-8b30-a4db22cd1f22 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:54.438457 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b845c-79d8-4d6d-9529-8d03849e9db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:54.439362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b845c-79d8-4d6d-9529-8d03849e9db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:54.440383 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b845c-79d8-4d6d-9529-8d03849e9db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:54.441121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b845c-79d8-4d6d-9529-8d03849e9db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:54.441841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b845c-79d8-4d6d-9529-8d03849e9db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:34:54.444667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b845c-79d8-4d6d-9529-8d03849e9db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:54.444667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b845c-79d8-4d6d-9529-8d03849e9db4 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:54.456718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387cfc6-2803-436a-b473-c0fd3f68a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:54.458579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 881/1774] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:34:54.459217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387cfc6-2803-436a-b473-c0fd3f68a939 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:54.463252 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387cfc6-2803-436a-b473-c0fd3f68a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:54.463407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b845c-79d8-4d6d-9529-8d03849e9db4 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:54.465400 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387cfc6-2803-436a-b473-c0fd3f68a939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:54.467530 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387cfc6-2803-436a-b473-c0fd3f68a939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:54.477142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387cfc6-2803-436a-b473-c0fd3f68a939 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:54.478788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b845c-79d8-4d6d-9529-8d03849e9db4 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:54.486439 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75a3ec-2a8a-496f-ad13-b652dee5adb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:54.487507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75a3ec-2a8a-496f-ad13-b652dee5adb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:54.487886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75a3ec-2a8a-496f-ad13-b652dee5adb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:54.488301 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75a3ec-2a8a-496f-ad13-b652dee5adb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:54.489578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75a3ec-2a8a-496f-ad13-b652dee5adb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:54.501859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:54.505938 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75a3ec-2a8a-496f-ad13-b652dee5adb5 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:54.527696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 894/1775] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:54.529134 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387cfc6-2803-436a-b473-c0fd3f68a939 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:54.556232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387cfc6-2803-436a-b473-c0fd3f68a939 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:54.561982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80b75a-a938-43fa-a18d-305d278195b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:54.564455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80b75a-a938-43fa-a18d-305d278195b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:54.564743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80b75a-a938-43fa-a18d-305d278195b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:54.565167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80b75a-a938-43fa-a18d-305d278195b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:54.568433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80b75a-a938-43fa-a18d-305d278195b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:54.570570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80b75a-a938-43fa-a18d-305d278195b3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:54.587996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 895/1776] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:54.596968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80b75a-a938-43fa-a18d-305d278195b3 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:54.610921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80b75a-a938-43fa-a18d-305d278195b3 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:54.619674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98e59e-128e-431d-a1c7-b0a0b41c6ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:54.621076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98e59e-128e-431d-a1c7-b0a0b41c6ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:54.621610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98e59e-128e-431d-a1c7-b0a0b41c6ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:54.622771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98e59e-128e-431d-a1c7-b0a0b41c6ed4 admin admin] PATH_INFO: `/v3/projects/f738dc459c164cce81788f4e354ce981/users/42327e2706d846719eb7e4714e497689/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:54.663104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98e59e-128e-431d-a1c7-b0a0b41c6ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f738dc459c164cce81788f4e354ce981, user_id=42327e2706d846719eb7e4714e497689, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:54.667225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98e59e-128e-431d-a1c7-b0a0b41c6ed4 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:54.685801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 882/1777] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:54 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:54.686979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75a3ec-2a8a-496f-ad13-b652dee5adb5 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:54.796163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 896/1778] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:54 2022] PUT /identity/v3/projects/f738dc459c164cce81788f4e354ce981/users/42327e2706d846719eb7e4714e497689/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:54.797220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98e59e-128e-431d-a1c7-b0a0b41c6ed4 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:54.800353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ef98e59e-128e-431d-a1c7-b0a0b41c6ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:54.866531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75a3ec-2a8a-496f-ad13-b652dee5adb5 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:54.921343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98e59e-128e-431d-a1c7-b0a0b41c6ed4 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:54.935771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:54.936537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:54.936822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:54.937094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] PATH_INFO: `/v3/users/1902ae886449455aadf4a2f933eeea9f` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:54.938240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29d567-8a46-409a-87e8-8a570082abd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:54.939801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29d567-8a46-409a-87e8-8a570082abd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:54.940578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29d567-8a46-409a-87e8-8a570082abd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:54.941053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29d567-8a46-409a-87e8-8a570082abd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:54.941170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1902ae886449455aadf4a2f933eeea9f)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:54.942182 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29d567-8a46-409a-87e8-8a570082abd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:54.943259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:54.948371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29d567-8a46-409a-87e8-8a570082abd1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:55.033180 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 883/1779] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:54 2022] POST /identity/v3/users => generated 288 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:55.034679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d673c4-a1f1-430f-8f00-292fe7d06ea7 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:55.035033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d673c4-a1f1-430f-8f00-292fe7d06ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:55.035378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d673c4-a1f1-430f-8f00-292fe7d06ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:55.090218 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b7d673c4-a1f1-430f-8f00-292fe7d06ea7 None None] MFA Rules not processed for user `42327e2706d846719eb7e4714e497689`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:55.091499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b7d673c4-a1f1-430f-8f00-292fe7d06ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:55.227372 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:55.238317 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1902ae886449455aadf4a2f933eeea9f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:55.248879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 884/1780] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:55.250218 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d673c4-a1f1-430f-8f00-292fe7d06ea7 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:55.255199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1902ae886449455aadf4a2f933eeea9f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:55.255932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1902ae886449455aadf4a2f933eeea9f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:55.259468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1902ae886449455aadf4a2f933eeea9f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:55.283302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d673c4-a1f1-430f-8f00-292fe7d06ea7 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:55.318614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f471571-5fff-4153-ba25-64aef0a4b135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:55.319297 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471571-5fff-4153-ba25-64aef0a4b135 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:55.319598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471571-5fff-4153-ba25-64aef0a4b135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:55.319983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471571-5fff-4153-ba25-64aef0a4b135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:55.320716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f471571-5fff-4153-ba25-64aef0a4b135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:55.322331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f471571-5fff-4153-ba25-64aef0a4b135 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:55.351496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 885/1781] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:55.353579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e91f9-614e-4995-aa0f-1543114754d6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:55.354022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e91f9-614e-4995-aa0f-1543114754d6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:55.355425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e91f9-614e-4995-aa0f-1543114754d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:55.386325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1902ae886449455aadf4a2f933eeea9f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:55.428425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 897/1782] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:34:54 2022] DELETE /identity/v3/users/1902ae886449455aadf4a2f933eeea9f => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:55.429338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:55.435281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:55.440961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-676e91f9-614e-4995-aa0f-1543114754d6 None None] MFA Rules not processed for user `eac479fab6e84174857d9bea3be6f423`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:55.442448 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-676e91f9-614e-4995-aa0f-1543114754d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:55.548266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 886/1783] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:55.549827 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e91f9-614e-4995-aa0f-1543114754d6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:55.551105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-676e91f9-614e-4995-aa0f-1543114754d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:55.572690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35022b-bbeb-4f92-b4fc-b1142bbbda7d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:55.580891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e4158-3317-4136-bcb1-7edbc1f7839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:55.581746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e4158-3317-4136-bcb1-7edbc1f7839c admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:55.582418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e4158-3317-4136-bcb1-7edbc1f7839c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:55.582418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e4158-3317-4136-bcb1-7edbc1f7839c admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:55.582906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e4158-3317-4136-bcb1-7edbc1f7839c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:55.585363 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e4158-3317-4136-bcb1-7edbc1f7839c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:55.645517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e91f9-614e-4995-aa0f-1543114754d6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:55.672787 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3487635-762e-4dc7-916c-2c1903a884bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:55.673432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3487635-762e-4dc7-916c-2c1903a884bb admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:55.673729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3487635-762e-4dc7-916c-2c1903a884bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:55.673980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3487635-762e-4dc7-916c-2c1903a884bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:55.674820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3487635-762e-4dc7-916c-2c1903a884bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:55.676268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3487635-762e-4dc7-916c-2c1903a884bb admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:55.688482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 898/1784] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:55 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:55.691340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057fd63-5906-484b-84e1-b12c7306117a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:55.696942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057fd63-5906-484b-84e1-b12c7306117a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:55.697289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057fd63-5906-484b-84e1-b12c7306117a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:55.698856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 887/1785] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:55.703533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71f4d8-4360-4b8a-9e9d-e5c047d75088 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:55.703533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71f4d8-4360-4b8a-9e9d-e5c047d75088 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:55.703533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71f4d8-4360-4b8a-9e9d-e5c047d75088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:55.746650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-fd71f4d8-4360-4b8a-9e9d-e5c047d75088 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:55.747882 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fd71f4d8-4360-4b8a-9e9d-e5c047d75088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:55.755795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9057fd63-5906-484b-84e1-b12c7306117a None None] MFA Rules not processed for user `58a89d6843d34c37814ec5508a7f1da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:55.757710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9057fd63-5906-484b-84e1-b12c7306117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:55.872146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 888/1786] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:55.872146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71f4d8-4360-4b8a-9e9d-e5c047d75088 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:55.892788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 899/1787] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:55.897977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057fd63-5906-484b-84e1-b12c7306117a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:55.957935 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057fd63-5906-484b-84e1-b12c7306117a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:55.974139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71f4d8-4360-4b8a-9e9d-e5c047d75088 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:55.976993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44e724-8f7b-4107-abca-42359265a062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:55.982608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44e724-8f7b-4107-abca-42359265a062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:55.982608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44e724-8f7b-4107-abca-42359265a062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:55.982608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44e724-8f7b-4107-abca-42359265a062 admin admin] PATH_INFO: `/v3/projects/4cf99bde65364d9aad83d50bfd365b08/users/6d005cabfedf44ac92235f37939b4c61/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:56.010905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52049b-2214-428d-b156-7af5463e30bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:56.011540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52049b-2214-428d-b156-7af5463e30bc admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:56.011813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52049b-2214-428d-b156-7af5463e30bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:56.015448 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52049b-2214-428d-b156-7af5463e30bc admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:56.016148 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52049b-2214-428d-b156-7af5463e30bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:56.027566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52049b-2214-428d-b156-7af5463e30bc admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:56.052918 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44e724-8f7b-4107-abca-42359265a062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf99bde65364d9aad83d50bfd365b08, user_id=6d005cabfedf44ac92235f37939b4c61, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:56.056477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44e724-8f7b-4107-abca-42359265a062 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:56.163651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 900/1788] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:55 2022] PUT /identity/v3/projects/4cf99bde65364d9aad83d50bfd365b08/users/6d005cabfedf44ac92235f37939b4c61/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:56.164723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44e724-8f7b-4107-abca-42359265a062 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:56.169133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0a44e724-8f7b-4107-abca-42359265a062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:56.174565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 889/1789] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:55 2022] POST /identity/v3/users => generated 300 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:56.176600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0a2c-7cc6-44da-8068-aeafe12a5544 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:56.176970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0a2c-7cc6-44da-8068-aeafe12a5544 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:56.177312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0a2c-7cc6-44da-8068-aeafe12a5544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:56.260249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-68cc0a2c-7cc6-44da-8068-aeafe12a5544 None None] MFA Rules not processed for user `6d005cabfedf44ac92235f37939b4c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:56.262369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-68cc0a2c-7cc6-44da-8068-aeafe12a5544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:56.273702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44e724-8f7b-4107-abca-42359265a062 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:56.278495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444b814-7806-43c3-9f82-0e3d53a5a6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:56.279286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444b814-7806-43c3-9f82-0e3d53a5a6fb service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:56.280184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444b814-7806-43c3-9f82-0e3d53a5a6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:56.280756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444b814-7806-43c3-9f82-0e3d53a5a6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:56.364950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 890/1790] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:56.366041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc0a2c-7cc6-44da-8068-aeafe12a5544 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:56.498660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444b814-7806-43c3-9f82-0e3d53a5a6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:56.500482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444b814-7806-43c3-9f82-0e3d53a5a6fb service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:56.531552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 901/1791] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:56.533073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444b814-7806-43c3-9f82-0e3d53a5a6fb service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:56.541485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc0a2c-7cc6-44da-8068-aeafe12a5544 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:56.573580 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e9c6f-5211-4ac1-b6d9-2157aa07270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:56.574227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e9c6f-5211-4ac1-b6d9-2157aa07270d admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:56.574506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e9c6f-5211-4ac1-b6d9-2157aa07270d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:56.574779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e9c6f-5211-4ac1-b6d9-2157aa07270d admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:56.575438 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e9c6f-5211-4ac1-b6d9-2157aa07270d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:56.577075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e9c6f-5211-4ac1-b6d9-2157aa07270d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:56.587449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444b814-7806-43c3-9f82-0e3d53a5a6fb service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:56.601117 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e85307-46db-4b28-aafb-d766aaca6181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:56.602975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85307-46db-4b28-aafb-d766aaca6181 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:56.603419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85307-46db-4b28-aafb-d766aaca6181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:56.603846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85307-46db-4b28-aafb-d766aaca6181 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:56.609630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 891/1792] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:56.610151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e85307-46db-4b28-aafb-d766aaca6181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:56.610568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e9c6f-5211-4ac1-b6d9-2157aa07270d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:56.613682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e85307-46db-4b28-aafb-d766aaca6181 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:56.630801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e9c6f-5211-4ac1-b6d9-2157aa07270d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:56.642887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110063d5-3fdd-4d48-998c-79071e8b1073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:56.646492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110063d5-3fdd-4d48-998c-79071e8b1073 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:56.646492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110063d5-3fdd-4d48-998c-79071e8b1073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:56.646492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110063d5-3fdd-4d48-998c-79071e8b1073 admin admin] PATH_INFO: `/v3/projects/4e9c410c138b4ff7a417a6edce892183/users/fbf99f1379be4613a3588398f06ae2b7/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:56.679866 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110063d5-3fdd-4d48-998c-79071e8b1073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9c410c138b4ff7a417a6edce892183, user_id=fbf99f1379be4613a3588398f06ae2b7, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:56.682788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110063d5-3fdd-4d48-998c-79071e8b1073 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:56.790715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 902/1793] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:34:56 2022] POST /identity/v3/projects => generated 377 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:56.806917 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e85307-46db-4b28-aafb-d766aaca6181 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:56.830496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 892/1794] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:56 2022] PUT /identity/v3/projects/4e9c410c138b4ff7a417a6edce892183/users/fbf99f1379be4613a3588398f06ae2b7/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:56.834615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110063d5-3fdd-4d48-998c-79071e8b1073 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:56.989130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110063d5-3fdd-4d48-998c-79071e8b1073 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:57.004704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003632a-5d36-4a5b-834f-4d864eaf8eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:57.005629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003632a-5d36-4a5b-834f-4d864eaf8eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:57.009086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003632a-5d36-4a5b-834f-4d864eaf8eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:57.009086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003632a-5d36-4a5b-834f-4d864eaf8eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:57.009086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003632a-5d36-4a5b-834f-4d864eaf8eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:57.012788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003632a-5d36-4a5b-834f-4d864eaf8eb5 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:57.026418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e85307-46db-4b28-aafb-d766aaca6181 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:57.029457 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 893/1795] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:57.034890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003632a-5d36-4a5b-834f-4d864eaf8eb5 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:57.042150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57263fb-4949-4b3e-b186-3cf26911b6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:57.042150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57263fb-4949-4b3e-b186-3cf26911b6fc admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:57.042150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57263fb-4949-4b3e-b186-3cf26911b6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:57.042150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57263fb-4949-4b3e-b186-3cf26911b6fc admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:57.042466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57263fb-4949-4b3e-b186-3cf26911b6fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:57.042466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57263fb-4949-4b3e-b186-3cf26911b6fc admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:57.049323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003632a-5d36-4a5b-834f-4d864eaf8eb5 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:57.079586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac46fc4-b4cb-47bb-837f-9afa5b83a7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:57.079586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac46fc4-b4cb-47bb-837f-9afa5b83a7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:57.079586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac46fc4-b4cb-47bb-837f-9afa5b83a7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:57.082110 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac46fc4-b4cb-47bb-837f-9afa5b83a7bb admin admin] PATH_INFO: `/v3/projects/4e9c410c138b4ff7a417a6edce892183/users/fbf99f1379be4613a3588398f06ae2b7/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:57.082110 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac46fc4-b4cb-47bb-837f-9afa5b83a7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9c410c138b4ff7a417a6edce892183, user_id=fbf99f1379be4613a3588398f06ae2b7, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:57.111187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac46fc4-b4cb-47bb-837f-9afa5b83a7bb admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:57.136670 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 903/1796] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:34:56 2022] POST /identity/v3/users => generated 295 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:34:57.143525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57263fb-4949-4b3e-b186-3cf26911b6fc admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:57.150188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 894/1797] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:57 2022] PUT /identity/v3/projects/4e9c410c138b4ff7a417a6edce892183/users/fbf99f1379be4613a3588398f06ae2b7/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:57.161353 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf5345-b477-4821-8f39-8c5a367dcbf9 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:57.161715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf5345-b477-4821-8f39-8c5a367dcbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:57.163170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf5345-b477-4821-8f39-8c5a367dcbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:57.167299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57263fb-4949-4b3e-b186-3cf26911b6fc admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:57.194427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:57.239374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-8caf5345-b477-4821-8f39-8c5a367dcbf9 None None] MFA Rules not processed for user `fbf99f1379be4613a3588398f06ae2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:57.243708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8caf5345-b477-4821-8f39-8c5a367dcbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:57.297276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5b5c6-3302-468a-a6cd-46f19336f18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:57.298176 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5b5c6-3302-468a-a6cd-46f19336f18b admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:57.298463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5b5c6-3302-468a-a6cd-46f19336f18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:57.298730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5b5c6-3302-468a-a6cd-46f19336f18b admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:57.299389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5b5c6-3302-468a-a6cd-46f19336f18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:57.301018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5b5c6-3302-468a-a6cd-46f19336f18b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:57.330308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 904/1798] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:34:57.334316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5b5c6-3302-468a-a6cd-46f19336f18b admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:57.372592 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5b5c6-3302-468a-a6cd-46f19336f18b admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:57.394097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b52bc9-2ad7-488e-bbff-9c8e84f9f3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:57.395769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b52bc9-2ad7-488e-bbff-9c8e84f9f3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:57.395979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b52bc9-2ad7-488e-bbff-9c8e84f9f3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:57.398204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b52bc9-2ad7-488e-bbff-9c8e84f9f3e0 admin admin] PATH_INFO: `/v3/projects/7d716bdec79141289b436581e178e2ab/users/85a337e345d54750b9ec1810744744a4/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:57.438337 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b52bc9-2ad7-488e-bbff-9c8e84f9f3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d716bdec79141289b436581e178e2ab, user_id=85a337e345d54750b9ec1810744744a4, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:57.447974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b52bc9-2ad7-488e-bbff-9c8e84f9f3e0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:57.495205 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:34:57.499915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 895/1799] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:34:57.517359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf5345-b477-4821-8f39-8c5a367dcbf9 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:57.521200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8caf5345-b477-4821-8f39-8c5a367dcbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:57.536971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 905/1800] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:57 2022] PUT /identity/v3/projects/7d716bdec79141289b436581e178e2ab/users/85a337e345d54750b9ec1810744744a4/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:57.541420 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b52bc9-2ad7-488e-bbff-9c8e84f9f3e0 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:57.762682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf5345-b477-4821-8f39-8c5a367dcbf9 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:57.790625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b52bc9-2ad7-488e-bbff-9c8e84f9f3e0 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:57.802371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4a67b-fee0-4e16-9922-59adb78b10c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:57.803204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4a67b-fee0-4e16-9922-59adb78b10c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:57.804959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4a67b-fee0-4e16-9922-59adb78b10c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:57.805347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4a67b-fee0-4e16-9922-59adb78b10c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:57.806116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4a67b-fee0-4e16-9922-59adb78b10c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:57.809964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4a67b-fee0-4e16-9922-59adb78b10c2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:57.833218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 906/1801] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:34:57.841165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4a67b-fee0-4e16-9922-59adb78b10c2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:57.849713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4a67b-fee0-4e16-9922-59adb78b10c2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:57.861787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5741e-41d1-4982-a915-9bbd61223529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:57.862817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5741e-41d1-4982-a915-9bbd61223529 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:57.863333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5741e-41d1-4982-a915-9bbd61223529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:57.863757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5741e-41d1-4982-a915-9bbd61223529 admin admin] PATH_INFO: `/v3/projects/7d716bdec79141289b436581e178e2ab/users/85a337e345d54750b9ec1810744744a4/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:57.864191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46fc66-91ff-4db0-bef7-ad82097975a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:57.864808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46fc66-91ff-4db0-bef7-ad82097975a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:57.865085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46fc66-91ff-4db0-bef7-ad82097975a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:57.865405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46fc66-91ff-4db0-bef7-ad82097975a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:57.877170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5741e-41d1-4982-a915-9bbd61223529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d716bdec79141289b436581e178e2ab, user_id=85a337e345d54750b9ec1810744744a4, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:57.879843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5741e-41d1-4982-a915-9bbd61223529 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:57.900265 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 907/1802] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:34:57 2022] PUT /identity/v3/projects/7d716bdec79141289b436581e178e2ab/users/85a337e345d54750b9ec1810744744a4/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:57.910725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ee0ef-dd15-4927-b114-6f1deb8e0fcd None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:57.911037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ee0ef-dd15-4927-b114-6f1deb8e0fcd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:57.911479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ee0ef-dd15-4927-b114-6f1deb8e0fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:57.952458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f94ee0ef-dd15-4927-b114-6f1deb8e0fcd None None] MFA Rules not processed for user `85a337e345d54750b9ec1810744744a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:34:57.953685 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f94ee0ef-dd15-4927-b114-6f1deb8e0fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:57.964627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46fc66-91ff-4db0-bef7-ad82097975a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:57.967172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46fc66-91ff-4db0-bef7-ad82097975a4 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:57.984268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 896/1803] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:58.202630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 908/1804] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:34:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:34:58.331942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46fc66-91ff-4db0-bef7-ad82097975a4 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:58.344734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46fc66-91ff-4db0-bef7-ad82097975a4 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:58.431043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd567e4-d369-43ef-aef6-baa746b906a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:58.431881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd567e4-d369-43ef-aef6-baa746b906a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:58.432368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd567e4-d369-43ef-aef6-baa746b906a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:58.433062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd567e4-d369-43ef-aef6-baa746b906a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:58.500310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd567e4-d369-43ef-aef6-baa746b906a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:58.501758 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd567e4-d369-43ef-aef6-baa746b906a1 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:58.511485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 897/1805] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:34:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:34:58.597601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ee0ef-dd15-4927-b114-6f1deb8e0fcd None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:58.603117 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f94ee0ef-dd15-4927-b114-6f1deb8e0fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:34:58.752637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ee0ef-dd15-4927-b114-6f1deb8e0fcd None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:58.758518 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fae19-85a1-46cd-86be-cccccb5bab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:58.759368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fae19-85a1-46cd-86be-cccccb5bab49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:58.759899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fae19-85a1-46cd-86be-cccccb5bab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:58.760294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fae19-85a1-46cd-86be-cccccb5bab49 admin admin] PATH_INFO: `/v3/projects/bab6d200d40b4202be77e86748fddc20` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:58.762540 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fae19-85a1-46cd-86be-cccccb5bab49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab6d200d40b4202be77e86748fddc20)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:58.766415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fae19-85a1-46cd-86be-cccccb5bab49 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:58.987119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e25fae19-85a1-46cd-86be-cccccb5bab49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab6d200d40b4202be77e86748fddc20', 'request_id': 'req-e25fae19-85a1-46cd-86be-cccccb5bab49'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:59.033347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e25fae19-85a1-46cd-86be-cccccb5bab49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab6d200d40b4202be77e86748fddc20', 'request_id': 'req-e25fae19-85a1-46cd-86be-cccccb5bab49'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:59.141220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e25fae19-85a1-46cd-86be-cccccb5bab49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab6d200d40b4202be77e86748fddc20', 'request_id': 'req-e25fae19-85a1-46cd-86be-cccccb5bab49'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:59.158545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e25fae19-85a1-46cd-86be-cccccb5bab49 admin admin] The token cache is being invalidate because project bab6d200d40b4202be77e86748fddc20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:34:59.158854 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e25fae19-85a1-46cd-86be-cccccb5bab49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:59.159528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e25fae19-85a1-46cd-86be-cccccb5bab49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:59.164347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 909/1806] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:34:58 2022] DELETE /identity/v3/projects/bab6d200d40b4202be77e86748fddc20 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:59.166861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd567e4-d369-43ef-aef6-baa746b906a1 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:34:59.177972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd567e4-d369-43ef-aef6-baa746b906a1 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:34:59.318290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:34:59.319342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:59.330503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:59.330848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] PATH_INFO: `/v3/users/77b8fa3f57864f6b81a51c14846b123f` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:34:59.332506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b8fa3f57864f6b81a51c14846b123f)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:34:59.335581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:34:59.595609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b8fa3f57864f6b81a51c14846b123f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:59.612638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b8fa3f57864f6b81a51c14846b123f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:59.613943 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b8fa3f57864f6b81a51c14846b123f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:59.693640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b8fa3f57864f6b81a51c14846b123f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:59.712415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b8fa3f57864f6b81a51c14846b123f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:34:59.719619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 898/1807] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:34:59 2022] DELETE /identity/v3/users/77b8fa3f57864f6b81a51c14846b123f => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:34:59.849934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699af9f2-5513-48c0-abd3-aa4c392dc028 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:34:59.850931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699af9f2-5513-48c0-abd3-aa4c392dc028 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:34:59.851072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699af9f2-5513-48c0-abd3-aa4c392dc028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:00.004611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-699af9f2-5513-48c0-abd3-aa4c392dc028 None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:00.005826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-699af9f2-5513-48c0-abd3-aa4c392dc028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:00.174104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:00.321643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 910/1808] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:34:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:00.520655 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:00.522286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:00.775704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:00.790351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b79a9-5996-49ea-ac5c-54e1cad17c48 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:00.802366 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338c590-5f6b-49c5-ad37-7f0cd0587378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:00.803334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338c590-5f6b-49c5-ad37-7f0cd0587378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:00.804491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338c590-5f6b-49c5-ad37-7f0cd0587378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:00.805076 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338c590-5f6b-49c5-ad37-7f0cd0587378 admin admin] PATH_INFO: `/v3/users/42327e2706d846719eb7e4714e497689` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:00.806431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338c590-5f6b-49c5-ad37-7f0cd0587378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42327e2706d846719eb7e4714e497689)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:00.808767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338c590-5f6b-49c5-ad37-7f0cd0587378 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:00.860847 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699af9f2-5513-48c0-abd3-aa4c392dc028 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:00.862431 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-699af9f2-5513-48c0-abd3-aa4c392dc028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:00.991631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699af9f2-5513-48c0-abd3-aa4c392dc028 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:00.998940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bd79a-35a4-484a-82d4-7230df6e7c43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:00.999820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bd79a-35a4-484a-82d4-7230df6e7c43 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:01.000293 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bd79a-35a4-484a-82d4-7230df6e7c43 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:01.000970 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bd79a-35a4-484a-82d4-7230df6e7c43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:01.010387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bd79a-35a4-484a-82d4-7230df6e7c43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:01.012146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bd79a-35a4-484a-82d4-7230df6e7c43 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:01.024140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 911/1809] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:35:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:35:01.138400 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bd79a-35a4-484a-82d4-7230df6e7c43 service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:01.140847 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0a9bd79a-35a4-484a-82d4-7230df6e7c43 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:01.177387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bd79a-35a4-484a-82d4-7230df6e7c43 service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:01.194348 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4571eff-c941-49d0-985f-345639d8780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:01.195002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4571eff-c941-49d0-985f-345639d8780e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:01.197767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4571eff-c941-49d0-985f-345639d8780e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:01.197767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4571eff-c941-49d0-985f-345639d8780e admin admin] PATH_INFO: `/v3/projects/5de3491437804cd89e682867f5efcede` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:01.197767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4571eff-c941-49d0-985f-345639d8780e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de3491437804cd89e682867f5efcede)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:01.207118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4571eff-c941-49d0-985f-345639d8780e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:01.273862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4338c590-5f6b-49c5-ad37-7f0cd0587378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42327e2706d846719eb7e4714e497689'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:01.300535 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4338c590-5f6b-49c5-ad37-7f0cd0587378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42327e2706d846719eb7e4714e497689'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:01.311443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4338c590-5f6b-49c5-ad37-7f0cd0587378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42327e2706d846719eb7e4714e497689'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:01.458923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4338c590-5f6b-49c5-ad37-7f0cd0587378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42327e2706d846719eb7e4714e497689'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:01.531895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4338c590-5f6b-49c5-ad37-7f0cd0587378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42327e2706d846719eb7e4714e497689'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:01.547169 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b4571eff-c941-49d0-985f-345639d8780e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de3491437804cd89e682867f5efcede', 'request_id': 'req-b4571eff-c941-49d0-985f-345639d8780e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:01.568751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b4571eff-c941-49d0-985f-345639d8780e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de3491437804cd89e682867f5efcede', 'request_id': 'req-b4571eff-c941-49d0-985f-345639d8780e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:01.570536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 899/1810] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:00 2022] DELETE /identity/v3/users/42327e2706d846719eb7e4714e497689 => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:01.575113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9739b5-c601-4357-8d83-c07ecf837c1d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:01.575681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9739b5-c601-4357-8d83-c07ecf837c1d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:01.576338 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9739b5-c601-4357-8d83-c07ecf837c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:01.646505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b4571eff-c941-49d0-985f-345639d8780e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de3491437804cd89e682867f5efcede', 'request_id': 'req-b4571eff-c941-49d0-985f-345639d8780e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:01.679586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-cf9739b5-c601-4357-8d83-c07ecf837c1d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:01.691645 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cf9739b5-c601-4357-8d83-c07ecf837c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:01.699643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b4571eff-c941-49d0-985f-345639d8780e admin admin] The token cache is being invalidate because project 5de3491437804cd89e682867f5efcede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:01.699643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b4571eff-c941-49d0-985f-345639d8780e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:01.703926 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b4571eff-c941-49d0-985f-345639d8780e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:01.710035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 912/1811] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:01 2022] DELETE /identity/v3/projects/5de3491437804cd89e682867f5efcede => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:01.717057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb1c29-b1b3-4ed5-961e-0321bb8f9241 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:01.720702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb1c29-b1b3-4ed5-961e-0321bb8f9241 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:01.721013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb1c29-b1b3-4ed5-961e-0321bb8f9241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:01.801581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7fcb1c29-b1b3-4ed5-961e-0321bb8f9241 None None] MFA Rules not processed for user `b040de20aa6f4e7b8366c7daa54c093c`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:01.804162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7fcb1c29-b1b3-4ed5-961e-0321bb8f9241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:01.939925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 900/1812] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:01.941517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ec46c-3aaf-48aa-a3bf-6ee4549f3009 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:01.942003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ec46c-3aaf-48aa-a3bf-6ee4549f3009 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:01.942491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ec46c-3aaf-48aa-a3bf-6ee4549f3009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:02.034290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5a2ec46c-3aaf-48aa-a3bf-6ee4549f3009 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:02.056340 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5a2ec46c-3aaf-48aa-a3bf-6ee4549f3009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:02.057124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 913/1813] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Oct 4 10:35:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:02.084700 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb1c29-b1b3-4ed5-961e-0321bb8f9241 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:02.085656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 901/1814] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:02.086732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7fcb1c29-b1b3-4ed5-961e-0321bb8f9241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:02.093626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ae08-e247-47ec-b610-ffb480073570 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:02.093903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ae08-e247-47ec-b610-ffb480073570 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:02.096322 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ae08-e247-47ec-b610-ffb480073570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:02.103029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb1c29-b1b3-4ed5-961e-0321bb8f9241 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:02.112897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521783f8-6e91-44ed-96d5-5fc1365c8755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:02.117488 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521783f8-6e91-44ed-96d5-5fc1365c8755 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:02.117993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521783f8-6e91-44ed-96d5-5fc1365c8755 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:02.118510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521783f8-6e91-44ed-96d5-5fc1365c8755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:02.165275 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521783f8-6e91-44ed-96d5-5fc1365c8755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:02.166964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521783f8-6e91-44ed-96d5-5fc1365c8755 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:02.224720 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:02.234569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 914/1815] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:02.235491 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521783f8-6e91-44ed-96d5-5fc1365c8755 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:02.237109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-df98ae08-e247-47ec-b610-ffb480073570 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:02.240805 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-df98ae08-e247-47ec-b610-ffb480073570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:02.246805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521783f8-6e91-44ed-96d5-5fc1365c8755 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:02.251733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57735e1-9035-4a69-82be-74af892015ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:02.252794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57735e1-9035-4a69-82be-74af892015ac service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:02.253264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57735e1-9035-4a69-82be-74af892015ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:02.253751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57735e1-9035-4a69-82be-74af892015ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:02.270406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57735e1-9035-4a69-82be-74af892015ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:02.271407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 902/1816] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:02.273020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57735e1-9035-4a69-82be-74af892015ac service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:02.276389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ae08-e247-47ec-b610-ffb480073570 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:02.303368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 915/1817] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:02.313660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ae08-e247-47ec-b610-ffb480073570 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:02.331600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf666e-5cb8-4a0e-aa56-88e9674e7c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:02.332465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf666e-5cb8-4a0e-aa56-88e9674e7c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:02.332750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf666e-5cb8-4a0e-aa56-88e9674e7c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:02.337780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf666e-5cb8-4a0e-aa56-88e9674e7c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:02.338589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf666e-5cb8-4a0e-aa56-88e9674e7c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:35:02.338980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf666e-5cb8-4a0e-aa56-88e9674e7c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:02.343810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf666e-5cb8-4a0e-aa56-88e9674e7c1c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:02.410062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 903/1818] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:35:02.436734 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57735e1-9035-4a69-82be-74af892015ac service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:02.436734 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57735e1-9035-4a69-82be-74af892015ac service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:02.439490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b602369-bc17-4528-a69a-630279bd9451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:02.440059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b602369-bc17-4528-a69a-630279bd9451 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:02.440395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b602369-bc17-4528-a69a-630279bd9451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:02.440673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b602369-bc17-4528-a69a-630279bd9451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:02.441315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b602369-bc17-4528-a69a-630279bd9451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:02.443922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b602369-bc17-4528-a69a-630279bd9451 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:02.720760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 916/1819] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:02 2022] POST /identity/v3/projects => generated 367 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:02.726119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf666e-5cb8-4a0e-aa56-88e9674e7c1c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:02.747019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf666e-5cb8-4a0e-aa56-88e9674e7c1c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:02.875898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe13214-02f8-4432-bf97-a09852dae538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:02.876875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe13214-02f8-4432-bf97-a09852dae538 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:02.878093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe13214-02f8-4432-bf97-a09852dae538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:02.878504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe13214-02f8-4432-bf97-a09852dae538 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:02.879323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe13214-02f8-4432-bf97-a09852dae538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:02.882194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe13214-02f8-4432-bf97-a09852dae538 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:03.192197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 904/1820] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:02 2022] POST /identity/v3/users => generated 284 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:03.198415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b602369-bc17-4528-a69a-630279bd9451 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:03.221468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b602369-bc17-4528-a69a-630279bd9451 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:03.235375 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df3040-b685-4237-95f1-d7da9191a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:03.236028 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df3040-b685-4237-95f1-d7da9191a3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:03.236308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df3040-b685-4237-95f1-d7da9191a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:03.236581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df3040-b685-4237-95f1-d7da9191a3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:03.239532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df3040-b685-4237-95f1-d7da9191a3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:03.248605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df3040-b685-4237-95f1-d7da9191a3f4 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:03.262170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 917/1821] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:03.266644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe13214-02f8-4432-bf97-a09852dae538 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:03.286169 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe13214-02f8-4432-bf97-a09852dae538 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:03.291738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2114b-77da-44c0-acfb-9309e71b8cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:03.292464 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2114b-77da-44c0-acfb-9309e71b8cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:03.292818 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2114b-77da-44c0-acfb-9309e71b8cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:03.293234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2114b-77da-44c0-acfb-9309e71b8cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:03.294696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2114b-77da-44c0-acfb-9309e71b8cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:03.296444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2114b-77da-44c0-acfb-9309e71b8cf2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:03.354724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df3040-b685-4237-95f1-d7da9191a3f4 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:03.354859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 905/1822] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:03.390459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df3040-b685-4237-95f1-d7da9191a3f4 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:03.399153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18109a9-3b38-4374-aeeb-366e9e196032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:03.400364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18109a9-3b38-4374-aeeb-366e9e196032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:03.400821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18109a9-3b38-4374-aeeb-366e9e196032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:03.401253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18109a9-3b38-4374-aeeb-366e9e196032 admin admin] PATH_INFO: `/v3/projects/f64f76e4cf8e48a7afc7a677a9b392b0/users/b1e8900b67144f4da5a8bb05cc7dcbf5/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:03.447836 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18109a9-3b38-4374-aeeb-366e9e196032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64f76e4cf8e48a7afc7a677a9b392b0, user_id=b1e8900b67144f4da5a8bb05cc7dcbf5, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:03.457901 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18109a9-3b38-4374-aeeb-366e9e196032 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:03.576211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 918/1823] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:03 2022] PUT /identity/v3/projects/f64f76e4cf8e48a7afc7a677a9b392b0/users/b1e8900b67144f4da5a8bb05cc7dcbf5/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:03.589830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb775-1656-4b37-aeda-d2bf68a899da None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:03.590160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb775-1656-4b37-aeda-d2bf68a899da None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:03.590438 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb775-1656-4b37-aeda-d2bf68a899da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:03.634533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-022bb775-1656-4b37-aeda-d2bf68a899da None None] MFA Rules not processed for user `b1e8900b67144f4da5a8bb05cc7dcbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:03.635743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-022bb775-1656-4b37-aeda-d2bf68a899da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:03.791872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 906/1824] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:03.797097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18109a9-3b38-4374-aeeb-366e9e196032 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:03.918502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bb775-1656-4b37-aeda-d2bf68a899da None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:03.922016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-022bb775-1656-4b37-aeda-d2bf68a899da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:03.947786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18109a9-3b38-4374-aeeb-366e9e196032 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:03.968435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76416553-b83f-41a5-8abb-f64315b10852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:03.968435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76416553-b83f-41a5-8abb-f64315b10852 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:03.968435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76416553-b83f-41a5-8abb-f64315b10852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:03.968435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76416553-b83f-41a5-8abb-f64315b10852 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:03.968915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76416553-b83f-41a5-8abb-f64315b10852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:03.973717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76416553-b83f-41a5-8abb-f64315b10852 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:04.083402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bb775-1656-4b37-aeda-d2bf68a899da None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:04.095380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec832a2-f4c3-466a-af4e-34eb8595f088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:04.100905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec832a2-f4c3-466a-af4e-34eb8595f088 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:04.100905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec832a2-f4c3-466a-af4e-34eb8595f088 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:04.104504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec832a2-f4c3-466a-af4e-34eb8595f088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:04.107760 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1ec832a2-f4c3-466a-af4e-34eb8595f088 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:04.143048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 919/1825] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:03 2022] POST /identity/v3/projects => generated 369 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:04.144874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76416553-b83f-41a5-8abb-f64315b10852 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:04.292534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec832a2-f4c3-466a-af4e-34eb8595f088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:04.294046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec832a2-f4c3-466a-af4e-34eb8595f088 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:04.318230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 907/1826] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:04.357084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:04.388004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76416553-b83f-41a5-8abb-f64315b10852 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:04.402688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a0c46-652f-487c-a12b-6d6903620e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:04.403476 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a0c46-652f-487c-a12b-6d6903620e0f admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:04.403658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a0c46-652f-487c-a12b-6d6903620e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:04.404083 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a0c46-652f-487c-a12b-6d6903620e0f admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:04.404632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a0c46-652f-487c-a12b-6d6903620e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:04.406515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a0c46-652f-487c-a12b-6d6903620e0f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:04.583886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec832a2-f4c3-466a-af4e-34eb8595f088 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:04.588113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 920/1827] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:04 2022] POST /identity/v3/users => generated 291 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:04.604969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec832a2-f4c3-466a-af4e-34eb8595f088 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:04.631846 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e466871-bb75-4515-abd3-06873b051768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:04.632980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e466871-bb75-4515-abd3-06873b051768 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:04.633604 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e466871-bb75-4515-abd3-06873b051768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:04.634324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e466871-bb75-4515-abd3-06873b051768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:04.635228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e466871-bb75-4515-abd3-06873b051768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:04.643195 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e466871-bb75-4515-abd3-06873b051768 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:04.688055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 908/1828] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:04.691987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a0c46-652f-487c-a12b-6d6903620e0f admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:04.697530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e466871-bb75-4515-abd3-06873b051768 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:04.702099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9e466871-bb75-4515-abd3-06873b051768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:04.726142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a0c46-652f-487c-a12b-6d6903620e0f admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:04.746890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e466871-bb75-4515-abd3-06873b051768 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:04.748378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6fbbe-df74-4596-b8aa-9861bc77982e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:04.749067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6fbbe-df74-4596-b8aa-9861bc77982e admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:04.749340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6fbbe-df74-4596-b8aa-9861bc77982e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:04.749788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6fbbe-df74-4596-b8aa-9861bc77982e admin admin] PATH_INFO: `/v3/projects/f987f4f189d34e8b9c9426f52ae2a041/users/12bf8ad3ce3d48699d5d32bc6f680113/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:04.773956 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:04.781166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:04.798690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:04.800579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] PATH_INFO: `/v3/projects/f738dc459c164cce81788f4e354ce981` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:04.808715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f738dc459c164cce81788f4e354ce981)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:04.810969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:04.851032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6fbbe-df74-4596-b8aa-9861bc77982e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f987f4f189d34e8b9c9426f52ae2a041, user_id=12bf8ad3ce3d48699d5d32bc6f680113, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:04.851032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6fbbe-df74-4596-b8aa-9861bc77982e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:05.103743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 921/1829] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:04 2022] PUT /identity/v3/projects/f987f4f189d34e8b9c9426f52ae2a041/users/12bf8ad3ce3d48699d5d32bc6f680113/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:05.106383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6fbbe-df74-4596-b8aa-9861bc77982e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:05.160233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f738dc459c164cce81788f4e354ce981', 'request_id': 'req-a93a5892-3501-435b-af25-68dcfbecc3e6'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:05.172781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f738dc459c164cce81788f4e354ce981', 'request_id': 'req-a93a5892-3501-435b-af25-68dcfbecc3e6'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:05.181499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f738dc459c164cce81788f4e354ce981', 'request_id': 'req-a93a5892-3501-435b-af25-68dcfbecc3e6'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:05.269758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:05.277106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6fbbe-df74-4596-b8aa-9861bc77982e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:05.308495 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] The token cache is being invalidate because project f738dc459c164cce81788f4e354ce981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:05.316553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:05.316553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:05.316553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 909/1830] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:04 2022] DELETE /identity/v3/projects/f738dc459c164cce81788f4e354ce981 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:05.316553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:05.321323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:05.513954 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62b5bd-1989-48a9-aad4-c3a2d466e905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:05.514615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62b5bd-1989-48a9-aad4-c3a2d466e905 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:05.514896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62b5bd-1989-48a9-aad4-c3a2d466e905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:05.515161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62b5bd-1989-48a9-aad4-c3a2d466e905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:05.518353 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a5892-3501-435b-af25-68dcfbecc3e6 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:05.519677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62b5bd-1989-48a9-aad4-c3a2d466e905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:05.524794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:05.525149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62b5bd-1989-48a9-aad4-c3a2d466e905 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:05.525593 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:05.525995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:05.526394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] PATH_INFO: `/v3/users/fbf99f1379be4613a3588398f06ae2b7` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:05.528093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf99f1379be4613a3588398f06ae2b7)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:05.530635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:05.570245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 922/1831] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:05.575032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dfe0e-2d46-4e6a-bf7a-abaec2bd5d4e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:05.575621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dfe0e-2d46-4e6a-bf7a-abaec2bd5d4e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:05.576156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dfe0e-2d46-4e6a-bf7a-abaec2bd5d4e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:05.578242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 923/1832] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:35:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:35:05.579549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dfe0e-2d46-4e6a-bf7a-abaec2bd5d4e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:05.581877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-585dfe0e-2d46-4e6a-bf7a-abaec2bd5d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:05.627686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dfe0e-2d46-4e6a-bf7a-abaec2bd5d4e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:05.659080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325a1e4-1689-4910-8e1f-9f88ce850171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:05.668924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325a1e4-1689-4910-8e1f-9f88ce850171 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:05.668924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325a1e4-1689-4910-8e1f-9f88ce850171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:05.668924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325a1e4-1689-4910-8e1f-9f88ce850171 admin admin] PATH_INFO: `/v3/projects/f987f4f189d34e8b9c9426f52ae2a041/users/12bf8ad3ce3d48699d5d32bc6f680113/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:05.670881 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325a1e4-1689-4910-8e1f-9f88ce850171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f987f4f189d34e8b9c9426f52ae2a041, user_id=12bf8ad3ce3d48699d5d32bc6f680113, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:05.676175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325a1e4-1689-4910-8e1f-9f88ce850171 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:05.711783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 924/1833] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:05 2022] PUT /identity/v3/projects/f987f4f189d34e8b9c9426f52ae2a041/users/12bf8ad3ce3d48699d5d32bc6f680113/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:05.722334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd99c6-3b31-45cb-bad0-1a664c3120fc None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:05.722925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd99c6-3b31-45cb-bad0-1a664c3120fc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:05.723404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd99c6-3b31-45cb-bad0-1a664c3120fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:05.801588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-04fd99c6-3b31-45cb-bad0-1a664c3120fc None None] MFA Rules not processed for user `12bf8ad3ce3d48699d5d32bc6f680113`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:05.803137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-04fd99c6-3b31-45cb-bad0-1a664c3120fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:05.842644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf99f1379be4613a3588398f06ae2b7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:05.869735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf99f1379be4613a3588398f06ae2b7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:05.872422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf99f1379be4613a3588398f06ae2b7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:05.964806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 925/1834] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:05.966050 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf99f1379be4613a3588398f06ae2b7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:05.966798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1aa7b-223c-4311-812d-5bdf50358104 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:05.967571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1aa7b-223c-4311-812d-5bdf50358104 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:05.968086 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1aa7b-223c-4311-812d-5bdf50358104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:05.996483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf99f1379be4613a3588398f06ae2b7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:06.001184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-38c1aa7b-223c-4311-812d-5bdf50358104 None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:06.002697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-38c1aa7b-223c-4311-812d-5bdf50358104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:06.015135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 910/1835] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:05 2022] DELETE /identity/v3/users/fbf99f1379be4613a3588398f06ae2b7 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:06.015135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:06.015135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:06.185667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1b97e-c4bf-42fb-91cd-e820b912f472 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:06.195044 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a1d25-08a0-4e07-9e6c-9133930a1d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:06.196464 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a1d25-08a0-4e07-9e6c-9133930a1d7c service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:06.197172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a1d25-08a0-4e07-9e6c-9133930a1d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:06.197716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a1d25-08a0-4e07-9e6c-9133930a1d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:06.243470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 926/1836] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:35:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:06.309330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1aa7b-223c-4311-812d-5bdf50358104 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:06.311711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-38c1aa7b-223c-4311-812d-5bdf50358104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:06.350034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1aa7b-223c-4311-812d-5bdf50358104 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:06.369526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971162c6-9eeb-451e-8045-247e54114dc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:06.376184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971162c6-9eeb-451e-8045-247e54114dc0 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:06.376184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971162c6-9eeb-451e-8045-247e54114dc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:06.376184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971162c6-9eeb-451e-8045-247e54114dc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:06.380107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a1d25-08a0-4e07-9e6c-9133930a1d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:06.382121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a1d25-08a0-4e07-9e6c-9133930a1d7c service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:06.393658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971162c6-9eeb-451e-8045-247e54114dc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:06.398524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971162c6-9eeb-451e-8045-247e54114dc0 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:06.405512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 911/1837] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:06.453184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 927/1838] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:06.588111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a1d25-08a0-4e07-9e6c-9133930a1d7c service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:06.589769 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-db3a1d25-08a0-4e07-9e6c-9133930a1d7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:06.616966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a1d25-08a0-4e07-9e6c-9133930a1d7c service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:06.628841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92fd42-0ec7-4962-a589-4ad05edf3db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:06.629478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92fd42-0ec7-4962-a589-4ad05edf3db5 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:06.629759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92fd42-0ec7-4962-a589-4ad05edf3db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:06.630032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92fd42-0ec7-4962-a589-4ad05edf3db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:06.632640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2a92fd42-0ec7-4962-a589-4ad05edf3db5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:06.753056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92fd42-0ec7-4962-a589-4ad05edf3db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:06.754625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92fd42-0ec7-4962-a589-4ad05edf3db5 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:06.778965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe342035-2502-422c-ba2a-5bc141878d0a None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:06.779478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe342035-2502-422c-ba2a-5bc141878d0a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:06.779562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe342035-2502-422c-ba2a-5bc141878d0a None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:06.781022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 928/1839] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:35:06.785251 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 912/1840] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:06.833207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11e815-b4a3-415b-89ed-9e3cb129e4c4 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:06.835841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11e815-b4a3-415b-89ed-9e3cb129e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:06.835841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11e815-b4a3-415b-89ed-9e3cb129e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:06.881157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1c11e815-b4a3-415b-89ed-9e3cb129e4c4 None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:06.883067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1c11e815-b4a3-415b-89ed-9e3cb129e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:06.926565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 929/1841] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:35:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:07.017208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92fd42-0ec7-4962-a589-4ad05edf3db5 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:07.036463 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92fd42-0ec7-4962-a589-4ad05edf3db5 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:07.045232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811b504-d1f6-4a7d-821e-7dd0ff54fa7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:07.046018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811b504-d1f6-4a7d-821e-7dd0ff54fa7d service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:07.046307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811b504-d1f6-4a7d-821e-7dd0ff54fa7d service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:07.046585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811b504-d1f6-4a7d-821e-7dd0ff54fa7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:07.058184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811b504-d1f6-4a7d-821e-7dd0ff54fa7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:07.060088 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811b504-d1f6-4a7d-821e-7dd0ff54fa7d service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:07.076206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 913/1842] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:07.291564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:08.416598 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:08.878741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11e815-b4a3-415b-89ed-9e3cb129e4c4 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:08.880669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1c11e815-b4a3-415b-89ed-9e3cb129e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:09.085765 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11e815-b4a3-415b-89ed-9e3cb129e4c4 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:09.095062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e86881-fac0-46a7-85c6-1814cc6fa8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:09.095716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e86881-fac0-46a7-85c6-1814cc6fa8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:09.096065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e86881-fac0-46a7-85c6-1814cc6fa8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:09.097089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e86881-fac0-46a7-85c6-1814cc6fa8cb admin admin] PATH_INFO: `/v3/projects/4e9c410c138b4ff7a417a6edce892183` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:09.100162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e86881-fac0-46a7-85c6-1814cc6fa8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9c410c138b4ff7a417a6edce892183)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:09.111458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e86881-fac0-46a7-85c6-1814cc6fa8cb admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:09.368741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-93e86881-fac0-46a7-85c6-1814cc6fa8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9c410c138b4ff7a417a6edce892183', 'request_id': 'req-93e86881-fac0-46a7-85c6-1814cc6fa8cb'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:09.402760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-93e86881-fac0-46a7-85c6-1814cc6fa8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9c410c138b4ff7a417a6edce892183', 'request_id': 'req-93e86881-fac0-46a7-85c6-1814cc6fa8cb'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:09.545829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-93e86881-fac0-46a7-85c6-1814cc6fa8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9c410c138b4ff7a417a6edce892183', 'request_id': 'req-93e86881-fac0-46a7-85c6-1814cc6fa8cb'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:09.564658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-93e86881-fac0-46a7-85c6-1814cc6fa8cb admin admin] The token cache is being invalidate because project 4e9c410c138b4ff7a417a6edce892183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:09.564658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-93e86881-fac0-46a7-85c6-1814cc6fa8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:09.565515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-93e86881-fac0-46a7-85c6-1814cc6fa8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:09.579058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 930/1843] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:08 2022] DELETE /identity/v3/projects/4e9c410c138b4ff7a417a6edce892183 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:09.591431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47fa2a-ea19-4091-9e24-e71f6ba91898 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:09.592026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47fa2a-ea19-4091-9e24-e71f6ba91898 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:09.592123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47fa2a-ea19-4091-9e24-e71f6ba91898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:09.650712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ac47fa2a-ea19-4091-9e24-e71f6ba91898 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:09.652174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ac47fa2a-ea19-4091-9e24-e71f6ba91898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:09.824363 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 914/1844] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:09.832296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fb124-b5e2-4db2-a681-ced5858cb695 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:09.832581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fb124-b5e2-4db2-a681-ced5858cb695 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:09.835178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fb124-b5e2-4db2-a681-ced5858cb695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:09.873122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fc6fb124-b5e2-4db2-a681-ced5858cb695 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:09.879357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fc6fb124-b5e2-4db2-a681-ced5858cb695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:09.893235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 931/1845] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:09.897965 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47fa2a-ea19-4091-9e24-e71f6ba91898 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:09.927102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47fa2a-ea19-4091-9e24-e71f6ba91898 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:09.941917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c81707-1980-4c7a-8f79-a697e8abf633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:09.942600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c81707-1980-4c7a-8f79-a697e8abf633 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:09.942878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c81707-1980-4c7a-8f79-a697e8abf633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:09.943187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c81707-1980-4c7a-8f79-a697e8abf633 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:09.943938 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c81707-1980-4c7a-8f79-a697e8abf633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:35:09.944306 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c81707-1980-4c7a-8f79-a697e8abf633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:09.945973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c81707-1980-4c7a-8f79-a697e8abf633 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:09.974424 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 915/1846] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:35:09.979063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fb124-b5e2-4db2-a681-ced5858cb695 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:09.993326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fb124-b5e2-4db2-a681-ced5858cb695 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:10.005411 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2848512-64a3-4447-81a5-a67e81feb9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:10.009590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2848512-64a3-4447-81a5-a67e81feb9bb admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:10.009590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2848512-64a3-4447-81a5-a67e81feb9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:10.009590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2848512-64a3-4447-81a5-a67e81feb9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:10.009590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2848512-64a3-4447-81a5-a67e81feb9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:10.009590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2848512-64a3-4447-81a5-a67e81feb9bb admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:10.139307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 932/1847] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:09 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:10.143325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c81707-1980-4c7a-8f79-a697e8abf633 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:10.159621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c81707-1980-4c7a-8f79-a697e8abf633 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:10.216718 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:10.280763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36431192-d657-4a00-ac74-8378f906f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:10.281872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36431192-d657-4a00-ac74-8378f906f88d admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:10.282225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36431192-d657-4a00-ac74-8378f906f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:10.282587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36431192-d657-4a00-ac74-8378f906f88d admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:10.283360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36431192-d657-4a00-ac74-8378f906f88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:10.285490 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36431192-d657-4a00-ac74-8378f906f88d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:10.408029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 916/1848] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:10 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:10.410211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2848512-64a3-4447-81a5-a67e81feb9bb admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:10.428412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2848512-64a3-4447-81a5-a67e81feb9bb admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:10.445492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1287d26-1002-4e32-aa42-51bb526fc126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:10.446276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1287d26-1002-4e32-aa42-51bb526fc126 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:10.446669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1287d26-1002-4e32-aa42-51bb526fc126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:10.446955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1287d26-1002-4e32-aa42-51bb526fc126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:10.447685 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1287d26-1002-4e32-aa42-51bb526fc126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:10.449608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1287d26-1002-4e32-aa42-51bb526fc126 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:10.474392 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 933/1849] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:10.478075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36431192-d657-4a00-ac74-8378f906f88d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:10.495621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36431192-d657-4a00-ac74-8378f906f88d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:10.508089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d12ee-f44f-4dac-ad6c-e97fb859143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:10.508739 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d12ee-f44f-4dac-ad6c-e97fb859143c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:10.510644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d12ee-f44f-4dac-ad6c-e97fb859143c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:10.510644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d12ee-f44f-4dac-ad6c-e97fb859143c admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:10.510644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d12ee-f44f-4dac-ad6c-e97fb859143c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:10.524699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d12ee-f44f-4dac-ad6c-e97fb859143c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:10.543433 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 917/1850] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:10.547092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1287d26-1002-4e32-aa42-51bb526fc126 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:10.566109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1287d26-1002-4e32-aa42-51bb526fc126 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:10.582209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237668b4-eb1b-4df7-a2ce-757e4dd9a5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:10.583797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237668b4-eb1b-4df7-a2ce-757e4dd9a5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:10.590557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237668b4-eb1b-4df7-a2ce-757e4dd9a5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:10.590557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237668b4-eb1b-4df7-a2ce-757e4dd9a5d5 admin admin] PATH_INFO: `/v3/projects/af354bb3073b45bbb72444adaaab6736/users/a3a3668d8dce4acd811cc0cf8d18ea5d/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:10.641397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237668b4-eb1b-4df7-a2ce-757e4dd9a5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af354bb3073b45bbb72444adaaab6736, user_id=a3a3668d8dce4acd811cc0cf8d18ea5d, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:10.641397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237668b4-eb1b-4df7-a2ce-757e4dd9a5d5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:10.751151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 934/1851] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:10 2022] PUT /identity/v3/projects/af354bb3073b45bbb72444adaaab6736/users/a3a3668d8dce4acd811cc0cf8d18ea5d/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:10.763757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca047-69e7-4f4a-b5c1-743fb6402c86 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:10.765541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca047-69e7-4f4a-b5c1-743fb6402c86 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:10.766070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca047-69e7-4f4a-b5c1-743fb6402c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:10.807811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-432ca047-69e7-4f4a-b5c1-743fb6402c86 None None] MFA Rules not processed for user `a3a3668d8dce4acd811cc0cf8d18ea5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:10.810967 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-432ca047-69e7-4f4a-b5c1-743fb6402c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:11.024014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 918/1852] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:11.028173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237668b4-eb1b-4df7-a2ce-757e4dd9a5d5 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:11.198530 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237668b4-eb1b-4df7-a2ce-757e4dd9a5d5 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:11.203878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14d12f-6dc8-40a6-a60d-a53eb9872f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:11.204605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14d12f-6dc8-40a6-a60d-a53eb9872f72 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:11.204882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14d12f-6dc8-40a6-a60d-a53eb9872f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:11.205322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14d12f-6dc8-40a6-a60d-a53eb9872f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:11.205972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14d12f-6dc8-40a6-a60d-a53eb9872f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:11.207896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14d12f-6dc8-40a6-a60d-a53eb9872f72 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:11.305340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 935/1853] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:11 2022] POST /identity/v3/projects => generated 381 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:11.309121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ca047-69e7-4f4a-b5c1-743fb6402c86 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:11.333683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ca047-69e7-4f4a-b5c1-743fb6402c86 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:11.490902 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:11.516026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8f6d8-e104-4825-9676-fc1ee6d7fb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:11.516797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8f6d8-e104-4825-9676-fc1ee6d7fb69 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:11.517077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8f6d8-e104-4825-9676-fc1ee6d7fb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:11.517343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8f6d8-e104-4825-9676-fc1ee6d7fb69 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:11.521238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8f6d8-e104-4825-9676-fc1ee6d7fb69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:11.521238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8f6d8-e104-4825-9676-fc1ee6d7fb69 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:11.723839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 919/1854] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:11 2022] POST /identity/v3/users => generated 297 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:11.727827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14d12f-6dc8-40a6-a60d-a53eb9872f72 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:11.750239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14d12f-6dc8-40a6-a60d-a53eb9872f72 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:11.794986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e680dc-fe58-45e8-91ab-68ba16382114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:11.795997 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e680dc-fe58-45e8-91ab-68ba16382114 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:11.796482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e680dc-fe58-45e8-91ab-68ba16382114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:11.796941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e680dc-fe58-45e8-91ab-68ba16382114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:11.797795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e680dc-fe58-45e8-91ab-68ba16382114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:11.799770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e680dc-fe58-45e8-91ab-68ba16382114 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:11.842209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 936/1855] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:11.846686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8f6d8-e104-4825-9676-fc1ee6d7fb69 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:11.867045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8f6d8-e104-4825-9676-fc1ee6d7fb69 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:11.882533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c77d3a-ab91-4e2c-852f-8a698010d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:11.883760 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c77d3a-ab91-4e2c-852f-8a698010d0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:11.884309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c77d3a-ab91-4e2c-852f-8a698010d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:11.884772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c77d3a-ab91-4e2c-852f-8a698010d0c8 admin admin] PATH_INFO: `/v3/projects/21a1b3d374594813977deaac5ca244e3/users/22bdbd38e4f4497f9282495367cd697c/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:11.929509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c77d3a-ab91-4e2c-852f-8a698010d0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a1b3d374594813977deaac5ca244e3, user_id=22bdbd38e4f4497f9282495367cd697c, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:11.938026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c77d3a-ab91-4e2c-852f-8a698010d0c8 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:12.068635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 920/1856] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:11 2022] PUT /identity/v3/projects/21a1b3d374594813977deaac5ca244e3/users/22bdbd38e4f4497f9282495367cd697c/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:12.080710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e680dc-fe58-45e8-91ab-68ba16382114 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:12.098194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e680dc-fe58-45e8-91ab-68ba16382114 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:12.220672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ee52d-a862-4e56-8d4e-9943337f4ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:12.221246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee52d-a862-4e56-8d4e-9943337f4ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:12.221523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee52d-a862-4e56-8d4e-9943337f4ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:12.222042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee52d-a862-4e56-8d4e-9943337f4ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:12.222972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ee52d-a862-4e56-8d4e-9943337f4ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:12.225191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ee52d-a862-4e56-8d4e-9943337f4ec4 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:12.265593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 937/1857] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:12.265708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c77d3a-ab91-4e2c-852f-8a698010d0c8 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:12.289352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c77d3a-ab91-4e2c-852f-8a698010d0c8 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:12.294601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f691f-d8b7-4943-a037-01a493035dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:12.295470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f691f-d8b7-4943-a037-01a493035dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:12.295758 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f691f-d8b7-4943-a037-01a493035dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:12.296101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f691f-d8b7-4943-a037-01a493035dcb admin admin] PATH_INFO: `/v3/projects/21a1b3d374594813977deaac5ca244e3/users/22bdbd38e4f4497f9282495367cd697c/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:12.305816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f691f-d8b7-4943-a037-01a493035dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a1b3d374594813977deaac5ca244e3, user_id=22bdbd38e4f4497f9282495367cd697c, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:12.310433 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f691f-d8b7-4943-a037-01a493035dcb admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:12.329619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 921/1858] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:12 2022] PUT /identity/v3/projects/21a1b3d374594813977deaac5ca244e3/users/22bdbd38e4f4497f9282495367cd697c/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:12.340913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52ed42-0bd5-451c-a8df-785f17e1caa3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:12.341868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52ed42-0bd5-451c-a8df-785f17e1caa3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:12.342446 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52ed42-0bd5-451c-a8df-785f17e1caa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:12.422554 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9c52ed42-0bd5-451c-a8df-785f17e1caa3 None None] MFA Rules not processed for user `22bdbd38e4f4497f9282495367cd697c`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:12.424063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9c52ed42-0bd5-451c-a8df-785f17e1caa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:12.611798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 938/1859] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:12.646000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f691f-d8b7-4943-a037-01a493035dcb admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:12.648364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-346f691f-d8b7-4943-a037-01a493035dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:12.737029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f691f-d8b7-4943-a037-01a493035dcb admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:12.741494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a80d3d-c54b-4ee7-bb4c-e5a04aeddf5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:12.742115 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a80d3d-c54b-4ee7-bb4c-e5a04aeddf5d service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:12.742503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a80d3d-c54b-4ee7-bb4c-e5a04aeddf5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:12.742752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a80d3d-c54b-4ee7-bb4c-e5a04aeddf5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:12.754785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a80d3d-c54b-4ee7-bb4c-e5a04aeddf5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:12.757915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a80d3d-c54b-4ee7-bb4c-e5a04aeddf5d service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:12.770926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 922/1860] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:13.052427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52ed42-0bd5-451c-a8df-785f17e1caa3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:13.054983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9c52ed42-0bd5-451c-a8df-785f17e1caa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:13.080669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52ed42-0bd5-451c-a8df-785f17e1caa3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:13.096222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6785ab4-9cc8-4066-9747-ba0a5a805068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:13.097411 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6785ab4-9cc8-4066-9747-ba0a5a805068 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:13.098071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6785ab4-9cc8-4066-9747-ba0a5a805068 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:13.104945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:13.109335 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6785ab4-9cc8-4066-9747-ba0a5a805068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:13.252843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6785ab4-9cc8-4066-9747-ba0a5a805068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:13.254917 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6785ab4-9cc8-4066-9747-ba0a5a805068 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:13.280637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 939/1861] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:13.307218 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:14.888323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a80d3d-c54b-4ee7-bb4c-e5a04aeddf5d service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:14.966948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a80d3d-c54b-4ee7-bb4c-e5a04aeddf5d service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:14.972009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c33456-ced1-4d32-8c5f-dade92f984df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:14.972745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33456-ced1-4d32-8c5f-dade92f984df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:14.973022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33456-ced1-4d32-8c5f-dade92f984df admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:14.973308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33456-ced1-4d32-8c5f-dade92f984df admin admin] PATH_INFO: `/v3/users/a3a3668d8dce4acd811cc0cf8d18ea5d` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:14.974600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c33456-ced1-4d32-8c5f-dade92f984df admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a3668d8dce4acd811cc0cf8d18ea5d)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:14.977171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c33456-ced1-4d32-8c5f-dade92f984df admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:15.015401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:15.222906 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e6c33456-ced1-4d32-8c5f-dade92f984df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a3668d8dce4acd811cc0cf8d18ea5d'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:15.230224 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e6c33456-ced1-4d32-8c5f-dade92f984df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a3668d8dce4acd811cc0cf8d18ea5d'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:15.230896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e6c33456-ced1-4d32-8c5f-dade92f984df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a3668d8dce4acd811cc0cf8d18ea5d'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:15.285723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6785ab4-9cc8-4066-9747-ba0a5a805068 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:15.287110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d6785ab4-9cc8-4066-9747-ba0a5a805068 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:15.300907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6785ab4-9cc8-4066-9747-ba0a5a805068 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:15.306219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:15.306833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:15.307114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:15.307386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] PATH_INFO: `/v3/users/b1e8900b67144f4da5a8bb05cc7dcbf5` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:15.308525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e8900b67144f4da5a8bb05cc7dcbf5)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:15.310510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:15.340615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e6c33456-ced1-4d32-8c5f-dade92f984df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a3668d8dce4acd811cc0cf8d18ea5d'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:15.354823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e6c33456-ced1-4d32-8c5f-dade92f984df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a3668d8dce4acd811cc0cf8d18ea5d'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:15.360892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 923/1862] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:14 2022] DELETE /identity/v3/users/a3a3668d8dce4acd811cc0cf8d18ea5d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:15.365043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca469e5-3947-4e23-b6f7-13171ccb436c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:15.365326 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca469e5-3947-4e23-b6f7-13171ccb436c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:15.365601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca469e5-3947-4e23-b6f7-13171ccb436c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:15.385269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-cca469e5-3947-4e23-b6f7-13171ccb436c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:15.386386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cca469e5-3947-4e23-b6f7-13171ccb436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:15.444400 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 924/1863] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:15.454158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca469e5-3947-4e23-b6f7-13171ccb436c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:15.455516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cca469e5-3947-4e23-b6f7-13171ccb436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:15.499256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e8900b67144f4da5a8bb05cc7dcbf5'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:15.507904 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e8900b67144f4da5a8bb05cc7dcbf5'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:15.508762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e8900b67144f4da5a8bb05cc7dcbf5'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:15.509408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e8900b67144f4da5a8bb05cc7dcbf5'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:15.515452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca469e5-3947-4e23-b6f7-13171ccb436c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:15.519058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d1739-b381-4f3a-bbff-46be73f2d148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:15.519668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d1739-b381-4f3a-bbff-46be73f2d148 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:15.519940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d1739-b381-4f3a-bbff-46be73f2d148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:15.520226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d1739-b381-4f3a-bbff-46be73f2d148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:15.521951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c31d1739-b381-4f3a-bbff-46be73f2d148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:15.533454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d1739-b381-4f3a-bbff-46be73f2d148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:15.534865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d1739-b381-4f3a-bbff-46be73f2d148 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:15.545214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 925/1864] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:35:15.578914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e8900b67144f4da5a8bb05cc7dcbf5'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:15.598137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 940/1865] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:15 2022] DELETE /identity/v3/users/b1e8900b67144f4da5a8bb05cc7dcbf5 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:15.602769 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6424c3b-4107-4721-ab67-03eb3b741140 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:15.603055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6424c3b-4107-4721-ab67-03eb3b741140 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:15.603327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6424c3b-4107-4721-ab67-03eb3b741140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:15.622664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e6424c3b-4107-4721-ab67-03eb3b741140 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:15.624022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e6424c3b-4107-4721-ab67-03eb3b741140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:15.681923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 926/1866] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:15.691651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:15.693099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:15.760212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0d969-b0dd-41ed-ab96-dca087e4a630 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:15.764329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ff582-04d9-4409-bce7-024d1ec10b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:15.764977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ff582-04d9-4409-bce7-024d1ec10b99 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:15.765252 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ff582-04d9-4409-bce7-024d1ec10b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:15.765521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ff582-04d9-4409-bce7-024d1ec10b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:15.779838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ff582-04d9-4409-bce7-024d1ec10b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:15.782967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ff582-04d9-4409-bce7-024d1ec10b99 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:15.791449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 941/1867] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:16.088481 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6424c3b-4107-4721-ab67-03eb3b741140 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:16.090138 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e6424c3b-4107-4721-ab67-03eb3b741140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:16.112562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6424c3b-4107-4721-ab67-03eb3b741140 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:16.117020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:16.117808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:16.118339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:16.118721 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] PATH_INFO: `/v3/projects/af354bb3073b45bbb72444adaaab6736` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:16.120217 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af354bb3073b45bbb72444adaaab6736)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:16.122830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:16.254311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af354bb3073b45bbb72444adaaab6736', 'request_id': 'req-f359df38-7ca1-4c14-ad33-4d1c372f87b0'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.267928 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af354bb3073b45bbb72444adaaab6736', 'request_id': 'req-f359df38-7ca1-4c14-ad33-4d1c372f87b0'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.276437 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af354bb3073b45bbb72444adaaab6736', 'request_id': 'req-f359df38-7ca1-4c14-ad33-4d1c372f87b0'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.382616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] The token cache is being invalidate because project af354bb3073b45bbb72444adaaab6736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:16.382914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.383569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.385426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 927/1868] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:16 2022] DELETE /identity/v3/projects/af354bb3073b45bbb72444adaaab6736 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:16.389110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ff582-04d9-4409-bce7-024d1ec10b99 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:16.404970 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ff582-04d9-4409-bce7-024d1ec10b99 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:16.471200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:16.472675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:16.482790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:16.483439 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:16.483771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:16.484081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] PATH_INFO: `/v3/users/22bdbd38e4f4497f9282495367cd697c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:16.485477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22bdbd38e4f4497f9282495367cd697c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:16.487868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:16.547568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359df38-7ca1-4c14-ad33-4d1c372f87b0 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:16.552454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:16.553092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:16.553401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:16.553677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] PATH_INFO: `/v3/projects/f64f76e4cf8e48a7afc7a677a9b392b0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:16.554831 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64f76e4cf8e48a7afc7a677a9b392b0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:16.556771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:16.739448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bdbd38e4f4497f9282495367cd697c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.747433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bdbd38e4f4497f9282495367cd697c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.748148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bdbd38e4f4497f9282495367cd697c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.748770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bdbd38e4f4497f9282495367cd697c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.753154 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64f76e4cf8e48a7afc7a677a9b392b0', 'request_id': 'req-42af6bd8-d90f-4dae-a762-9f4a480031b8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.759172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64f76e4cf8e48a7afc7a677a9b392b0', 'request_id': 'req-42af6bd8-d90f-4dae-a762-9f4a480031b8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.765346 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64f76e4cf8e48a7afc7a677a9b392b0', 'request_id': 'req-42af6bd8-d90f-4dae-a762-9f4a480031b8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.824658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bdbd38e4f4497f9282495367cd697c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.842740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 942/1869] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:16 2022] DELETE /identity/v3/users/22bdbd38e4f4497f9282495367cd697c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:16.923471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] The token cache is being invalidate because project f64f76e4cf8e48a7afc7a677a9b392b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:16.930286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.930286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:16.930286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 928/1870] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:16 2022] DELETE /identity/v3/projects/f64f76e4cf8e48a7afc7a677a9b392b0 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:16.930644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:16.932445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:16.997014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5d6a-a6d9-4ffb-a411-226c6b711812 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:17.001849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1c647-5062-436c-a916-620b6dc9c766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:17.002541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1c647-5062-436c-a916-620b6dc9c766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:17.002824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1c647-5062-436c-a916-620b6dc9c766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:17.003099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1c647-5062-436c-a916-620b6dc9c766 admin admin] PATH_INFO: `/v3/users/12bf8ad3ce3d48699d5d32bc6f680113` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:17.004260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1c647-5062-436c-a916-620b6dc9c766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12bf8ad3ce3d48699d5d32bc6f680113)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:17.006193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1c647-5062-436c-a916-620b6dc9c766 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:17.163931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:17.246503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b0a1c647-5062-436c-a916-620b6dc9c766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bf8ad3ce3d48699d5d32bc6f680113'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:17.253807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b0a1c647-5062-436c-a916-620b6dc9c766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bf8ad3ce3d48699d5d32bc6f680113'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:17.254487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b0a1c647-5062-436c-a916-620b6dc9c766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bf8ad3ce3d48699d5d32bc6f680113'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:17.255110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b0a1c647-5062-436c-a916-620b6dc9c766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bf8ad3ce3d48699d5d32bc6f680113'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:17.283358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:17.284888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:17.329624 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b0a1c647-5062-436c-a916-620b6dc9c766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bf8ad3ce3d48699d5d32bc6f680113'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:17.357702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 943/1871] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:16 2022] DELETE /identity/v3/users/12bf8ad3ce3d48699d5d32bc6f680113 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:17.384325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6bd8-d90f-4dae-a762-9f4a480031b8 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:17.418009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:17.515229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4ce64-5e60-4bf1-b18d-0028248d8097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:17.516187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4ce64-5e60-4bf1-b18d-0028248d8097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:17.516469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4ce64-5e60-4bf1-b18d-0028248d8097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:17.516824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4ce64-5e60-4bf1-b18d-0028248d8097 admin admin] PATH_INFO: `/v3/projects/21a1b3d374594813977deaac5ca244e3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:17.518333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4ce64-5e60-4bf1-b18d-0028248d8097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21a1b3d374594813977deaac5ca244e3)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:17.523574 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4ce64-5e60-4bf1-b18d-0028248d8097 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:17.774487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-86c4ce64-5e60-4bf1-b18d-0028248d8097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21a1b3d374594813977deaac5ca244e3', 'request_id': 'req-86c4ce64-5e60-4bf1-b18d-0028248d8097'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:17.780178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-86c4ce64-5e60-4bf1-b18d-0028248d8097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21a1b3d374594813977deaac5ca244e3', 'request_id': 'req-86c4ce64-5e60-4bf1-b18d-0028248d8097'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:17.786694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-86c4ce64-5e60-4bf1-b18d-0028248d8097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21a1b3d374594813977deaac5ca244e3', 'request_id': 'req-86c4ce64-5e60-4bf1-b18d-0028248d8097'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:17.916614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-86c4ce64-5e60-4bf1-b18d-0028248d8097 admin admin] The token cache is being invalidate because project 21a1b3d374594813977deaac5ca244e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:17.916973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-86c4ce64-5e60-4bf1-b18d-0028248d8097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:17.918349 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-86c4ce64-5e60-4bf1-b18d-0028248d8097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:17.921271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 929/1872] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:17 2022] DELETE /identity/v3/projects/21a1b3d374594813977deaac5ca244e3 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:17.927011 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd48ed-80ee-42bb-8047-cf6374bd1330 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:17.932245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd48ed-80ee-42bb-8047-cf6374bd1330 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:17.932245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd48ed-80ee-42bb-8047-cf6374bd1330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:17.949709 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8bbd48ed-80ee-42bb-8047-cf6374bd1330 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:17.956887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8bbd48ed-80ee-42bb-8047-cf6374bd1330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:18.040154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 944/1873] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:18.047713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e2dd0-939a-4284-92e7-ba82ce4f6bca None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:18.052810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e2dd0-939a-4284-92e7-ba82ce4f6bca None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:18.052810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e2dd0-939a-4284-92e7-ba82ce4f6bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:18.076286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-246e2dd0-939a-4284-92e7-ba82ce4f6bca None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:18.085833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-246e2dd0-939a-4284-92e7-ba82ce4f6bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:18.099810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 930/1874] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:18.104384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd48ed-80ee-42bb-8047-cf6374bd1330 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:18.115080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd48ed-80ee-42bb-8047-cf6374bd1330 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:18.126784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3edf6-7d02-42ed-b189-19ea8f5ae08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:18.126784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3edf6-7d02-42ed-b189-19ea8f5ae08d admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:18.126784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3edf6-7d02-42ed-b189-19ea8f5ae08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:18.126784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3edf6-7d02-42ed-b189-19ea8f5ae08d admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:18.127264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3edf6-7d02-42ed-b189-19ea8f5ae08d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:35:18.127264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3edf6-7d02-42ed-b189-19ea8f5ae08d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:18.127264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3edf6-7d02-42ed-b189-19ea8f5ae08d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:18.151729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 945/1875] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:35:18.159289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e2dd0-939a-4284-92e7-ba82ce4f6bca None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:18.169767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e2dd0-939a-4284-92e7-ba82ce4f6bca None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:18.176886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2d004-0409-4d60-8120-e44a14539adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:18.179050 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2d004-0409-4d60-8120-e44a14539adf admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:18.179597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2d004-0409-4d60-8120-e44a14539adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:18.188167 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2d004-0409-4d60-8120-e44a14539adf admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:18.189802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2d004-0409-4d60-8120-e44a14539adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:18.192885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2d004-0409-4d60-8120-e44a14539adf admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:18.321787 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 931/1876] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:18 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:18.322532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3edf6-7d02-42ed-b189-19ea8f5ae08d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:18.324027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1ca3edf6-7d02-42ed-b189-19ea8f5ae08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:18.324499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2d004-0409-4d60-8120-e44a14539adf admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:18.338341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3edf6-7d02-42ed-b189-19ea8f5ae08d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:18.389721 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2d004-0409-4d60-8120-e44a14539adf admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:18.394254 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79e3dc-3cf4-49ba-8939-bc6d36990793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:18.394881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79e3dc-3cf4-49ba-8939-bc6d36990793 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:18.395157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79e3dc-3cf4-49ba-8939-bc6d36990793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:18.395424 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79e3dc-3cf4-49ba-8939-bc6d36990793 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:18.396076 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79e3dc-3cf4-49ba-8939-bc6d36990793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:18.396720 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58cfcb-db46-49ab-820f-f7bf427f1353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:18.397411 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58cfcb-db46-49ab-820f-f7bf427f1353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:18.397711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58cfcb-db46-49ab-820f-f7bf427f1353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:18.397981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58cfcb-db46-49ab-820f-f7bf427f1353 admin admin] PATH_INFO: `/v3/projects/f987f4f189d34e8b9c9426f52ae2a041` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:18.398082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79e3dc-3cf4-49ba-8939-bc6d36990793 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:18.399137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58cfcb-db46-49ab-820f-f7bf427f1353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f987f4f189d34e8b9c9426f52ae2a041)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:18.401053 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58cfcb-db46-49ab-820f-f7bf427f1353 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:18.560276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 932/1877] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:18 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:18.563866 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79e3dc-3cf4-49ba-8939-bc6d36990793 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:18.576238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-db58cfcb-db46-49ab-820f-f7bf427f1353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f987f4f189d34e8b9c9426f52ae2a041', 'request_id': 'req-db58cfcb-db46-49ab-820f-f7bf427f1353'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:18.579807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79e3dc-3cf4-49ba-8939-bc6d36990793 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:18.583866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-db58cfcb-db46-49ab-820f-f7bf427f1353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f987f4f189d34e8b9c9426f52ae2a041', 'request_id': 'req-db58cfcb-db46-49ab-820f-f7bf427f1353'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:18.687369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fd0f5-d05e-4bf1-af96-e4cb0202c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:18.688126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fd0f5-d05e-4bf1-af96-e4cb0202c72e admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:18.688478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fd0f5-d05e-4bf1-af96-e4cb0202c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:18.688817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fd0f5-d05e-4bf1-af96-e4cb0202c72e admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:18.689601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fd0f5-d05e-4bf1-af96-e4cb0202c72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:18.694404 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fd0f5-d05e-4bf1-af96-e4cb0202c72e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:18.704461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 933/1878] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:18.713837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fd0f5-d05e-4bf1-af96-e4cb0202c72e admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:18.734029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-db58cfcb-db46-49ab-820f-f7bf427f1353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f987f4f189d34e8b9c9426f52ae2a041', 'request_id': 'req-db58cfcb-db46-49ab-820f-f7bf427f1353'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:18.748905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fd0f5-d05e-4bf1-af96-e4cb0202c72e admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:18.751279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-db58cfcb-db46-49ab-820f-f7bf427f1353 admin admin] The token cache is being invalidate because project f987f4f189d34e8b9c9426f52ae2a041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:18.752162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-db58cfcb-db46-49ab-820f-f7bf427f1353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:18.753305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-db58cfcb-db46-49ab-820f-f7bf427f1353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:18.769477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 946/1879] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:18 2022] DELETE /identity/v3/projects/f987f4f189d34e8b9c9426f52ae2a041 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:18.771651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20989c-15ee-4619-8960-3babdcc59993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:18.774602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609c82-9104-4f3e-ac89-b1f93b70d262 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:18.774877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609c82-9104-4f3e-ac89-b1f93b70d262 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:18.775148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609c82-9104-4f3e-ac89-b1f93b70d262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:18.784636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20989c-15ee-4619-8960-3babdcc59993 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:18.784908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20989c-15ee-4619-8960-3babdcc59993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:18.785178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20989c-15ee-4619-8960-3babdcc59993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:18.785910 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20989c-15ee-4619-8960-3babdcc59993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:18.788347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20989c-15ee-4619-8960-3babdcc59993 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:18.838569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 934/1880] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:18.838569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20989c-15ee-4619-8960-3babdcc59993 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:18.838868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7a609c82-9104-4f3e-ac89-b1f93b70d262 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:18.838868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7a609c82-9104-4f3e-ac89-b1f93b70d262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:18.839049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dd20989c-15ee-4619-8960-3babdcc59993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:18.843472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20989c-15ee-4619-8960-3babdcc59993 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:18.844410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 947/1881] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:18.852874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bad0e-d063-416b-858f-6cd3d3112ad9 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:18.853170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bad0e-d063-416b-858f-6cd3d3112ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:18.853635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bad0e-d063-416b-858f-6cd3d3112ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:18.874981 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22dbf2-49c5-4f74-a6ea-58f6a731d0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:18.875853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22dbf2-49c5-4f74-a6ea-58f6a731d0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:18.876228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22dbf2-49c5-4f74-a6ea-58f6a731d0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:18.876573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22dbf2-49c5-4f74-a6ea-58f6a731d0e5 admin admin] PATH_INFO: `/v3/projects/314c89250b644fd695ae3966757dfb20/users/f5ca1bc84be04e61a641b18b26cb63cf/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:18.885450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-674bad0e-d063-416b-858f-6cd3d3112ad9 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:18.886705 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-674bad0e-d063-416b-858f-6cd3d3112ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:18.900355 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 948/1882] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:18.904380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bad0e-d063-416b-858f-6cd3d3112ad9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:18.906591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22dbf2-49c5-4f74-a6ea-58f6a731d0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=314c89250b644fd695ae3966757dfb20, user_id=f5ca1bc84be04e61a641b18b26cb63cf, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:18.909465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22dbf2-49c5-4f74-a6ea-58f6a731d0e5 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:18.929195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bad0e-d063-416b-858f-6cd3d3112ad9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:18.935396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b6571-37de-4320-baa0-6b917208fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:18.936159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b6571-37de-4320-baa0-6b917208fdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:18.936501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b6571-37de-4320-baa0-6b917208fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:18.936837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b6571-37de-4320-baa0-6b917208fdb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:18.937560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b6571-37de-4320-baa0-6b917208fdb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:35:18.937931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b6571-37de-4320-baa0-6b917208fdb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:18.939514 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b6571-37de-4320-baa0-6b917208fdb7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:18.951243 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 949/1883] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:35:18.955519 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b6571-37de-4320-baa0-6b917208fdb7 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:18.965721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b6571-37de-4320-baa0-6b917208fdb7 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:18.971938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba753a0-34bc-442d-a55e-2fc4cfa5881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:18.972801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba753a0-34bc-442d-a55e-2fc4cfa5881e admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:18.972979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba753a0-34bc-442d-a55e-2fc4cfa5881e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:18.973285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba753a0-34bc-442d-a55e-2fc4cfa5881e admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:18.973924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba753a0-34bc-442d-a55e-2fc4cfa5881e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:18.976692 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba753a0-34bc-442d-a55e-2fc4cfa5881e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:19.899727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 935/1884] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:18 2022] PUT /identity/v3/projects/314c89250b644fd695ae3966757dfb20/users/f5ca1bc84be04e61a641b18b26cb63cf/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 1075 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:19.905087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b90a0-b491-4f35-93a8-dbeced4684e1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:19.905087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b90a0-b491-4f35-93a8-dbeced4684e1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:19.905087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b90a0-b491-4f35-93a8-dbeced4684e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:19.905378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 950/1885] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:18 2022] POST /identity/v3/projects => generated 377 bytes in 948 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:19.911981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba753a0-34bc-442d-a55e-2fc4cfa5881e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:19.941717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b29b90a0-b491-4f35-93a8-dbeced4684e1 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:19.943243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b29b90a0-b491-4f35-93a8-dbeced4684e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:19.999219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba753a0-34bc-442d-a55e-2fc4cfa5881e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:20.023871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c641a3-0b88-4752-803c-1ee97d30913b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:20.026818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c641a3-0b88-4752-803c-1ee97d30913b admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:20.026818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c641a3-0b88-4752-803c-1ee97d30913b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:20.026818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c641a3-0b88-4752-803c-1ee97d30913b admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:20.026818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c641a3-0b88-4752-803c-1ee97d30913b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:20.031942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c641a3-0b88-4752-803c-1ee97d30913b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:20.058793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 936/1886] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:20.072911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b90a0-b491-4f35-93a8-dbeced4684e1 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:20.074597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b29b90a0-b491-4f35-93a8-dbeced4684e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:20.158428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b90a0-b491-4f35-93a8-dbeced4684e1 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:20.162202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c5729-1dcc-4c23-a97e-e442a4f787f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:20.163366 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c5729-1dcc-4c23-a97e-e442a4f787f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:20.163643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c5729-1dcc-4c23-a97e-e442a4f787f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:20.163916 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c5729-1dcc-4c23-a97e-e442a4f787f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:20.177067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c5729-1dcc-4c23-a97e-e442a4f787f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:20.178890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c5729-1dcc-4c23-a97e-e442a4f787f6 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:20.191691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 937/1887] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:20.230284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 951/1888] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:19 2022] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:20.231790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c5729-1dcc-4c23-a97e-e442a4f787f6 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:20.249915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c5729-1dcc-4c23-a97e-e442a4f787f6 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:20.257936 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f5501-e5b9-48e2-8d5f-d2607b53ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:20.258636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f5501-e5b9-48e2-8d5f-d2607b53ad95 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:20.258985 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f5501-e5b9-48e2-8d5f-d2607b53ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:20.259342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f5501-e5b9-48e2-8d5f-d2607b53ad95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:20.260174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f5501-e5b9-48e2-8d5f-d2607b53ad95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:20.262112 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f5501-e5b9-48e2-8d5f-d2607b53ad95 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:20.275452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 938/1889] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:20.279677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c641a3-0b88-4752-803c-1ee97d30913b admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:20.290806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c641a3-0b88-4752-803c-1ee97d30913b admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:20.307386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babe111-b3ab-444c-99b6-b507bd428d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:20.308039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babe111-b3ab-444c-99b6-b507bd428d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:20.308326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babe111-b3ab-444c-99b6-b507bd428d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:20.308602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babe111-b3ab-444c-99b6-b507bd428d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:20.309495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babe111-b3ab-444c-99b6-b507bd428d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:20.313081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babe111-b3ab-444c-99b6-b507bd428d33 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:20.327490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 952/1890] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:20.328807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f5501-e5b9-48e2-8d5f-d2607b53ad95 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:20.340631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f5501-e5b9-48e2-8d5f-d2607b53ad95 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:20.345847 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef57c70-0e16-46ea-80b9-521009a08241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:20.346553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef57c70-0e16-46ea-80b9-521009a08241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:20.346829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef57c70-0e16-46ea-80b9-521009a08241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:20.347150 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef57c70-0e16-46ea-80b9-521009a08241 admin admin] PATH_INFO: `/v3/projects/bb1d3e12f9854e06b00e7c6c68e63d47/users/f9683213a91f4154b845df189db992ea/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:20.365441 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef57c70-0e16-46ea-80b9-521009a08241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1d3e12f9854e06b00e7c6c68e63d47, user_id=f9683213a91f4154b845df189db992ea, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:20.369047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef57c70-0e16-46ea-80b9-521009a08241 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:20.380051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c591a6-3a79-4219-b363-1c53e0f46c67 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:20.380688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c591a6-3a79-4219-b363-1c53e0f46c67 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:20.380688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c591a6-3a79-4219-b363-1c53e0f46c67 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:20.382318 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 953/1891] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:35:20.396278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba55fb-aa1d-4d23-bf4d-fe36da972f50 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:20.397914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba55fb-aa1d-4d23-bf4d-fe36da972f50 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:20.398429 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba55fb-aa1d-4d23-bf4d-fe36da972f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:20.424259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-62ba55fb-aa1d-4d23-bf4d-fe36da972f50 None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:20.425566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-62ba55fb-aa1d-4d23-bf4d-fe36da972f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:20.475376 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 939/1892] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:20 2022] PUT /identity/v3/projects/bb1d3e12f9854e06b00e7c6c68e63d47/users/f9683213a91f4154b845df189db992ea/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:20.494354 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f886598-641e-4355-9fbe-a4cd5701d214 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:20.495686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f886598-641e-4355-9fbe-a4cd5701d214 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:20.495991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f886598-641e-4355-9fbe-a4cd5701d214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:20.507390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 954/1893] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:35:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:20.520279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba55fb-aa1d-4d23-bf4d-fe36da972f50 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:20.521604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-62ba55fb-aa1d-4d23-bf4d-fe36da972f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:20.539391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba55fb-aa1d-4d23-bf4d-fe36da972f50 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:20.539675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4f886598-641e-4355-9fbe-a4cd5701d214 None None] MFA Rules not processed for user `f9683213a91f4154b845df189db992ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:20.542096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4f886598-641e-4355-9fbe-a4cd5701d214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:20.626800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:20.651185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1bb86-57d6-4568-88b3-60d6c364f48f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:20.652004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1bb86-57d6-4568-88b3-60d6c364f48f service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:20.652295 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1bb86-57d6-4568-88b3-60d6c364f48f service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:20.652614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1bb86-57d6-4568-88b3-60d6c364f48f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:20.656235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 940/1894] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:20.663419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f886598-641e-4355-9fbe-a4cd5701d214 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:20.697790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1bb86-57d6-4568-88b3-60d6c364f48f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:20.701521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1bb86-57d6-4568-88b3-60d6c364f48f service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:20.723336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 955/1895] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:35:20.777821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f886598-641e-4355-9fbe-a4cd5701d214 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:20.782915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fe3c8-0cb1-4899-91cf-91d8dbaa37ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:20.783537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fe3c8-0cb1-4899-91cf-91d8dbaa37ab admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:20.783815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fe3c8-0cb1-4899-91cf-91d8dbaa37ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:20.784240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fe3c8-0cb1-4899-91cf-91d8dbaa37ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:20.784788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fe3c8-0cb1-4899-91cf-91d8dbaa37ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:20.788818 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fe3c8-0cb1-4899-91cf-91d8dbaa37ab admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:20.914620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 941/1896] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:20 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:20.920595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1bb86-57d6-4568-88b3-60d6c364f48f service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:20.933611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1bb86-57d6-4568-88b3-60d6c364f48f service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:21.008432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebdf0a-2cf4-46db-9f0b-8ed58f2f5703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:21.014226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebdf0a-2cf4-46db-9f0b-8ed58f2f5703 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:21.014226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebdf0a-2cf4-46db-9f0b-8ed58f2f5703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:21.014226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebdf0a-2cf4-46db-9f0b-8ed58f2f5703 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:21.014226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebdf0a-2cf4-46db-9f0b-8ed58f2f5703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:21.014226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebdf0a-2cf4-46db-9f0b-8ed58f2f5703 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:21.123758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 956/1897] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:20 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:21.127813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fe3c8-0cb1-4899-91cf-91d8dbaa37ab admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:21.144757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fe3c8-0cb1-4899-91cf-91d8dbaa37ab admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:21.152633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d77d4-5325-4adc-bda0-40e2fa08bab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:21.154624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d77d4-5325-4adc-bda0-40e2fa08bab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:21.154624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d77d4-5325-4adc-bda0-40e2fa08bab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:21.154624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d77d4-5325-4adc-bda0-40e2fa08bab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:21.154624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d77d4-5325-4adc-bda0-40e2fa08bab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:21.157227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d77d4-5325-4adc-bda0-40e2fa08bab9 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:21.172333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 942/1898] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:21.173528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebdf0a-2cf4-46db-9f0b-8ed58f2f5703 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:21.185297 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebdf0a-2cf4-46db-9f0b-8ed58f2f5703 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:21.190585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef639bd-d891-4bcd-aab5-f311c3ef15f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:21.191267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef639bd-d891-4bcd-aab5-f311c3ef15f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:21.191589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef639bd-d891-4bcd-aab5-f311c3ef15f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:21.192014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef639bd-d891-4bcd-aab5-f311c3ef15f0 admin admin] PATH_INFO: `/v3/projects/c7019c9673f54080853def8bfd632b79/users/f0a7bffd052c4d1389b1ae5f604f83ba/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:21.215324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef639bd-d891-4bcd-aab5-f311c3ef15f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7019c9673f54080853def8bfd632b79, user_id=f0a7bffd052c4d1389b1ae5f604f83ba, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:21.215324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef639bd-d891-4bcd-aab5-f311c3ef15f0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:21.323912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 957/1899] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:21 2022] PUT /identity/v3/projects/c7019c9673f54080853def8bfd632b79/users/f0a7bffd052c4d1389b1ae5f604f83ba/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:21.328792 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d77d4-5325-4adc-bda0-40e2fa08bab9 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:21.349519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d77d4-5325-4adc-bda0-40e2fa08bab9 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:21.421713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5176a4-a953-4eb7-ba41-19eb7cb0db08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:21.422496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5176a4-a953-4eb7-ba41-19eb7cb0db08 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:21.422629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5176a4-a953-4eb7-ba41-19eb7cb0db08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:21.422928 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5176a4-a953-4eb7-ba41-19eb7cb0db08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:21.423662 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5176a4-a953-4eb7-ba41-19eb7cb0db08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:21.425264 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5176a4-a953-4eb7-ba41-19eb7cb0db08 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:21.440146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 943/1900] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:21.441271 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef639bd-d891-4bcd-aab5-f311c3ef15f0 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:21.452773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef639bd-d891-4bcd-aab5-f311c3ef15f0 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:21.457894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2543c7b-70b7-414c-8ef8-eece7cbaa095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:21.458631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2543c7b-70b7-414c-8ef8-eece7cbaa095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:21.459287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2543c7b-70b7-414c-8ef8-eece7cbaa095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:21.459287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2543c7b-70b7-414c-8ef8-eece7cbaa095 admin admin] PATH_INFO: `/v3/projects/c7019c9673f54080853def8bfd632b79/users/f0a7bffd052c4d1389b1ae5f604f83ba/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:21.461303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2543c7b-70b7-414c-8ef8-eece7cbaa095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7019c9673f54080853def8bfd632b79, user_id=f0a7bffd052c4d1389b1ae5f604f83ba, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:21.464070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2543c7b-70b7-414c-8ef8-eece7cbaa095 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:21.479107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 958/1901] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:21 2022] PUT /identity/v3/projects/c7019c9673f54080853def8bfd632b79/users/f0a7bffd052c4d1389b1ae5f604f83ba/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:21.489869 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e08c5-4df9-41bc-910c-7f971619fa3b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:21.490152 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e08c5-4df9-41bc-910c-7f971619fa3b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:21.490426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e08c5-4df9-41bc-910c-7f971619fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:21.524049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3f0e08c5-4df9-41bc-910c-7f971619fa3b None None] MFA Rules not processed for user `f0a7bffd052c4d1389b1ae5f604f83ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:21.524049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3f0e08c5-4df9-41bc-910c-7f971619fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:21.539388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:21.588089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 944/1902] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:21.601292 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2543c7b-70b7-414c-8ef8-eece7cbaa095 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:21.603803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c2543c7b-70b7-414c-8ef8-eece7cbaa095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:21.624084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:21.678175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2543c7b-70b7-414c-8ef8-eece7cbaa095 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:21.681845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bc779-a037-4bb5-bb87-41d3513b859e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:21.682459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bc779-a037-4bb5-bb87-41d3513b859e service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:21.682737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bc779-a037-4bb5-bb87-41d3513b859e service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:21.683007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bc779-a037-4bb5-bb87-41d3513b859e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:21.754559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bc779-a037-4bb5-bb87-41d3513b859e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:21.757245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bc779-a037-4bb5-bb87-41d3513b859e service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:21.772256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 959/1903] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:22.098132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d452d3-b8ec-4034-92e8-986572344f1b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:22.098646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d452d3-b8ec-4034-92e8-986572344f1b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:22.098751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d452d3-b8ec-4034-92e8-986572344f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:22.152253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-75d452d3-b8ec-4034-92e8-986572344f1b None None] MFA Rules not processed for user `f5ca1bc84be04e61a641b18b26cb63cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:22.153793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-75d452d3-b8ec-4034-92e8-986572344f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:22.236233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 945/1904] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:22.903932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bc779-a037-4bb5-bb87-41d3513b859e service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:22.923644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bc779-a037-4bb5-bb87-41d3513b859e service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:22.933314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7052fce-9a5c-46c2-b780-35feccdebe04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:22.933981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7052fce-9a5c-46c2-b780-35feccdebe04 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:22.934262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7052fce-9a5c-46c2-b780-35feccdebe04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:22.934535 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7052fce-9a5c-46c2-b780-35feccdebe04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:22.957341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7052fce-9a5c-46c2-b780-35feccdebe04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:22.958787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7052fce-9a5c-46c2-b780-35feccdebe04 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:22.992717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 960/1905] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:23.513238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:24.076947 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d452d3-b8ec-4034-92e8-986572344f1b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:24.078348 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-75d452d3-b8ec-4034-92e8-986572344f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:24.091157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d452d3-b8ec-4034-92e8-986572344f1b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:24.095677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7be86-1bc8-4eeb-b46e-f1461c561e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:24.096351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7be86-1bc8-4eeb-b46e-f1461c561e85 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:24.096631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7be86-1bc8-4eeb-b46e-f1461c561e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:24.096902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7be86-1bc8-4eeb-b46e-f1461c561e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:24.107425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7be86-1bc8-4eeb-b46e-f1461c561e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:24.108894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7be86-1bc8-4eeb-b46e-f1461c561e85 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:24.120298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 946/1906] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:35:24.996211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd157d1-c4d4-4c1e-9dd6-2033e2b01d8e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:24.997016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd157d1-c4d4-4c1e-9dd6-2033e2b01d8e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:24.997647 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd157d1-c4d4-4c1e-9dd6-2033e2b01d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:25.024589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-afd157d1-c4d4-4c1e-9dd6-2033e2b01d8e None None] MFA Rules not processed for user `f5ca1bc84be04e61a641b18b26cb63cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:25.026009 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-afd157d1-c4d4-4c1e-9dd6-2033e2b01d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:25.043354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 961/1907] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:25.136039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:26.101511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7be86-1bc8-4eeb-b46e-f1461c561e85 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:26.103458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-37b7be86-1bc8-4eeb-b46e-f1461c561e85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:26.221804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:26.256453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7be86-1bc8-4eeb-b46e-f1461c561e85 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:26.262695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:26.266427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:26.266427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:26.268166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] PATH_INFO: `/v3/users/6d005cabfedf44ac92235f37939b4c61` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:26.269615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d005cabfedf44ac92235f37939b4c61)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:26.272508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:26.610934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d005cabfedf44ac92235f37939b4c61'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:26.622025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d005cabfedf44ac92235f37939b4c61'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:26.622788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d005cabfedf44ac92235f37939b4c61'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:26.699176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d005cabfedf44ac92235f37939b4c61'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:26.722278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d005cabfedf44ac92235f37939b4c61'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:26.732344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 947/1908] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:26 2022] DELETE /identity/v3/users/6d005cabfedf44ac92235f37939b4c61 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:26.741219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac022e-818c-41bb-a7bc-17352c522176 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:26.741617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac022e-818c-41bb-a7bc-17352c522176 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:26.742582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac022e-818c-41bb-a7bc-17352c522176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:26.775545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-47ac022e-818c-41bb-a7bc-17352c522176 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:26.776892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-47ac022e-818c-41bb-a7bc-17352c522176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:26.851908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 962/1909] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:26.862551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:26.864290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:26.966834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d71e9a-cb49-40fb-af4c-981b3e74d988 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:26.976259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70dbf9-6536-4fe8-913d-7e37156884ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:26.977069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70dbf9-6536-4fe8-913d-7e37156884ac service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:26.977443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70dbf9-6536-4fe8-913d-7e37156884ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:26.977815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70dbf9-6536-4fe8-913d-7e37156884ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:26.996473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70dbf9-6536-4fe8-913d-7e37156884ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:27.004323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70dbf9-6536-4fe8-913d-7e37156884ac service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:27.013359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 948/1910] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:27.615137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:27.926090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac022e-818c-41bb-a7bc-17352c522176 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:27.928643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-47ac022e-818c-41bb-a7bc-17352c522176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:27.944956 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac022e-818c-41bb-a7bc-17352c522176 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:27.952353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:27.953864 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:27.954353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:27.954826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] PATH_INFO: `/v3/projects/4cf99bde65364d9aad83d50bfd365b08` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:27.956300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf99bde65364d9aad83d50bfd365b08)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:27.961000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:28.142351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf99bde65364d9aad83d50bfd365b08', 'request_id': 'req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:28.152806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf99bde65364d9aad83d50bfd365b08', 'request_id': 'req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:28.270404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf99bde65364d9aad83d50bfd365b08', 'request_id': 'req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:28.305521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] The token cache is being invalidate because project 4cf99bde65364d9aad83d50bfd365b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:28.305852 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:28.306694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:28.309216 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 963/1911] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:27 2022] DELETE /identity/v3/projects/4cf99bde65364d9aad83d50bfd365b08 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:28.313010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70dbf9-6536-4fe8-913d-7e37156884ac service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:28.326414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70dbf9-6536-4fe8-913d-7e37156884ac service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:28.394310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:28.395077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:28.395445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:28.395798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] PATH_INFO: `/v3/users/85a337e345d54750b9ec1810744744a4` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:28.397356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a337e345d54750b9ec1810744744a4)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:28.399304 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:28.694716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a337e345d54750b9ec1810744744a4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:28.701948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a337e345d54750b9ec1810744744a4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:28.702676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a337e345d54750b9ec1810744744a4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:28.814656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a337e345d54750b9ec1810744744a4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:28.826901 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:28.828449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:28.828871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a337e345d54750b9ec1810744744a4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:28.835032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 949/1912] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:28 2022] DELETE /identity/v3/users/85a337e345d54750b9ec1810744744a4 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:28.843425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b55a79-4780-4dc2-9b4c-0ce47e2eabfc admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:28.932680 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524f9db-6c0f-44a9-a40c-7e7ee1bb1086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:28.933336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524f9db-6c0f-44a9-a40c-7e7ee1bb1086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:28.933790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524f9db-6c0f-44a9-a40c-7e7ee1bb1086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:28.934208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524f9db-6c0f-44a9-a40c-7e7ee1bb1086 admin admin] PATH_INFO: `/v3/users/f9683213a91f4154b845df189db992ea` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:28.935361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524f9db-6c0f-44a9-a40c-7e7ee1bb1086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9683213a91f4154b845df189db992ea)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:28.937316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524f9db-6c0f-44a9-a40c-7e7ee1bb1086 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:29.194610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a524f9db-6c0f-44a9-a40c-7e7ee1bb1086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9683213a91f4154b845df189db992ea'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:29.223202 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a524f9db-6c0f-44a9-a40c-7e7ee1bb1086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9683213a91f4154b845df189db992ea'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:29.223996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a524f9db-6c0f-44a9-a40c-7e7ee1bb1086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9683213a91f4154b845df189db992ea'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:29.224727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a524f9db-6c0f-44a9-a40c-7e7ee1bb1086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9683213a91f4154b845df189db992ea'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:29.341582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a524f9db-6c0f-44a9-a40c-7e7ee1bb1086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9683213a91f4154b845df189db992ea'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:29.353056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:29.354550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:29.375383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 964/1913] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:28 2022] DELETE /identity/v3/users/f9683213a91f4154b845df189db992ea => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:29.383201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54de95d-9e6b-4b71-8378-e0fdad23158b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:29.383201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54de95d-9e6b-4b71-8378-e0fdad23158b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:29.383520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54de95d-9e6b-4b71-8378-e0fdad23158b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:29.389104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b55a3-02c4-4c8a-8511-f15d97b42636 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:29.422572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a54de95d-9e6b-4b71-8378-e0fdad23158b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:29.423993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a54de95d-9e6b-4b71-8378-e0fdad23158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:29.516968 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0793751-fba7-437a-b5e1-e905c43bd498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:29.519164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0793751-fba7-437a-b5e1-e905c43bd498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:29.519164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0793751-fba7-437a-b5e1-e905c43bd498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:29.519164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0793751-fba7-437a-b5e1-e905c43bd498 admin admin] PATH_INFO: `/v3/projects/7d716bdec79141289b436581e178e2ab` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:29.519602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0793751-fba7-437a-b5e1-e905c43bd498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d716bdec79141289b436581e178e2ab)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:29.521569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0793751-fba7-437a-b5e1-e905c43bd498 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:29.525544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 965/1914] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:29.547157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54de95d-9e6b-4b71-8378-e0fdad23158b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:29.553760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a54de95d-9e6b-4b71-8378-e0fdad23158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:29.644414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:29.687831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54de95d-9e6b-4b71-8378-e0fdad23158b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:29.692236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cc031-c3c0-4b19-97d1-92ff33d5a012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:29.693058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cc031-c3c0-4b19-97d1-92ff33d5a012 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:29.693486 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cc031-c3c0-4b19-97d1-92ff33d5a012 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:29.694452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cc031-c3c0-4b19-97d1-92ff33d5a012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:29.713890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cc031-c3c0-4b19-97d1-92ff33d5a012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:29.718280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cc031-c3c0-4b19-97d1-92ff33d5a012 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:29.738837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b0793751-fba7-437a-b5e1-e905c43bd498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d716bdec79141289b436581e178e2ab', 'request_id': 'req-b0793751-fba7-437a-b5e1-e905c43bd498'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:29.747158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 966/1915] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:29.751504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b0793751-fba7-437a-b5e1-e905c43bd498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d716bdec79141289b436581e178e2ab', 'request_id': 'req-b0793751-fba7-437a-b5e1-e905c43bd498'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:29.759070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b0793751-fba7-437a-b5e1-e905c43bd498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d716bdec79141289b436581e178e2ab', 'request_id': 'req-b0793751-fba7-437a-b5e1-e905c43bd498'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:29.888102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b0793751-fba7-437a-b5e1-e905c43bd498 admin admin] The token cache is being invalidate because project 7d716bdec79141289b436581e178e2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:29.888405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b0793751-fba7-437a-b5e1-e905c43bd498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:29.889748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b0793751-fba7-437a-b5e1-e905c43bd498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:29.893261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 950/1916] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:29 2022] DELETE /identity/v3/projects/7d716bdec79141289b436581e178e2ab => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:29.898500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f4a0d-12dc-4899-abe4-31c8631f92ff None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:29.899006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f4a0d-12dc-4899-abe4-31c8631f92ff None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:29.899978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f4a0d-12dc-4899-abe4-31c8631f92ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:29.973931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-749f4a0d-12dc-4899-abe4-31c8631f92ff None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:29.976372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-749f4a0d-12dc-4899-abe4-31c8631f92ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:30.078464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 967/1917] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:30.089466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224f855-6fb2-4a8f-9bb2-c6a57dd0b379 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:30.089757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224f855-6fb2-4a8f-9bb2-c6a57dd0b379 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:30.090031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224f855-6fb2-4a8f-9bb2-c6a57dd0b379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:30.110974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6224f855-6fb2-4a8f-9bb2-c6a57dd0b379 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:30.116162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6224f855-6fb2-4a8f-9bb2-c6a57dd0b379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:30.123399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 951/1918] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:30.127546 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f4a0d-12dc-4899-abe4-31c8631f92ff None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:30.138605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f4a0d-12dc-4899-abe4-31c8631f92ff None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:30.143405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac26b24-fe13-4636-b171-ea849e989975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:30.144250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac26b24-fe13-4636-b171-ea849e989975 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:30.144841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac26b24-fe13-4636-b171-ea849e989975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:30.145455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac26b24-fe13-4636-b171-ea849e989975 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:30.146283 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac26b24-fe13-4636-b171-ea849e989975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:35:30.146589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac26b24-fe13-4636-b171-ea849e989975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:30.148307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac26b24-fe13-4636-b171-ea849e989975 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:30.162821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 968/1919] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:35:30.167859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224f855-6fb2-4a8f-9bb2-c6a57dd0b379 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:30.191450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224f855-6fb2-4a8f-9bb2-c6a57dd0b379 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:30.196798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc056dd-ef6c-426b-a522-cd4a59bbacf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:30.197503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc056dd-ef6c-426b-a522-cd4a59bbacf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:30.197841 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc056dd-ef6c-426b-a522-cd4a59bbacf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:30.198211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc056dd-ef6c-426b-a522-cd4a59bbacf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:30.198919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc056dd-ef6c-426b-a522-cd4a59bbacf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:30.200950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc056dd-ef6c-426b-a522-cd4a59bbacf3 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:30.359091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 952/1920] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:30 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:30.360936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac26b24-fe13-4636-b171-ea849e989975 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:30.387333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac26b24-fe13-4636-b171-ea849e989975 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:30.511654 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d27a8b-d198-40ad-a3df-485b1d99a44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:30.512468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d27a8b-d198-40ad-a3df-485b1d99a44f admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:30.513003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d27a8b-d198-40ad-a3df-485b1d99a44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:30.513386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d27a8b-d198-40ad-a3df-485b1d99a44f admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:30.514146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d27a8b-d198-40ad-a3df-485b1d99a44f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:30.516247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d27a8b-d198-40ad-a3df-485b1d99a44f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:30.592195 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc056dd-ef6c-426b-a522-cd4a59bbacf3 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:30.594109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2fc056dd-ef6c-426b-a522-cd4a59bbacf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:30.609944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc056dd-ef6c-426b-a522-cd4a59bbacf3 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:30.614824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c6696-dd2d-42f2-b594-923c65a2e82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:30.616237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c6696-dd2d-42f2-b594-923c65a2e82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:30.616875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c6696-dd2d-42f2-b594-923c65a2e82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:30.617573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c6696-dd2d-42f2-b594-923c65a2e82c admin admin] PATH_INFO: `/v3/users/f738ceaeb2cc4c0e8f173db34f5e3e51` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:30.618895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c6696-dd2d-42f2-b594-923c65a2e82c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f738ceaeb2cc4c0e8f173db34f5e3e51)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:30.621524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c6696-dd2d-42f2-b594-923c65a2e82c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:30.686093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 969/1921] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:30 2022] POST /identity/v3/users => generated 294 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:30.689041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d27a8b-d198-40ad-a3df-485b1d99a44f admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:30.714779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d27a8b-d198-40ad-a3df-485b1d99a44f admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:30.720544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a22197-d808-409a-9b1a-95d58cfeaab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:30.721338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a22197-d808-409a-9b1a-95d58cfeaab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:30.721725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a22197-d808-409a-9b1a-95d58cfeaab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:30.722100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a22197-d808-409a-9b1a-95d58cfeaab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:30.723108 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a22197-d808-409a-9b1a-95d58cfeaab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:30.725813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a22197-d808-409a-9b1a-95d58cfeaab6 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:30.739887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 970/1922] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:30.744138 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a22197-d808-409a-9b1a-95d58cfeaab6 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:30.754958 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a22197-d808-409a-9b1a-95d58cfeaab6 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:30.761301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155165d5-5a20-4882-952c-91f086f84086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:30.762141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155165d5-5a20-4882-952c-91f086f84086 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:30.762713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155165d5-5a20-4882-952c-91f086f84086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:30.763199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155165d5-5a20-4882-952c-91f086f84086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:30.764151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155165d5-5a20-4882-952c-91f086f84086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:30.766350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155165d5-5a20-4882-952c-91f086f84086 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:30.779787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 971/1923] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:30.784079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155165d5-5a20-4882-952c-91f086f84086 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:30.799618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155165d5-5a20-4882-952c-91f086f84086 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:30.805209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bd77c-f58b-4ed6-9420-4a2b43abaf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:30.806120 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bd77c-f58b-4ed6-9420-4a2b43abaf4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:30.806480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bd77c-f58b-4ed6-9420-4a2b43abaf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:30.806848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bd77c-f58b-4ed6-9420-4a2b43abaf4b admin admin] PATH_INFO: `/v3/projects/0dea3db50deb43e39b8e28269d4ec1ec/users/6393263346894b06adbf7585d99a0d8d/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:30.823501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bd77c-f58b-4ed6-9420-4a2b43abaf4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dea3db50deb43e39b8e28269d4ec1ec, user_id=6393263346894b06adbf7585d99a0d8d, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:30.826338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bd77c-f58b-4ed6-9420-4a2b43abaf4b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:30.941683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 972/1924] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:30 2022] PUT /identity/v3/projects/0dea3db50deb43e39b8e28269d4ec1ec/users/6393263346894b06adbf7585d99a0d8d/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:30.957526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590085f2-74bf-4e8c-af38-d63e78877b7d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:30.958075 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590085f2-74bf-4e8c-af38-d63e78877b7d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:30.958704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590085f2-74bf-4e8c-af38-d63e78877b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:30.965348 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e96c6696-dd2d-42f2-b594-923c65a2e82c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f738ceaeb2cc4c0e8f173db34f5e3e51'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:30.973279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e96c6696-dd2d-42f2-b594-923c65a2e82c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f738ceaeb2cc4c0e8f173db34f5e3e51'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:30.974313 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e96c6696-dd2d-42f2-b594-923c65a2e82c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f738ceaeb2cc4c0e8f173db34f5e3e51'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:31.008121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-590085f2-74bf-4e8c-af38-d63e78877b7d None None] MFA Rules not processed for user `6393263346894b06adbf7585d99a0d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:31.009285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-590085f2-74bf-4e8c-af38-d63e78877b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:31.080592 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 973/1925] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:31.085567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e96c6696-dd2d-42f2-b594-923c65a2e82c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f738ceaeb2cc4c0e8f173db34f5e3e51'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:31.088689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590085f2-74bf-4e8c-af38-d63e78877b7d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:31.090071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-590085f2-74bf-4e8c-af38-d63e78877b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:31.099868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e96c6696-dd2d-42f2-b594-923c65a2e82c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f738ceaeb2cc4c0e8f173db34f5e3e51'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:31.106191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 953/1926] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:30 2022] DELETE /identity/v3/users/f738ceaeb2cc4c0e8f173db34f5e3e51 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:31.111149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82d281-4062-46fd-a0a3-83d3169934f4 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:31.111480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82d281-4062-46fd-a0a3-83d3169934f4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:31.111756 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82d281-4062-46fd-a0a3-83d3169934f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:31.132995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9b82d281-4062-46fd-a0a3-83d3169934f4 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:31.134261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9b82d281-4062-46fd-a0a3-83d3169934f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:31.174556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590085f2-74bf-4e8c-af38-d63e78877b7d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:31.211931 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 954/1927] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:31.220329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82d281-4062-46fd-a0a3-83d3169934f4 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:31.222239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9b82d281-4062-46fd-a0a3-83d3169934f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:31.317361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490ae93-f275-4f3e-92ed-8ae20ce6f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:31.324047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490ae93-f275-4f3e-92ed-8ae20ce6f219 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:31.324047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490ae93-f275-4f3e-92ed-8ae20ce6f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:31.324047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490ae93-f275-4f3e-92ed-8ae20ce6f219 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:31.324047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490ae93-f275-4f3e-92ed-8ae20ce6f219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:31.324047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490ae93-f275-4f3e-92ed-8ae20ce6f219 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:31.343269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82d281-4062-46fd-a0a3-83d3169934f4 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:31.351452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086c8ee-df39-40fb-8120-fc19f3d22d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:31.352309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086c8ee-df39-40fb-8120-fc19f3d22d31 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:31.352800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086c8ee-df39-40fb-8120-fc19f3d22d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:31.353231 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086c8ee-df39-40fb-8120-fc19f3d22d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:31.371353 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086c8ee-df39-40fb-8120-fc19f3d22d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:31.372998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086c8ee-df39-40fb-8120-fc19f3d22d31 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:31.389664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 955/1928] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:31.390859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086c8ee-df39-40fb-8120-fc19f3d22d31 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:31.392588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a086c8ee-df39-40fb-8120-fc19f3d22d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:31.405864 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086c8ee-df39-40fb-8120-fc19f3d22d31 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:31.413386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:31.414300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:31.414651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:31.415024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] PATH_INFO: `/v3/projects/bb1d3e12f9854e06b00e7c6c68e63d47` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:31.416517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1d3e12f9854e06b00e7c6c68e63d47)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:31.418669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:31.442290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:31.448676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 974/1929] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:31 2022] POST /identity/v3/projects => generated 385 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:31.449785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490ae93-f275-4f3e-92ed-8ae20ce6f219 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:31.534816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490ae93-f275-4f3e-92ed-8ae20ce6f219 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:31.541279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e3b22-6c6e-4fed-a0b3-15e64b9d53e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:31.542051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e3b22-6c6e-4fed-a0b3-15e64b9d53e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:31.542384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e3b22-6c6e-4fed-a0b3-15e64b9d53e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:31.542848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e3b22-6c6e-4fed-a0b3-15e64b9d53e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:31.543439 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e3b22-6c6e-4fed-a0b3-15e64b9d53e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:31.545451 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e3b22-6c6e-4fed-a0b3-15e64b9d53e9 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:31.609943 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1d3e12f9854e06b00e7c6c68e63d47', 'request_id': 'req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:31.619603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1d3e12f9854e06b00e7c6c68e63d47', 'request_id': 'req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:31.626208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1d3e12f9854e06b00e7c6c68e63d47', 'request_id': 'req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:31.686854 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 975/1930] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:31 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:31.690688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e3b22-6c6e-4fed-a0b3-15e64b9d53e9 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:31.701604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e3b22-6c6e-4fed-a0b3-15e64b9d53e9 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:31.739726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] The token cache is being invalidate because project bb1d3e12f9854e06b00e7c6c68e63d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:31.744385 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:31.746258 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:31.749369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 956/1931] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:31 2022] DELETE /identity/v3/projects/bb1d3e12f9854e06b00e7c6c68e63d47 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:31.769262 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:31.771331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:31.780720 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c4378-eae8-4274-85d0-391ea5c0ef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:31.781619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4378-eae8-4274-85d0-391ea5c0ef98 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:31.782157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4378-eae8-4274-85d0-391ea5c0ef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:31.782851 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4378-eae8-4274-85d0-391ea5c0ef98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:31.783711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c4378-eae8-4274-85d0-391ea5c0ef98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:31.786097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c4378-eae8-4274-85d0-391ea5c0ef98 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:31.806483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 976/1932] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:31.807712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c4378-eae8-4274-85d0-391ea5c0ef98 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:31.810213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e90c4378-eae8-4274-85d0-391ea5c0ef98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:31.840561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c4378-eae8-4274-85d0-391ea5c0ef98 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:31.846245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e93b3-0c39-4201-ad18-906a7164da61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:31.846549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e93b3-0c39-4201-ad18-906a7164da61 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:31.846837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e93b3-0c39-4201-ad18-906a7164da61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:31.847114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e93b3-0c39-4201-ad18-906a7164da61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:31.847770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e93b3-0c39-4201-ad18-906a7164da61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:31.849573 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e93b3-0c39-4201-ad18-906a7164da61 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:31.868596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 977/1933] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:31.872774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e93b3-0c39-4201-ad18-906a7164da61 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:31.884682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e93b3-0c39-4201-ad18-906a7164da61 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:31.890242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7ecd6-d8a1-4aa0-94c1-4f437da2b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:31.890911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7ecd6-d8a1-4aa0-94c1-4f437da2b9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:31.891288 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7ecd6-d8a1-4aa0-94c1-4f437da2b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:31.891457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7ecd6-d8a1-4aa0-94c1-4f437da2b9d3 admin admin] PATH_INFO: `/v3/projects/8a6bf01405264613a776baa90fc726ab/users/6413c093f5f646ceaa02a77757b82708/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:31.909547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a1ea6-c920-4ece-9260-4d3af55a0c24 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:31.915593 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:31.916530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:31.916951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:31.917387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] PATH_INFO: `/v3/users/f0a7bffd052c4d1389b1ae5f604f83ba` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:31.918899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a7bffd052c4d1389b1ae5f604f83ba)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:31.921084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:31.936170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7ecd6-d8a1-4aa0-94c1-4f437da2b9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6bf01405264613a776baa90fc726ab, user_id=6413c093f5f646ceaa02a77757b82708, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:31.939320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7ecd6-d8a1-4aa0-94c1-4f437da2b9d3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:32.136146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 978/1934] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:31 2022] PUT /identity/v3/projects/8a6bf01405264613a776baa90fc726ab/users/6413c093f5f646ceaa02a77757b82708/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:32.148418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f35dd5-e49c-4626-bdcd-03dea6b7792c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:32.149190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f35dd5-e49c-4626-bdcd-03dea6b7792c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:32.149669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f35dd5-e49c-4626-bdcd-03dea6b7792c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:32.192514 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c5f35dd5-e49c-4626-bdcd-03dea6b7792c None None] MFA Rules not processed for user `6413c093f5f646ceaa02a77757b82708`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:32.195057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c5f35dd5-e49c-4626-bdcd-03dea6b7792c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:32.274615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a7bffd052c4d1389b1ae5f604f83ba'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:32.276437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 979/1935] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:32.286049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a7bffd052c4d1389b1ae5f604f83ba'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:32.288544 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a7bffd052c4d1389b1ae5f604f83ba'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:32.294002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f35dd5-e49c-4626-bdcd-03dea6b7792c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:32.445219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a7bffd052c4d1389b1ae5f604f83ba'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:32.469116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f35dd5-e49c-4626-bdcd-03dea6b7792c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:32.475071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a7bffd052c4d1389b1ae5f604f83ba'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:32.484784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 957/1936] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:31 2022] DELETE /identity/v3/users/f0a7bffd052c4d1389b1ae5f604f83ba => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:32.487365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:32.488497 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf965b99-0577-4c5c-91ad-1cad7307e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:32.489096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf965b99-0577-4c5c-91ad-1cad7307e901 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:32.489382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf965b99-0577-4c5c-91ad-1cad7307e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:32.489657 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf965b99-0577-4c5c-91ad-1cad7307e901 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:32.492987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf965b99-0577-4c5c-91ad-1cad7307e901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:32.494940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf965b99-0577-4c5c-91ad-1cad7307e901 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:32.503995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:32.662961 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 980/1937] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:32 2022] POST /identity/v3/projects => generated 385 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:32.664702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf965b99-0577-4c5c-91ad-1cad7307e901 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:32.668574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cf965b99-0577-4c5c-91ad-1cad7307e901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:32.695873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b329c20-a790-4063-9789-bfd474c04fe3 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:32.807267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf965b99-0577-4c5c-91ad-1cad7307e901 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:32.813382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311fc23-5fe4-4b4c-b285-1018f9182f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:32.814050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311fc23-5fe4-4b4c-b285-1018f9182f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:32.814334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311fc23-5fe4-4b4c-b285-1018f9182f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:32.814608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311fc23-5fe4-4b4c-b285-1018f9182f66 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:32.815311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311fc23-5fe4-4b4c-b285-1018f9182f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:32.817268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311fc23-5fe4-4b4c-b285-1018f9182f66 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:32.822896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:32.823736 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:32.824216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:32.824616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] PATH_INFO: `/v3/projects/0b1416e20c584dd2b11f25ee9e0b5fd3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:32.825865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1416e20c584dd2b11f25ee9e0b5fd3)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:32.828171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:32.958642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 981/1938] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:32 2022] POST /identity/v3/users => generated 299 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:32.962977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311fc23-5fe4-4b4c-b285-1018f9182f66 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:32.983075 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311fc23-5fe4-4b4c-b285-1018f9182f66 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:32.991326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f4285-583f-4fd1-88ae-4b457c111fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:32.994182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f4285-583f-4fd1-88ae-4b457c111fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:32.994492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f4285-583f-4fd1-88ae-4b457c111fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:32.994777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f4285-583f-4fd1-88ae-4b457c111fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:32.995466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f4285-583f-4fd1-88ae-4b457c111fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:32.997197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f4285-583f-4fd1-88ae-4b457c111fa4 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:33.015426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 982/1939] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:33.021587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f4285-583f-4fd1-88ae-4b457c111fa4 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:33.041550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1416e20c584dd2b11f25ee9e0b5fd3', 'request_id': 'req-d2922b7c-32ef-4552-82c4-4fa09d99137b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.056690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f4285-583f-4fd1-88ae-4b457c111fa4 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:33.064466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1416e20c584dd2b11f25ee9e0b5fd3', 'request_id': 'req-d2922b7c-32ef-4552-82c4-4fa09d99137b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.082181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1416e20c584dd2b11f25ee9e0b5fd3', 'request_id': 'req-d2922b7c-32ef-4552-82c4-4fa09d99137b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.150658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142be9a2-9066-4c14-a8df-7d86a1665d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:33.150658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142be9a2-9066-4c14-a8df-7d86a1665d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:33.151304 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142be9a2-9066-4c14-a8df-7d86a1665d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:33.151304 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142be9a2-9066-4c14-a8df-7d86a1665d49 admin admin] PATH_INFO: `/v3/projects/b134bc2a11fc49f6b17bdda5ba6ab309/users/37a047af782d43c8920376f105b8df9a/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:33.168744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142be9a2-9066-4c14-a8df-7d86a1665d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b134bc2a11fc49f6b17bdda5ba6ab309, user_id=37a047af782d43c8920376f105b8df9a, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:33.171784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142be9a2-9066-4c14-a8df-7d86a1665d49 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:33.202934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] The token cache is being invalidate because project 0b1416e20c584dd2b11f25ee9e0b5fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:33.202934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.202934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.204471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 958/1940] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:32 2022] DELETE /identity/v3/projects/0b1416e20c584dd2b11f25ee9e0b5fd3 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:33.209165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:33.210782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:33.223388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2922b7c-32ef-4552-82c4-4fa09d99137b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:33.228364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:33.234703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:33.234703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:33.234703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] PATH_INFO: `/v3/users/1ebb1dc523b84f5c8bf7d0f3bdb74061` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:33.234703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ebb1dc523b84f5c8bf7d0f3bdb74061)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:33.234703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:33.284768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 983/1941] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:33 2022] PUT /identity/v3/projects/b134bc2a11fc49f6b17bdda5ba6ab309/users/37a047af782d43c8920376f105b8df9a/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:33.286846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142be9a2-9066-4c14-a8df-7d86a1665d49 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:33.291242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-142be9a2-9066-4c14-a8df-7d86a1665d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:33.366454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142be9a2-9066-4c14-a8df-7d86a1665d49 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:33.371532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126685c-2c47-47b6-8bfc-9f89a550e094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:33.372285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126685c-2c47-47b6-8bfc-9f89a550e094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:33.372664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126685c-2c47-47b6-8bfc-9f89a550e094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:33.373001 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126685c-2c47-47b6-8bfc-9f89a550e094 admin admin] PATH_INFO: `/v3/projects/c7019c9673f54080853def8bfd632b79` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:33.374183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126685c-2c47-47b6-8bfc-9f89a550e094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7019c9673f54080853def8bfd632b79)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:33.376156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126685c-2c47-47b6-8bfc-9f89a550e094 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:33.469234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ebb1dc523b84f5c8bf7d0f3bdb74061'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.476771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ebb1dc523b84f5c8bf7d0f3bdb74061'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.477434 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ebb1dc523b84f5c8bf7d0f3bdb74061'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.523098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3126685c-2c47-47b6-8bfc-9f89a550e094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7019c9673f54080853def8bfd632b79', 'request_id': 'req-3126685c-2c47-47b6-8bfc-9f89a550e094'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.530162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3126685c-2c47-47b6-8bfc-9f89a550e094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7019c9673f54080853def8bfd632b79', 'request_id': 'req-3126685c-2c47-47b6-8bfc-9f89a550e094'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.569405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ebb1dc523b84f5c8bf7d0f3bdb74061'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.593641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ebb1dc523b84f5c8bf7d0f3bdb74061'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.601130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 959/1942] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:33 2022] DELETE /identity/v3/users/1ebb1dc523b84f5c8bf7d0f3bdb74061 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:33.601967 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:33.603461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:33.666850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3126685c-2c47-47b6-8bfc-9f89a550e094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7019c9673f54080853def8bfd632b79', 'request_id': 'req-3126685c-2c47-47b6-8bfc-9f89a550e094'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.682433 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b6b7b-7f7e-45f4-b86e-59c59cad454a admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:33.687927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3126685c-2c47-47b6-8bfc-9f89a550e094 admin admin] The token cache is being invalidate because project c7019c9673f54080853def8bfd632b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:33.688475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3126685c-2c47-47b6-8bfc-9f89a550e094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.688703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca06be-9caa-44b4-8e8a-8bf5772dc8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:33.689457 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca06be-9caa-44b4-8e8a-8bf5772dc8de admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:33.689836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca06be-9caa-44b4-8e8a-8bf5772dc8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:33.690207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca06be-9caa-44b4-8e8a-8bf5772dc8de admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:33.691036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3126685c-2c47-47b6-8bfc-9f89a550e094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:33.691259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca06be-9caa-44b4-8e8a-8bf5772dc8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:33.693874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca06be-9caa-44b4-8e8a-8bf5772dc8de admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:33.698838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 984/1943] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:33 2022] DELETE /identity/v3/projects/c7019c9673f54080853def8bfd632b79 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:33.703745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed92ba5-71a7-451c-8d02-5e57e8b93d90 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:33.704182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed92ba5-71a7-451c-8d02-5e57e8b93d90 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:33.704599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed92ba5-71a7-451c-8d02-5e57e8b93d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:33.715907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 960/1944] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:33.723204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca06be-9caa-44b4-8e8a-8bf5772dc8de admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:33.727466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4cca06be-9caa-44b4-8e8a-8bf5772dc8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:33.746615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca06be-9caa-44b4-8e8a-8bf5772dc8de admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:33.752350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b39e5-7941-4914-92df-29b5f099d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:33.753187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b39e5-7941-4914-92df-29b5f099d930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:33.753598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b39e5-7941-4914-92df-29b5f099d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:33.753977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b39e5-7941-4914-92df-29b5f099d930 admin admin] PATH_INFO: `/v3/projects/b134bc2a11fc49f6b17bdda5ba6ab309/users/37a047af782d43c8920376f105b8df9a/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:33.756161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b39e5-7941-4914-92df-29b5f099d930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b134bc2a11fc49f6b17bdda5ba6ab309, user_id=37a047af782d43c8920376f105b8df9a, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:33.757274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6ed92ba5-71a7-451c-8d02-5e57e8b93d90 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:33.758787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6ed92ba5-71a7-451c-8d02-5e57e8b93d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:33.759446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b39e5-7941-4914-92df-29b5f099d930 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:33.770487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 985/1945] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:33.783860 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 961/1946] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:33 2022] PUT /identity/v3/projects/b134bc2a11fc49f6b17bdda5ba6ab309/users/37a047af782d43c8920376f105b8df9a/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:33.785767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd5015-39f6-4fa9-8fc8-558d7cb31c33 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:33.786203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd5015-39f6-4fa9-8fc8-558d7cb31c33 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:33.786579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd5015-39f6-4fa9-8fc8-558d7cb31c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:33.792487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:33.796414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7498-6273-4e13-9d80-27d8fa79e819 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:33.797839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7498-6273-4e13-9d80-27d8fa79e819 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:33.802956 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7498-6273-4e13-9d80-27d8fa79e819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:33.818798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-52fd5015-39f6-4fa9-8fc8-558d7cb31c33 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:33.820353 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-52fd5015-39f6-4fa9-8fc8-558d7cb31c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:33.832111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-75be7498-6273-4e13-9d80-27d8fa79e819 None None] MFA Rules not processed for user `37a047af782d43c8920376f105b8df9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:33.833547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-75be7498-6273-4e13-9d80-27d8fa79e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:33.925937 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 962/1947] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:33.934435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd5015-39f6-4fa9-8fc8-558d7cb31c33 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:33.943155 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 986/1948] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:33.945283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd5015-39f6-4fa9-8fc8-558d7cb31c33 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:33.950268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14761e04-b232-4991-ba8e-edda0974b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:33.951460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14761e04-b232-4991-ba8e-edda0974b2ee admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:33.951460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14761e04-b232-4991-ba8e-edda0974b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:33.952034 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14761e04-b232-4991-ba8e-edda0974b2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:33.953128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14761e04-b232-4991-ba8e-edda0974b2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:35:33.953128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14761e04-b232-4991-ba8e-edda0974b2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:33.955556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14761e04-b232-4991-ba8e-edda0974b2ee admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:33.957119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be7498-6273-4e13-9d80-27d8fa79e819 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:33.958684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-75be7498-6273-4e13-9d80-27d8fa79e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:33.974630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 963/1949] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:35:33.977261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14761e04-b232-4991-ba8e-edda0974b2ee admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:33.992085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14761e04-b232-4991-ba8e-edda0974b2ee admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:34.003693 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e6c8a-00fa-4e84-8c3e-81b6fa9a8061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:34.004609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e6c8a-00fa-4e84-8c3e-81b6fa9a8061 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:34.004789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e6c8a-00fa-4e84-8c3e-81b6fa9a8061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:34.005062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e6c8a-00fa-4e84-8c3e-81b6fa9a8061 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:34.005701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e6c8a-00fa-4e84-8c3e-81b6fa9a8061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:34.008729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e6c8a-00fa-4e84-8c3e-81b6fa9a8061 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:34.044417 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be7498-6273-4e13-9d80-27d8fa79e819 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:34.050202 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966ed5c-b8f3-43be-9bb6-9c8a56209971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:34.051322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966ed5c-b8f3-43be-9bb6-9c8a56209971 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:34.051499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966ed5c-b8f3-43be-9bb6-9c8a56209971 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:34.051774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966ed5c-b8f3-43be-9bb6-9c8a56209971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:34.063481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966ed5c-b8f3-43be-9bb6-9c8a56209971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:34.065151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966ed5c-b8f3-43be-9bb6-9c8a56209971 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:34.076503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 987/1950] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:34.263414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966ed5c-b8f3-43be-9bb6-9c8a56209971 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:34.264789 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1966ed5c-b8f3-43be-9bb6-9c8a56209971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:34.267233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 964/1951] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:33 2022] POST /identity/v3/projects => generated 371 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:34.274688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e6c8a-00fa-4e84-8c3e-81b6fa9a8061 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:34.279189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966ed5c-b8f3-43be-9bb6-9c8a56209971 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:34.338425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:34.339063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:34.339341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:34.339650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298 admin admin] PATH_INFO: `/v3/projects/09096ff4c39b4751b850f296f06c9a23` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:34.340962 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09096ff4c39b4751b850f296f06c9a23)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:34.344727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:34.368288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e6c8a-00fa-4e84-8c3e-81b6fa9a8061 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:34.373111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10353d40-c7cd-475b-b2be-3edc47d6f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:34.373775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10353d40-c7cd-475b-b2be-3edc47d6f2eb admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:34.374054 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10353d40-c7cd-475b-b2be-3edc47d6f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:34.374324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10353d40-c7cd-475b-b2be-3edc47d6f2eb admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:34.374950 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10353d40-c7cd-475b-b2be-3edc47d6f2eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:34.376917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10353d40-c7cd-475b-b2be-3edc47d6f2eb admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:34.519316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 965/1952] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:34 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:34.523564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10353d40-c7cd-475b-b2be-3edc47d6f2eb admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:34.533386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09096ff4c39b4751b850f296f06c9a23', 'request_id': 'req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:34.534690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10353d40-c7cd-475b-b2be-3edc47d6f2eb admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:34.539523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09096ff4c39b4751b850f296f06c9a23', 'request_id': 'req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:34.592196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c663fa-71ac-4c03-a961-6e03aa50ba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:34.592807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c663fa-71ac-4c03-a961-6e03aa50ba25 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:34.593083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c663fa-71ac-4c03-a961-6e03aa50ba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:34.593373 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c663fa-71ac-4c03-a961-6e03aa50ba25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:34.594115 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c663fa-71ac-4c03-a961-6e03aa50ba25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:34.595758 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c663fa-71ac-4c03-a961-6e03aa50ba25 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:34.605826 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 966/1953] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:34.610049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c663fa-71ac-4c03-a961-6e03aa50ba25 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:34.614802 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09096ff4c39b4751b850f296f06c9a23', 'request_id': 'req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:34.620161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c663fa-71ac-4c03-a961-6e03aa50ba25 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:34.624853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4916be0-8a8e-4ec0-b299-fff615a59a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:34.625434 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4916be0-8a8e-4ec0-b299-fff615a59a7c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:34.625711 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4916be0-8a8e-4ec0-b299-fff615a59a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:34.625976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4916be0-8a8e-4ec0-b299-fff615a59a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:34.626600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4916be0-8a8e-4ec0-b299-fff615a59a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:34.627734 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298 admin admin] The token cache is being invalidate because project 09096ff4c39b4751b850f296f06c9a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:34.628163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:34.628259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4916be0-8a8e-4ec0-b299-fff615a59a7c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:34.628951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3cc6cb94-31b0-427a-a1bc-9ecd693b8298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:34.630564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 988/1954] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:34 2022] DELETE /identity/v3/projects/09096ff4c39b4751b850f296f06c9a23 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:34.636058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4092e79-9b22-4e27-9c8e-10090ca8b71e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:34.636452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4092e79-9b22-4e27-9c8e-10090ca8b71e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:34.636732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4092e79-9b22-4e27-9c8e-10090ca8b71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:34.642150 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 967/1955] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:34.643152 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4916be0-8a8e-4ec0-b299-fff615a59a7c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:34.644835 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c4916be0-8a8e-4ec0-b299-fff615a59a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:34.656614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c4092e79-9b22-4e27-9c8e-10090ca8b71e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:34.657824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c4092e79-9b22-4e27-9c8e-10090ca8b71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:34.657923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4916be0-8a8e-4ec0-b299-fff615a59a7c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:34.662456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df5c08-5b26-46c0-855d-5dcb4c51ddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:34.663107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df5c08-5b26-46c0-855d-5dcb4c51ddd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:34.663390 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df5c08-5b26-46c0-855d-5dcb4c51ddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:34.663658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df5c08-5b26-46c0-855d-5dcb4c51ddd6 admin admin] PATH_INFO: `/v3/projects/564438150a6d4898b54086a973d6272b/users/6a9ca92424c5472c92164a91e1899664/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:34.666027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 989/1956] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:34.673707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c356f-4c40-4975-8b05-f190009800c4 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:34.673988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c356f-4c40-4975-8b05-f190009800c4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:34.674262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c356f-4c40-4975-8b05-f190009800c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:34.678719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df5c08-5b26-46c0-855d-5dcb4c51ddd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=564438150a6d4898b54086a973d6272b, user_id=6a9ca92424c5472c92164a91e1899664, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:34.681373 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df5c08-5b26-46c0-855d-5dcb4c51ddd6 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:34.694733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-252c356f-4c40-4975-8b05-f190009800c4 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:34.695921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-252c356f-4c40-4975-8b05-f190009800c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:34.703791 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 990/1957] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:34.707908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c356f-4c40-4975-8b05-f190009800c4 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:34.727027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c356f-4c40-4975-8b05-f190009800c4 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:34.727027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4f819-8550-4be1-b6d2-51965a053ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:34.727027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4f819-8550-4be1-b6d2-51965a053ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:34.727027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4f819-8550-4be1-b6d2-51965a053ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:34.727436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4f819-8550-4be1-b6d2-51965a053ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:34.727436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4f819-8550-4be1-b6d2-51965a053ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:35:34.727436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4f819-8550-4be1-b6d2-51965a053ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:34.727436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4f819-8550-4be1-b6d2-51965a053ad8 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:34.737982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 991/1958] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:35:34.742747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4f819-8550-4be1-b6d2-51965a053ad8 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:34.752136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4f819-8550-4be1-b6d2-51965a053ad8 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:34.757326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468dc30-e319-46bf-a039-df951af363d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:34.758507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468dc30-e319-46bf-a039-df951af363d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:34.759182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468dc30-e319-46bf-a039-df951af363d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:34.759182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468dc30-e319-46bf-a039-df951af363d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:34.759647 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468dc30-e319-46bf-a039-df951af363d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:34.761533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468dc30-e319-46bf-a039-df951af363d0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:34.804818 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 968/1959] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:34 2022] PUT /identity/v3/projects/564438150a6d4898b54086a973d6272b/users/6a9ca92424c5472c92164a91e1899664/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:34.815811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec901fe-6520-4743-a113-48dfd018d5a9 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:34.816227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec901fe-6520-4743-a113-48dfd018d5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:34.816620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec901fe-6520-4743-a113-48dfd018d5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:34.853109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-fec901fe-6520-4743-a113-48dfd018d5a9 None None] MFA Rules not processed for user `6a9ca92424c5472c92164a91e1899664`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:34.853372 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fec901fe-6520-4743-a113-48dfd018d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:34.923467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 969/1960] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:34.928639 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 992/1961] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:34 2022] POST /identity/v3/projects => generated 353 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:34.931082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec901fe-6520-4743-a113-48dfd018d5a9 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:34.936611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468dc30-e319-46bf-a039-df951af363d0 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:34.938416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c468dc30-e319-46bf-a039-df951af363d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:35.015675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468dc30-e319-46bf-a039-df951af363d0 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:35.021100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16624b4d-c252-4c81-a018-58b641011368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:35.021707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16624b4d-c252-4c81-a018-58b641011368 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:35.022034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16624b4d-c252-4c81-a018-58b641011368 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:35.022304 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16624b4d-c252-4c81-a018-58b641011368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:35.065178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec901fe-6520-4743-a113-48dfd018d5a9 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:35.088417 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16624b4d-c252-4c81-a018-58b641011368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:35.090256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16624b4d-c252-4c81-a018-58b641011368 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:35.104470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 993/1962] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:35:35.141019 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16624b4d-c252-4c81-a018-58b641011368 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:35.151638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bc13d-b219-4916-a904-e3ec1b7597fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:35.152537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bc13d-b219-4916-a904-e3ec1b7597fd admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:35.152992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bc13d-b219-4916-a904-e3ec1b7597fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:35.153420 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bc13d-b219-4916-a904-e3ec1b7597fd admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:35.154209 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bc13d-b219-4916-a904-e3ec1b7597fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:35.156866 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bc13d-b219-4916-a904-e3ec1b7597fd admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:35.245423 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16624b4d-c252-4c81-a018-58b641011368 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:35.252620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848bc7f-a378-4591-93f1-7de209324caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:35.255172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848bc7f-a378-4591-93f1-7de209324caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:35.255455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848bc7f-a378-4591-93f1-7de209324caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:35.255732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848bc7f-a378-4591-93f1-7de209324caa admin admin] PATH_INFO: `/v3/users/6a9ca92424c5472c92164a91e1899664` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:35.257137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848bc7f-a378-4591-93f1-7de209324caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9ca92424c5472c92164a91e1899664)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:35.259100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848bc7f-a378-4591-93f1-7de209324caa admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:35.290193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 970/1963] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:34 2022] POST /identity/v3/users => generated 277 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:35.297468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bc13d-b219-4916-a904-e3ec1b7597fd admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:35.308840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bc13d-b219-4916-a904-e3ec1b7597fd admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:35.314296 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb38d6-a55a-4e2d-bd51-0988219fe8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:35.315399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb38d6-a55a-4e2d-bd51-0988219fe8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:35.315675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb38d6-a55a-4e2d-bd51-0988219fe8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:35.316041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb38d6-a55a-4e2d-bd51-0988219fe8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:35.316675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb38d6-a55a-4e2d-bd51-0988219fe8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:35.319088 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb38d6-a55a-4e2d-bd51-0988219fe8bb admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:35.335419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 971/1964] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:35.339092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb38d6-a55a-4e2d-bd51-0988219fe8bb admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:35.349511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb38d6-a55a-4e2d-bd51-0988219fe8bb admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:35.355432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf5fd-abb3-4889-81ef-f782b890b253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:35.356240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf5fd-abb3-4889-81ef-f782b890b253 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:35.356581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf5fd-abb3-4889-81ef-f782b890b253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:35.357181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf5fd-abb3-4889-81ef-f782b890b253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:35.357886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbf5fd-abb3-4889-81ef-f782b890b253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:35.359530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbf5fd-abb3-4889-81ef-f782b890b253 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:35.371019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 972/1965] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:35.375501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf5fd-abb3-4889-81ef-f782b890b253 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:35.392137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf5fd-abb3-4889-81ef-f782b890b253 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:35.399063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471235ce-14cc-44a6-83f3-6d4f06ac6cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:35.400025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471235ce-14cc-44a6-83f3-6d4f06ac6cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:35.400460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471235ce-14cc-44a6-83f3-6d4f06ac6cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:35.400906 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471235ce-14cc-44a6-83f3-6d4f06ac6cdb admin admin] PATH_INFO: `/v3/projects/68fa71f8c1184afa9432e5cd126a3325/users/de77603351994570b7041e2ce88110a0/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:35.421855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471235ce-14cc-44a6-83f3-6d4f06ac6cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fa71f8c1184afa9432e5cd126a3325, user_id=de77603351994570b7041e2ce88110a0, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:35.424576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471235ce-14cc-44a6-83f3-6d4f06ac6cdb admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:35.430901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:35.489778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a848bc7f-a378-4591-93f1-7de209324caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9ca92424c5472c92164a91e1899664'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:35.501448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a848bc7f-a378-4591-93f1-7de209324caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9ca92424c5472c92164a91e1899664'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:35.502268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a848bc7f-a378-4591-93f1-7de209324caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9ca92424c5472c92164a91e1899664'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:35.502905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a848bc7f-a378-4591-93f1-7de209324caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9ca92424c5472c92164a91e1899664'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:35.512953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 973/1966] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:35 2022] PUT /identity/v3/projects/68fa71f8c1184afa9432e5cd126a3325/users/de77603351994570b7041e2ce88110a0/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:35.524782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec732c-c097-4192-85e0-daa0c4650c1a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:35.525389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec732c-c097-4192-85e0-daa0c4650c1a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:35.525389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec732c-c097-4192-85e0-daa0c4650c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:35.574474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-65ec732c-c097-4192-85e0-daa0c4650c1a None None] MFA Rules not processed for user `de77603351994570b7041e2ce88110a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:35.575844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-65ec732c-c097-4192-85e0-daa0c4650c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:35.626577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a848bc7f-a378-4591-93f1-7de209324caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9ca92424c5472c92164a91e1899664'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:35.659636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 994/1967] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:35 2022] DELETE /identity/v3/users/6a9ca92424c5472c92164a91e1899664 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:35.664871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8c86-c13e-49d4-b635-70cc6ed3db68 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:35.665281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8c86-c13e-49d4-b635-70cc6ed3db68 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:35.665457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8c86-c13e-49d4-b635-70cc6ed3db68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:35.710562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 974/1968] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:35.718876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec732c-c097-4192-85e0-daa0c4650c1a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:35.721019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-65ec732c-c097-4192-85e0-daa0c4650c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:35.726528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e93e8c86-c13e-49d4-b635-70cc6ed3db68 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:35.727762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e93e8c86-c13e-49d4-b635-70cc6ed3db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:35.800874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec732c-c097-4192-85e0-daa0c4650c1a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:35.827316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 995/1969] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:35.829077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8c86-c13e-49d4-b635-70cc6ed3db68 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:35.831358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e93e8c86-c13e-49d4-b635-70cc6ed3db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:35.881623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee028bc-3bb6-437b-a80a-2025b82a35e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:35.882252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee028bc-3bb6-437b-a80a-2025b82a35e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:35.882591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee028bc-3bb6-437b-a80a-2025b82a35e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:35.882995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee028bc-3bb6-437b-a80a-2025b82a35e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:35.883647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee028bc-3bb6-437b-a80a-2025b82a35e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:35.885767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee028bc-3bb6-437b-a80a-2025b82a35e6 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:35.915691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8c86-c13e-49d4-b635-70cc6ed3db68 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:35.920339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecf066-0868-4dd3-adb8-cd8aafb91156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:35.921577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecf066-0868-4dd3-adb8-cd8aafb91156 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:35.922006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecf066-0868-4dd3-adb8-cd8aafb91156 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:35.922308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecf066-0868-4dd3-adb8-cd8aafb91156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:35.924220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f5ecf066-0868-4dd3-adb8-cd8aafb91156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:35.994604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecf066-0868-4dd3-adb8-cd8aafb91156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:35.996196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecf066-0868-4dd3-adb8-cd8aafb91156 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:36.008614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 996/1970] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:36.009312 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecf066-0868-4dd3-adb8-cd8aafb91156 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:36.010798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f5ecf066-0868-4dd3-adb8-cd8aafb91156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:36.020581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 975/1971] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:35 2022] POST /identity/v3/projects => generated 357 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:36.025849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee028bc-3bb6-437b-a80a-2025b82a35e6 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:36.082089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecf066-0868-4dd3-adb8-cd8aafb91156 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:36.109901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee028bc-3bb6-437b-a80a-2025b82a35e6 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:36.116549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071184f2-9a87-425a-a417-e12226ce2e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:36.117305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071184f2-9a87-425a-a417-e12226ce2e6e admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:36.117802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071184f2-9a87-425a-a417-e12226ce2e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:36.118191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071184f2-9a87-425a-a417-e12226ce2e6e admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:36.119432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071184f2-9a87-425a-a417-e12226ce2e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:36.121432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071184f2-9a87-425a-a417-e12226ce2e6e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:36.142625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c033d-5651-4e58-acfe-dac4cd8838ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:36.143244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c033d-5651-4e58-acfe-dac4cd8838ed service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:36.156139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c033d-5651-4e58-acfe-dac4cd8838ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:36.156973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c033d-5651-4e58-acfe-dac4cd8838ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:36.171297 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c033d-5651-4e58-acfe-dac4cd8838ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:36.172752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c033d-5651-4e58-acfe-dac4cd8838ed service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:36.183642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 997/1972] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:36.389939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 976/1973] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:36 2022] POST /identity/v3/users => generated 285 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:36.393816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c033d-5651-4e58-acfe-dac4cd8838ed service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:36.405933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c033d-5651-4e58-acfe-dac4cd8838ed service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:36.410751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0ffde-3b33-4ce5-9bef-b850a556c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:36.411457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0ffde-3b33-4ce5-9bef-b850a556c9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:36.411698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0ffde-3b33-4ce5-9bef-b850a556c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:36.412024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0ffde-3b33-4ce5-9bef-b850a556c9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:36.413196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0ffde-3b33-4ce5-9bef-b850a556c9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:36.415716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0ffde-3b33-4ce5-9bef-b850a556c9c2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:36.429846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 998/1974] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:36.433856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071184f2-9a87-425a-a417-e12226ce2e6e admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:36.448288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071184f2-9a87-425a-a417-e12226ce2e6e admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:36.454475 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f623b63-1c37-4da6-9df6-a3aeac1c1950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:36.455285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f623b63-1c37-4da6-9df6-a3aeac1c1950 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:36.455646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f623b63-1c37-4da6-9df6-a3aeac1c1950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:36.456026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f623b63-1c37-4da6-9df6-a3aeac1c1950 admin admin] PATH_INFO: `/v3/projects/91725248f6e9484897e81c1c72f6aea2/users/b47c75126b4d4686925bb1bd03c592bb/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:36.481803 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f623b63-1c37-4da6-9df6-a3aeac1c1950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91725248f6e9484897e81c1c72f6aea2, user_id=b47c75126b4d4686925bb1bd03c592bb, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:36.486430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f623b63-1c37-4da6-9df6-a3aeac1c1950 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:36.571650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:36.622122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 977/1975] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:36 2022] PUT /identity/v3/projects/91725248f6e9484897e81c1c72f6aea2/users/b47c75126b4d4686925bb1bd03c592bb/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:36.626112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0ffde-3b33-4ce5-9bef-b850a556c9c2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:36.636926 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0ffde-3b33-4ce5-9bef-b850a556c9c2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:36.720314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c18c2d-c76b-4203-9719-2317354d1444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:36.721418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18c2d-c76b-4203-9719-2317354d1444 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:36.721905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18c2d-c76b-4203-9719-2317354d1444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:36.722418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18c2d-c76b-4203-9719-2317354d1444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:36.723288 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c18c2d-c76b-4203-9719-2317354d1444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:36.725226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c18c2d-c76b-4203-9719-2317354d1444 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:36.744213 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 999/1976] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:36.744562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f623b63-1c37-4da6-9df6-a3aeac1c1950 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:36.768311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f623b63-1c37-4da6-9df6-a3aeac1c1950 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:36.783897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c03ef-94a9-4cd6-8121-861493b2e51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:36.785122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c03ef-94a9-4cd6-8121-861493b2e51f admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:36.785680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c03ef-94a9-4cd6-8121-861493b2e51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:36.786193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c03ef-94a9-4cd6-8121-861493b2e51f admin admin] PATH_INFO: `/v3/projects/91725248f6e9484897e81c1c72f6aea2/users/b47c75126b4d4686925bb1bd03c592bb/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:36.789241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c03ef-94a9-4cd6-8121-861493b2e51f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91725248f6e9484897e81c1c72f6aea2, user_id=b47c75126b4d4686925bb1bd03c592bb, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:36.793704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c03ef-94a9-4cd6-8121-861493b2e51f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:36.817641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 978/1977] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:36 2022] PUT /identity/v3/projects/91725248f6e9484897e81c1c72f6aea2/users/b47c75126b4d4686925bb1bd03c592bb/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:36.828820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b41643-dcee-419a-83cb-1ef21a61785e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:36.829198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b41643-dcee-419a-83cb-1ef21a61785e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:36.829541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b41643-dcee-419a-83cb-1ef21a61785e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:36.862281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-33b41643-dcee-419a-83cb-1ef21a61785e None None] MFA Rules not processed for user `b47c75126b4d4686925bb1bd03c592bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:36.862767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-33b41643-dcee-419a-83cb-1ef21a61785e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:36.944691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c03ef-94a9-4cd6-8121-861493b2e51f admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:36.949806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8f5c03ef-94a9-4cd6-8121-861493b2e51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:37.005886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1000/1978] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:37.019195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b41643-dcee-419a-83cb-1ef21a61785e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:37.030019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c03ef-94a9-4cd6-8121-861493b2e51f admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:37.034867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:37.035631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:37.036019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:37.036367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] PATH_INFO: `/v3/projects/564438150a6d4898b54086a973d6272b` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:37.038137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=564438150a6d4898b54086a973d6272b)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:37.040076 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:37.077281 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b41643-dcee-419a-83cb-1ef21a61785e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:37.081149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a8bd9-22b1-43b9-8334-8fbd24ff167a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:37.081547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a8bd9-22b1-43b9-8334-8fbd24ff167a service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:37.081824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a8bd9-22b1-43b9-8334-8fbd24ff167a service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:37.082100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a8bd9-22b1-43b9-8334-8fbd24ff167a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:37.091478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a8bd9-22b1-43b9-8334-8fbd24ff167a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:37.092918 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a8bd9-22b1-43b9-8334-8fbd24ff167a service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:37.103390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1001/1979] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:35:37.169452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '564438150a6d4898b54086a973d6272b', 'request_id': 'req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:37.174896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '564438150a6d4898b54086a973d6272b', 'request_id': 'req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:37.181681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '564438150a6d4898b54086a973d6272b', 'request_id': 'req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:37.294780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] The token cache is being invalidate because project 564438150a6d4898b54086a973d6272b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:37.295074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:37.295707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:37.297248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 979/1980] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:36 2022] DELETE /identity/v3/projects/564438150a6d4898b54086a973d6272b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:37.302301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189cd8a-6bf5-46f8-ae48-a1e5dfe8656c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:37.302585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189cd8a-6bf5-46f8-ae48-a1e5dfe8656c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:37.302857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189cd8a-6bf5-46f8-ae48-a1e5dfe8656c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:37.319313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:37.328463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4189cd8a-6bf5-46f8-ae48-a1e5dfe8656c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:37.328463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4189cd8a-6bf5-46f8-ae48-a1e5dfe8656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:37.345283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:37.346698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:37.393057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1002/1981] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:37.400903 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556387b3-31b0-4356-8e5b-57d9f48000eb None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:37.401246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556387b3-31b0-4356-8e5b-57d9f48000eb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:37.401528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556387b3-31b0-4356-8e5b-57d9f48000eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:37.408231 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735149e4-6b89-4ec9-9c2f-6ad9fd0d4434 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:37.414623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f17da-9632-4d73-a507-13510a35d9b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:37.415389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f17da-9632-4d73-a507-13510a35d9b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:37.415576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f17da-9632-4d73-a507-13510a35d9b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:37.415774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f17da-9632-4d73-a507-13510a35d9b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:37.417583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d77f17da-9632-4d73-a507-13510a35d9b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:37.423412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-556387b3-31b0-4356-8e5b-57d9f48000eb None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:37.427461 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-556387b3-31b0-4356-8e5b-57d9f48000eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:37.433594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1003/1982] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:37.442027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556387b3-31b0-4356-8e5b-57d9f48000eb None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:37.451053 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556387b3-31b0-4356-8e5b-57d9f48000eb None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:37.456451 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6d090-dbb8-43ed-95bb-34262b956a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:37.457050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6d090-dbb8-43ed-95bb-34262b956a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:37.457332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6d090-dbb8-43ed-95bb-34262b956a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:37.457638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6d090-dbb8-43ed-95bb-34262b956a4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:37.458255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6d090-dbb8-43ed-95bb-34262b956a4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:35:37.458560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6d090-dbb8-43ed-95bb-34262b956a4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:37.460812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6d090-dbb8-43ed-95bb-34262b956a4f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:37.472471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1004/1983] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:35:37.477553 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6d090-dbb8-43ed-95bb-34262b956a4f admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:37.487668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6d090-dbb8-43ed-95bb-34262b956a4f admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:37.489446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f17da-9632-4d73-a507-13510a35d9b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:37.491684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f17da-9632-4d73-a507-13510a35d9b1 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:37.493112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369d870-4152-4756-b0bd-810f916bec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:37.493752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369d870-4152-4756-b0bd-810f916bec52 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:37.494026 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369d870-4152-4756-b0bd-810f916bec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:37.494297 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369d870-4152-4756-b0bd-810f916bec52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:37.494953 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369d870-4152-4756-b0bd-810f916bec52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:37.496862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369d870-4152-4756-b0bd-810f916bec52 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:37.501472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 980/1984] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:35:37.604377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1005/1985] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:37 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:37.608891 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f17da-9632-4d73-a507-13510a35d9b1 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:37.619301 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f17da-9632-4d73-a507-13510a35d9b1 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:37.673236 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f6304-99a9-4887-876f-58480befd4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:37.673833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f6304-99a9-4887-876f-58480befd4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:37.674103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f6304-99a9-4887-876f-58480befd4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:37.674367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f6304-99a9-4887-876f-58480befd4c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:37.674998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f6304-99a9-4887-876f-58480befd4c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:37.676910 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f6304-99a9-4887-876f-58480befd4c7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:37.786575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 981/1986] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:37 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:37.791444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369d870-4152-4756-b0bd-810f916bec52 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:37.801745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369d870-4152-4756-b0bd-810f916bec52 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:37.806446 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff66b9-f62b-443b-b36d-e623900d7a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:37.807041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff66b9-f62b-443b-b36d-e623900d7a1d admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:37.807323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff66b9-f62b-443b-b36d-e623900d7a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:37.807596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff66b9-f62b-443b-b36d-e623900d7a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:37.808307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff66b9-f62b-443b-b36d-e623900d7a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:37.809916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff66b9-f62b-443b-b36d-e623900d7a1d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:37.820981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1006/1987] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:37.830096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f6304-99a9-4887-876f-58480befd4c7 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:37.841700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f6304-99a9-4887-876f-58480befd4c7 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:37.847686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a02a5-ffbe-425c-9bf1-30aae524dbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:37.848351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a02a5-ffbe-425c-9bf1-30aae524dbcb admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:37.848627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a02a5-ffbe-425c-9bf1-30aae524dbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:37.848897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a02a5-ffbe-425c-9bf1-30aae524dbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:37.849613 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a02a5-ffbe-425c-9bf1-30aae524dbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:37.851210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a02a5-ffbe-425c-9bf1-30aae524dbcb admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:37.864113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 982/1988] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:37.868184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff66b9-f62b-443b-b36d-e623900d7a1d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:37.882613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff66b9-f62b-443b-b36d-e623900d7a1d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:37.887437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6963e7c-37b5-4283-a8d4-931ba1e51b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:37.888122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6963e7c-37b5-4283-a8d4-931ba1e51b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:37.888402 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6963e7c-37b5-4283-a8d4-931ba1e51b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:37.888678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6963e7c-37b5-4283-a8d4-931ba1e51b92 admin admin] PATH_INFO: `/v3/projects/7ea438a20fae4acf807f604618c2c45c/users/9277204080fb4bc8801181a4903971c4/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:37.905901 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6963e7c-37b5-4283-a8d4-931ba1e51b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea438a20fae4acf807f604618c2c45c, user_id=9277204080fb4bc8801181a4903971c4, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:37.912370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6963e7c-37b5-4283-a8d4-931ba1e51b92 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:38.040910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1007/1989] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:37 2022] PUT /identity/v3/projects/7ea438a20fae4acf807f604618c2c45c/users/9277204080fb4bc8801181a4903971c4/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:38.051191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa8841-01b7-42ac-904c-63fb9b1a4217 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:38.052023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa8841-01b7-42ac-904c-63fb9b1a4217 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:38.052332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa8841-01b7-42ac-904c-63fb9b1a4217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:38.096560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-75fa8841-01b7-42ac-904c-63fb9b1a4217 None None] MFA Rules not processed for user `9277204080fb4bc8801181a4903971c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:38.098050 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-75fa8841-01b7-42ac-904c-63fb9b1a4217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:38.181492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 983/1990] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:38.193764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6963e7c-37b5-4283-a8d4-931ba1e51b92 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:38.195097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c6963e7c-37b5-4283-a8d4-931ba1e51b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:38.275178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6963e7c-37b5-4283-a8d4-931ba1e51b92 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:38.278952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992a742-c0dd-468a-b53f-d0afb39402f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6462736c485545d8a26766360ebe0c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:38.279555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992a742-c0dd-468a-b53f-d0afb39402f4 service glance] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:38.279835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992a742-c0dd-468a-b53f-d0afb39402f4 service glance] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:38.280145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992a742-c0dd-468a-b53f-d0afb39402f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:38.289024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992a742-c0dd-468a-b53f-d0afb39402f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:38.290481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992a742-c0dd-468a-b53f-d0afb39402f4 service glance] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:38.299652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1008/1991] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:38.996790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:39.914579 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:41.792008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa8841-01b7-42ac-904c-63fb9b1a4217 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:41.794547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-75fa8841-01b7-42ac-904c-63fb9b1a4217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:41.853284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa8841-01b7-42ac-904c-63fb9b1a4217 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:41.856982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63988e-2be8-44bd-818a-c819bc514d88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:41.860023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63988e-2be8-44bd-818a-c819bc514d88 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:41.860023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63988e-2be8-44bd-818a-c819bc514d88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:41.860023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63988e-2be8-44bd-818a-c819bc514d88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:41.860310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3a63988e-2be8-44bd-818a-c819bc514d88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:41.925579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63988e-2be8-44bd-818a-c819bc514d88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:41.927101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63988e-2be8-44bd-818a-c819bc514d88 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:41.938355 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 984/1992] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:42.049989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:42.558620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:44.759512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:45.089645 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:46.962844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:47.110104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992a742-c0dd-468a-b53f-d0afb39402f4 service glance] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:47.111606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6992a742-c0dd-468a-b53f-d0afb39402f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:47.184477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992a742-c0dd-468a-b53f-d0afb39402f4 service glance] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:47.189091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f810ff7-f259-4278-a06a-3ef536a73c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:47.189711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f810ff7-f259-4278-a06a-3ef536a73c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:47.189986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f810ff7-f259-4278-a06a-3ef536a73c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:47.190254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f810ff7-f259-4278-a06a-3ef536a73c3c admin admin] PATH_INFO: `/v3/users/6393263346894b06adbf7585d99a0d8d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:47.191361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f810ff7-f259-4278-a06a-3ef536a73c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6393263346894b06adbf7585d99a0d8d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:47.193808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f810ff7-f259-4278-a06a-3ef536a73c3c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:47.465843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6f810ff7-f259-4278-a06a-3ef536a73c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6393263346894b06adbf7585d99a0d8d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:47.470169 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ef4d4-d080-4e49-8be6-0c810bd254b1 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:47.470660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ef4d4-d080-4e49-8be6-0c810bd254b1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:47.471030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ef4d4-d080-4e49-8be6-0c810bd254b1 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:47.473350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6f810ff7-f259-4278-a06a-3ef536a73c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6393263346894b06adbf7585d99a0d8d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:47.473656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 985/1993] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:35:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:35:47.474066 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6f810ff7-f259-4278-a06a-3ef536a73c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6393263346894b06adbf7585d99a0d8d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:47.474828 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6f810ff7-f259-4278-a06a-3ef536a73c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6393263346894b06adbf7585d99a0d8d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:47.483396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb51c2-be91-4037-84ac-c5cba79f394c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:47.483747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb51c2-be91-4037-84ac-c5cba79f394c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:47.484055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb51c2-be91-4037-84ac-c5cba79f394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:47.513886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6ceb51c2-be91-4037-84ac-c5cba79f394c None None] MFA Rules not processed for user `505c7c48b0d14dc9af8006cc7e8eea53`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:47.515178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6ceb51c2-be91-4037-84ac-c5cba79f394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:47.582388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 986/1994] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:47.586141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6f810ff7-f259-4278-a06a-3ef536a73c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6393263346894b06adbf7585d99a0d8d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:47.597995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb51c2-be91-4037-84ac-c5cba79f394c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:47.599158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6ceb51c2-be91-4037-84ac-c5cba79f394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:47.617225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb51c2-be91-4037-84ac-c5cba79f394c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:47.618253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1009/1995] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:47 2022] DELETE /identity/v3/users/6393263346894b06adbf7585d99a0d8d => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:47.622768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9937f8-2910-4542-ae36-2a2fd8dbe71e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:47.625950 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9937f8-2910-4542-ae36-2a2fd8dbe71e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:47.626285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9937f8-2910-4542-ae36-2a2fd8dbe71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:47.646636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0d9937f8-2910-4542-ae36-2a2fd8dbe71e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:47.647890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0d9937f8-2910-4542-ae36-2a2fd8dbe71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:47.700536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e7ef8-aa4d-43ff-aabc-91f93a413dee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:47.701153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e7ef8-aa4d-43ff-aabc-91f93a413dee service placement] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:47.701437 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e7ef8-aa4d-43ff-aabc-91f93a413dee service placement] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:47.701709 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e7ef8-aa4d-43ff-aabc-91f93a413dee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:47.709264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1010/1996] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:47.713945 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e7ef8-aa4d-43ff-aabc-91f93a413dee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:47.716215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e7ef8-aa4d-43ff-aabc-91f93a413dee service placement] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:47.720329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9937f8-2910-4542-ae36-2a2fd8dbe71e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:47.722616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0d9937f8-2910-4542-ae36-2a2fd8dbe71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:47.729145 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 987/1997] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:35:47.729978 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e7ef8-aa4d-43ff-aabc-91f93a413dee service placement] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:47.731293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c46e7ef8-aa4d-43ff-aabc-91f93a413dee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:47.763132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e7ef8-aa4d-43ff-aabc-91f93a413dee service placement] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:47.763132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:47.763132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:47.763132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:47.763534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] PATH_INFO: `/v3/users/becdc04dc32a469c89bca633b4173162` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:47.763534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=becdc04dc32a469c89bca633b4173162)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:47.764049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:47.797666 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9937f8-2910-4542-ae36-2a2fd8dbe71e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:47.801380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a3359-8d9c-4c2d-9e0b-8173bfdaeb55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:47.801974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a3359-8d9c-4c2d-9e0b-8173bfdaeb55 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:47.802251 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a3359-8d9c-4c2d-9e0b-8173bfdaeb55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:47.802615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a3359-8d9c-4c2d-9e0b-8173bfdaeb55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:47.811403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a3359-8d9c-4c2d-9e0b-8173bfdaeb55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:47.812885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a3359-8d9c-4c2d-9e0b-8173bfdaeb55 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:47.822482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1011/1998] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:48.156168 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'becdc04dc32a469c89bca633b4173162'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.165257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'becdc04dc32a469c89bca633b4173162'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.166166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'becdc04dc32a469c89bca633b4173162'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.289008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'becdc04dc32a469c89bca633b4173162'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.305322 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'becdc04dc32a469c89bca633b4173162'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.312420 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 988/1999] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:47 2022] DELETE /identity/v3/users/becdc04dc32a469c89bca633b4173162 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:48.358251 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:48.421110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a3359-8d9c-4c2d-9e0b-8173bfdaeb55 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:48.423245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d64a3359-8d9c-4c2d-9e0b-8173bfdaeb55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:48.439609 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a3359-8d9c-4c2d-9e0b-8173bfdaeb55 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:48.529384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:48.530021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:48.530358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:48.530634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] PATH_INFO: `/v3/projects/0dea3db50deb43e39b8e28269d4ec1ec` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:48.531825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dea3db50deb43e39b8e28269d4ec1ec)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:48.533875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:48.576899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:48.579070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:48.594126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98242a3-8688-49b7-a09c-36c6f5bb16b4 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:48.598957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1080d-f293-4b12-992d-565f98480a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:48.599628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1080d-f293-4b12-992d-565f98480a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:48.599908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1080d-f293-4b12-992d-565f98480a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:48.600213 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1080d-f293-4b12-992d-565f98480a56 admin admin] PATH_INFO: `/v3/projects/cc785435a1794272b4b96620abbcf412` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:48.601451 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1080d-f293-4b12-992d-565f98480a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc785435a1794272b4b96620abbcf412)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:48.604685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1080d-f293-4b12-992d-565f98480a56 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:48.735558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dea3db50deb43e39b8e28269d4ec1ec', 'request_id': 'req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.743228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dea3db50deb43e39b8e28269d4ec1ec', 'request_id': 'req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.778170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b7d1080d-f293-4b12-992d-565f98480a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc785435a1794272b4b96620abbcf412', 'request_id': 'req-b7d1080d-f293-4b12-992d-565f98480a56'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.783998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b7d1080d-f293-4b12-992d-565f98480a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc785435a1794272b4b96620abbcf412', 'request_id': 'req-b7d1080d-f293-4b12-992d-565f98480a56'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.790241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b7d1080d-f293-4b12-992d-565f98480a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc785435a1794272b4b96620abbcf412', 'request_id': 'req-b7d1080d-f293-4b12-992d-565f98480a56'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.821327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dea3db50deb43e39b8e28269d4ec1ec', 'request_id': 'req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.835276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] The token cache is being invalidate because project 0dea3db50deb43e39b8e28269d4ec1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:48.835276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.835276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.836126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1012/2000] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:48 2022] DELETE /identity/v3/projects/0dea3db50deb43e39b8e28269d4ec1ec => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:48.840017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:48.841319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:48.905897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b7d1080d-f293-4b12-992d-565f98480a56 admin admin] The token cache is being invalidate because project cc785435a1794272b4b96620abbcf412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:48.906208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b7d1080d-f293-4b12-992d-565f98480a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.907249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b7d1080d-f293-4b12-992d-565f98480a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:48.909302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 989/2001] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:48 2022] DELETE /identity/v3/projects/cc785435a1794272b4b96620abbcf412 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:48.911344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcfa15-d4bd-45be-ab36-84939ea6aa5c admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:48.915425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba86e8-7ad1-438f-8e96-e133b76d81c1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:48.915741 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba86e8-7ad1-438f-8e96-e133b76d81c1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:48.916101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba86e8-7ad1-438f-8e96-e133b76d81c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:48.939269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1bba86e8-7ad1-438f-8e96-e133b76d81c1 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:48.940444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1bba86e8-7ad1-438f-8e96-e133b76d81c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:48.995229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:48.996069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:48.996678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:48.996984 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] PATH_INFO: `/v3/users/6413c093f5f646ceaa02a77757b82708` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:48.998123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6413c093f5f646ceaa02a77757b82708)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:49.000070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:49.016986 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 990/2002] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:49.029734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f07e0b-7f45-4456-ae41-e13e0d6a1380 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:49.030056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f07e0b-7f45-4456-ae41-e13e0d6a1380 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:49.030324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f07e0b-7f45-4456-ae41-e13e0d6a1380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:49.050276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-31f07e0b-7f45-4456-ae41-e13e0d6a1380 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:49.051464 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-31f07e0b-7f45-4456-ae41-e13e0d6a1380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:49.060061 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 991/2003] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:49.064117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f07e0b-7f45-4456-ae41-e13e0d6a1380 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:49.073785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f07e0b-7f45-4456-ae41-e13e0d6a1380 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:49.080652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b8b1f-ca96-444f-a88c-f1553dae0096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:49.080652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b8b1f-ca96-444f-a88c-f1553dae0096 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:49.080652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b8b1f-ca96-444f-a88c-f1553dae0096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:49.080652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b8b1f-ca96-444f-a88c-f1553dae0096 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:49.081025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b8b1f-ca96-444f-a88c-f1553dae0096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:35:49.081025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b8b1f-ca96-444f-a88c-f1553dae0096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:49.082158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b8b1f-ca96-444f-a88c-f1553dae0096 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:49.094694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 992/2004] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:35:49.099113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b8b1f-ca96-444f-a88c-f1553dae0096 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:49.109709 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b8b1f-ca96-444f-a88c-f1553dae0096 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:49.114438 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55253be2-8747-4b50-be73-5eacbde4b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:49.115043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55253be2-8747-4b50-be73-5eacbde4b043 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:49.115322 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55253be2-8747-4b50-be73-5eacbde4b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:49.115594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55253be2-8747-4b50-be73-5eacbde4b043 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:49.116299 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55253be2-8747-4b50-be73-5eacbde4b043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:49.118170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55253be2-8747-4b50-be73-5eacbde4b043 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:49.217562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 993/2005] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:49 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:49.221669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55253be2-8747-4b50-be73-5eacbde4b043 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:49.247595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6413c093f5f646ceaa02a77757b82708'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:49.255236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6413c093f5f646ceaa02a77757b82708'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:49.256585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6413c093f5f646ceaa02a77757b82708'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:49.257208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6413c093f5f646ceaa02a77757b82708'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:49.294993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55253be2-8747-4b50-be73-5eacbde4b043 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:49.305416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f8e94-01ef-47de-a755-122fe9319bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:49.306044 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f8e94-01ef-47de-a755-122fe9319bee admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:49.306327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f8e94-01ef-47de-a755-122fe9319bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:49.306601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f8e94-01ef-47de-a755-122fe9319bee admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:49.307272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f8e94-01ef-47de-a755-122fe9319bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:49.309214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f8e94-01ef-47de-a755-122fe9319bee admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:49.340129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6413c093f5f646ceaa02a77757b82708'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:49.358290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1013/2006] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:48 2022] DELETE /identity/v3/users/6413c093f5f646ceaa02a77757b82708 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:49.452822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 994/2007] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:49 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:49.454048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:49.455615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:49.529017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976c1b6-4813-4ea2-833a-d2c3f552ee59 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:49.543931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241342f-0abe-457b-9a6c-182f5b3e71bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:49.543931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241342f-0abe-457b-9a6c-182f5b3e71bb admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:49.543931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241342f-0abe-457b-9a6c-182f5b3e71bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:49.543931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241342f-0abe-457b-9a6c-182f5b3e71bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:49.544314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241342f-0abe-457b-9a6c-182f5b3e71bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:49.544314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241342f-0abe-457b-9a6c-182f5b3e71bb admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:49.554209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1014/2008] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:49.555406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f8e94-01ef-47de-a755-122fe9319bee admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:49.565500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f8e94-01ef-47de-a755-122fe9319bee admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:49.570850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9742c-9756-4f5a-a7da-2d557528d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:49.571458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9742c-9756-4f5a-a7da-2d557528d6cf admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:49.571725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9742c-9756-4f5a-a7da-2d557528d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:49.572019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9742c-9756-4f5a-a7da-2d557528d6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:49.572719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9742c-9756-4f5a-a7da-2d557528d6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:49.574254 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9742c-9756-4f5a-a7da-2d557528d6cf admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:49.587247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 995/2009] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:49.588518 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241342f-0abe-457b-9a6c-182f5b3e71bb admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:49.599703 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241342f-0abe-457b-9a6c-182f5b3e71bb admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:49.604997 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40b41c-b152-4750-8b2a-d431526e7086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:49.605676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40b41c-b152-4750-8b2a-d431526e7086 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:49.605954 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40b41c-b152-4750-8b2a-d431526e7086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:49.606227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40b41c-b152-4750-8b2a-d431526e7086 admin admin] PATH_INFO: `/v3/projects/3a375a42e97346f796729ed9cb5d8359/users/64799b0fc3ce4ffc9c348a603e8bc4ac/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:49.623591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40b41c-b152-4750-8b2a-d431526e7086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a375a42e97346f796729ed9cb5d8359, user_id=64799b0fc3ce4ffc9c348a603e8bc4ac, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:49.626355 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40b41c-b152-4750-8b2a-d431526e7086 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:49.752804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1015/2010] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:49 2022] PUT /identity/v3/projects/3a375a42e97346f796729ed9cb5d8359/users/64799b0fc3ce4ffc9c348a603e8bc4ac/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:49.763657 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a7de0-b19f-4704-974b-77a8f1842a70 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:49.763942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a7de0-b19f-4704-974b-77a8f1842a70 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:49.764246 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a7de0-b19f-4704-974b-77a8f1842a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:49.797573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ad1a7de0-b19f-4704-974b-77a8f1842a70 None None] MFA Rules not processed for user `64799b0fc3ce4ffc9c348a603e8bc4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:49.798897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ad1a7de0-b19f-4704-974b-77a8f1842a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:49.835239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:49.870508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 996/2011] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:49.875329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40b41c-b152-4750-8b2a-d431526e7086 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:49.941091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a7de0-b19f-4704-974b-77a8f1842a70 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:49.946877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ad1a7de0-b19f-4704-974b-77a8f1842a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:49.950710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40b41c-b152-4750-8b2a-d431526e7086 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:49.957523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01dd37-0cf8-4cfb-8e42-22611dfb6d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:49.958167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01dd37-0cf8-4cfb-8e42-22611dfb6d66 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:49.958793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01dd37-0cf8-4cfb-8e42-22611dfb6d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:49.959075 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01dd37-0cf8-4cfb-8e42-22611dfb6d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:49.959740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01dd37-0cf8-4cfb-8e42-22611dfb6d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:49.961680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a7de0-b19f-4704-974b-77a8f1842a70 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:49.962894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01dd37-0cf8-4cfb-8e42-22611dfb6d66 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:49.969849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:49.970709 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:49.971058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:49.971397 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] PATH_INFO: `/v3/projects/8a6bf01405264613a776baa90fc726ab` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:49.972658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6bf01405264613a776baa90fc726ab)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:49.975807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:50.078773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1016/2012] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:49 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:50.083070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01dd37-0cf8-4cfb-8e42-22611dfb6d66 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:50.120382 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6bf01405264613a776baa90fc726ab', 'request_id': 'req-101e3878-87d7-4f32-83e3-52fe3ca32109'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:50.130149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6bf01405264613a776baa90fc726ab', 'request_id': 'req-101e3878-87d7-4f32-83e3-52fe3ca32109'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:50.144998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6bf01405264613a776baa90fc726ab', 'request_id': 'req-101e3878-87d7-4f32-83e3-52fe3ca32109'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:50.172563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01dd37-0cf8-4cfb-8e42-22611dfb6d66 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:50.236978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559e457-43f5-4537-a356-45435d5738ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:50.237530 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559e457-43f5-4537-a356-45435d5738ad admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:50.237835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559e457-43f5-4537-a356-45435d5738ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:50.238107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559e457-43f5-4537-a356-45435d5738ad admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:50.238743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559e457-43f5-4537-a356-45435d5738ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:50.240761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559e457-43f5-4537-a356-45435d5738ad admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:50.280425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] The token cache is being invalidate because project 8a6bf01405264613a776baa90fc726ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:50.280719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:50.281485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:50.283050 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 997/2013] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:49 2022] DELETE /identity/v3/projects/8a6bf01405264613a776baa90fc726ab => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:50.287547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:50.288881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:50.301985 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3878-87d7-4f32-83e3-52fe3ca32109 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:50.306902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:50.307524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:50.307803 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:50.308114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] PATH_INFO: `/v3/users/37a047af782d43c8920376f105b8df9a` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:50.309378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a047af782d43c8920376f105b8df9a)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:50.312488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:50.346934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1017/2014] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:50 2022] POST /identity/v3/users => generated 299 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:50.351319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559e457-43f5-4537-a356-45435d5738ad admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:50.354831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6559e457-43f5-4537-a356-45435d5738ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:50.367427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559e457-43f5-4537-a356-45435d5738ad admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:50.372252 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadae92-5756-4ed7-be35-a3161dee9788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:50.372917 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadae92-5756-4ed7-be35-a3161dee9788 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:50.373345 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadae92-5756-4ed7-be35-a3161dee9788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:50.373624 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadae92-5756-4ed7-be35-a3161dee9788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:50.374370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadae92-5756-4ed7-be35-a3161dee9788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:50.376092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadae92-5756-4ed7-be35-a3161dee9788 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:50.392261 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1018/2015] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:50.393634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadae92-5756-4ed7-be35-a3161dee9788 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:50.404450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadae92-5756-4ed7-be35-a3161dee9788 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:50.409932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eebb54-e4de-4368-b653-e1e559bfb35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:50.413485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eebb54-e4de-4368-b653-e1e559bfb35e admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:50.413485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eebb54-e4de-4368-b653-e1e559bfb35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:50.413485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eebb54-e4de-4368-b653-e1e559bfb35e admin admin] PATH_INFO: `/v3/projects/64471be9ebf04fa390cf409bcf609aa3/users/a3c91c41c4d7424a954d123101e058c6/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:50.427731 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eebb54-e4de-4368-b653-e1e559bfb35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64471be9ebf04fa390cf409bcf609aa3, user_id=a3c91c41c4d7424a954d123101e058c6, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:50.430810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eebb54-e4de-4368-b653-e1e559bfb35e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:50.541790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1019/2016] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:50 2022] PUT /identity/v3/projects/64471be9ebf04fa390cf409bcf609aa3/users/a3c91c41c4d7424a954d123101e058c6/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:50.545582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eebb54-e4de-4368-b653-e1e559bfb35e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:50.610598 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eebb54-e4de-4368-b653-e1e559bfb35e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:50.615307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0255042-44b2-4077-9fa7-345eb11d0d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:50.615916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0255042-44b2-4077-9fa7-345eb11d0d7a admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:50.616211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0255042-44b2-4077-9fa7-345eb11d0d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:50.616480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0255042-44b2-4077-9fa7-345eb11d0d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:50.617141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0255042-44b2-4077-9fa7-345eb11d0d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:50.618696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0255042-44b2-4077-9fa7-345eb11d0d7a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:50.628700 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1020/2017] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:50.633041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0255042-44b2-4077-9fa7-345eb11d0d7a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:50.642184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0255042-44b2-4077-9fa7-345eb11d0d7a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:50.647479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beae43d-f27c-44a6-956e-3c8992851776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:50.657339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae43d-f27c-44a6-956e-3c8992851776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:50.657339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae43d-f27c-44a6-956e-3c8992851776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:50.657339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae43d-f27c-44a6-956e-3c8992851776 admin admin] PATH_INFO: `/v3/projects/64471be9ebf04fa390cf409bcf609aa3/users/a3c91c41c4d7424a954d123101e058c6/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:50.657339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beae43d-f27c-44a6-956e-3c8992851776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64471be9ebf04fa390cf409bcf609aa3, user_id=a3c91c41c4d7424a954d123101e058c6, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:50.657339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beae43d-f27c-44a6-956e-3c8992851776 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:50.666802 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1021/2018] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:50 2022] PUT /identity/v3/projects/64471be9ebf04fa390cf409bcf609aa3/users/a3c91c41c4d7424a954d123101e058c6/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:50.678065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcda75-6c41-4083-9097-22f033a2912b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:50.678356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcda75-6c41-4083-9097-22f033a2912b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:50.678634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcda75-6c41-4083-9097-22f033a2912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:50.697963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a047af782d43c8920376f105b8df9a'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:50.706030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a047af782d43c8920376f105b8df9a'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:50.706803 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a047af782d43c8920376f105b8df9a'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:50.708231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c2dcda75-6c41-4083-9097-22f033a2912b None None] MFA Rules not processed for user `a3c91c41c4d7424a954d123101e058c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:50.710206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c2dcda75-6c41-4083-9097-22f033a2912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:50.781877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1022/2019] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:50.786412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a047af782d43c8920376f105b8df9a'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:50.795251 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcda75-6c41-4083-9097-22f033a2912b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:50.795417 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c2dcda75-6c41-4083-9097-22f033a2912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:50.799708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a047af782d43c8920376f105b8df9a'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:50.806762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 998/2020] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:50 2022] DELETE /identity/v3/users/37a047af782d43c8920376f105b8df9a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:50.864322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcda75-6c41-4083-9097-22f033a2912b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:50.948695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63422a-d227-499d-ba66-6dc38a62a70d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:50.949307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63422a-d227-499d-ba66-6dc38a62a70d service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:50.952070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63422a-d227-499d-ba66-6dc38a62a70d service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:50.952070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63422a-d227-499d-ba66-6dc38a62a70d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:51.029416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63422a-d227-499d-ba66-6dc38a62a70d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:51.031330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63422a-d227-499d-ba66-6dc38a62a70d service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:51.053847 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1023/2021] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:51.075204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:51.076743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:51.150222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776e96f-5341-4c69-a168-fe0ffb21fb68 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:51.154934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647a07a-6934-49a4-9d53-87e6d5ec0133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:51.155575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647a07a-6934-49a4-9d53-87e6d5ec0133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:51.155976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647a07a-6934-49a4-9d53-87e6d5ec0133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:51.156426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647a07a-6934-49a4-9d53-87e6d5ec0133 admin admin] PATH_INFO: `/v3/users/64799b0fc3ce4ffc9c348a603e8bc4ac` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:51.157283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647a07a-6934-49a4-9d53-87e6d5ec0133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64799b0fc3ce4ffc9c348a603e8bc4ac)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:51.159414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647a07a-6934-49a4-9d53-87e6d5ec0133 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:51.260836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:51.303201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63422a-d227-499d-ba66-6dc38a62a70d service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:51.304579 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2e63422a-d227-499d-ba66-6dc38a62a70d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:51.318955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63422a-d227-499d-ba66-6dc38a62a70d service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:51.325112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a873d1-f596-4b6e-85c0-72a489fb74de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:51.325782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a873d1-f596-4b6e-85c0-72a489fb74de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:51.326102 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a873d1-f596-4b6e-85c0-72a489fb74de admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:51.326467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a873d1-f596-4b6e-85c0-72a489fb74de admin admin] PATH_INFO: `/v3/projects/b134bc2a11fc49f6b17bdda5ba6ab309` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:51.327663 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a873d1-f596-4b6e-85c0-72a489fb74de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b134bc2a11fc49f6b17bdda5ba6ab309)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:51.329834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a873d1-f596-4b6e-85c0-72a489fb74de admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:51.440130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7647a07a-6934-49a4-9d53-87e6d5ec0133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64799b0fc3ce4ffc9c348a603e8bc4ac'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:51.447173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7647a07a-6934-49a4-9d53-87e6d5ec0133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64799b0fc3ce4ffc9c348a603e8bc4ac'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:51.447908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7647a07a-6934-49a4-9d53-87e6d5ec0133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64799b0fc3ce4ffc9c348a603e8bc4ac'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:51.460083 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d5a873d1-f596-4b6e-85c0-72a489fb74de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b134bc2a11fc49f6b17bdda5ba6ab309', 'request_id': 'req-d5a873d1-f596-4b6e-85c0-72a489fb74de'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:51.468646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d5a873d1-f596-4b6e-85c0-72a489fb74de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b134bc2a11fc49f6b17bdda5ba6ab309', 'request_id': 'req-d5a873d1-f596-4b6e-85c0-72a489fb74de'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:51.591471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7647a07a-6934-49a4-9d53-87e6d5ec0133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64799b0fc3ce4ffc9c348a603e8bc4ac'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:51.609516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7647a07a-6934-49a4-9d53-87e6d5ec0133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64799b0fc3ce4ffc9c348a603e8bc4ac'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:51.624280 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 999/2022] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:51 2022] DELETE /identity/v3/users/64799b0fc3ce4ffc9c348a603e8bc4ac => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:51.628996 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d98c9c-dab4-451c-9ce6-f140ed48237a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:51.630306 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d98c9c-dab4-451c-9ce6-f140ed48237a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:51.630736 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d98c9c-dab4-451c-9ce6-f140ed48237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:51.669366 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f3d98c9c-dab4-451c-9ce6-f140ed48237a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:51.670823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f3d98c9c-dab4-451c-9ce6-f140ed48237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:51.711887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d5a873d1-f596-4b6e-85c0-72a489fb74de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b134bc2a11fc49f6b17bdda5ba6ab309', 'request_id': 'req-d5a873d1-f596-4b6e-85c0-72a489fb74de'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:51.725396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d5a873d1-f596-4b6e-85c0-72a489fb74de admin admin] The token cache is being invalidate because project b134bc2a11fc49f6b17bdda5ba6ab309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:51.725676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d5a873d1-f596-4b6e-85c0-72a489fb74de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:51.726456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d5a873d1-f596-4b6e-85c0-72a489fb74de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:51.728687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1024/2023] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:51 2022] DELETE /identity/v3/projects/b134bc2a11fc49f6b17bdda5ba6ab309 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:51.735012 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9981217-db34-432a-9129-77127e4923ab None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:51.735616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9981217-db34-432a-9129-77127e4923ab None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:51.735732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1000/2024] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:51.736321 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9981217-db34-432a-9129-77127e4923ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:51.746898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d98c9c-dab4-451c-9ce6-f140ed48237a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:51.748413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f3d98c9c-dab4-451c-9ce6-f140ed48237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:51.756493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e9981217-db34-432a-9129-77127e4923ab None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:51.757685 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e9981217-db34-432a-9129-77127e4923ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:51.765679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1025/2025] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:51.775122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1910f56-7b93-4050-8273-bdba9a406610 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:51.775416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1910f56-7b93-4050-8273-bdba9a406610 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:51.776863 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1910f56-7b93-4050-8273-bdba9a406610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:51.798891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b1910f56-7b93-4050-8273-bdba9a406610 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:51.800390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b1910f56-7b93-4050-8273-bdba9a406610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:51.809114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1026/2026] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:51.809483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d98c9c-dab4-451c-9ce6-f140ed48237a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:51.813232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3e0a0-6065-46f2-bee2-0e432e37518c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:51.813382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1910f56-7b93-4050-8273-bdba9a406610 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:51.813839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3e0a0-6065-46f2-bee2-0e432e37518c service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:51.814124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3e0a0-6065-46f2-bee2-0e432e37518c service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:51.814378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3e0a0-6065-46f2-bee2-0e432e37518c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:51.822896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1910f56-7b93-4050-8273-bdba9a406610 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:51.826982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3e0a0-6065-46f2-bee2-0e432e37518c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:51.828066 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4382b1-ce89-41d6-9918-6e87d2e9c77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:51.828716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4382b1-ce89-41d6-9918-6e87d2e9c77a admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:51.829000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4382b1-ce89-41d6-9918-6e87d2e9c77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:51.829113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3e0a0-6065-46f2-bee2-0e432e37518c service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:51.829272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4382b1-ce89-41d6-9918-6e87d2e9c77a admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:51.829923 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4382b1-ce89-41d6-9918-6e87d2e9c77a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:35:51.830227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4382b1-ce89-41d6-9918-6e87d2e9c77a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:51.831846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4382b1-ce89-41d6-9918-6e87d2e9c77a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:51.839536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1001/2027] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:35:51.844965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1027/2028] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:35:51.849834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3e0a0-6065-46f2-bee2-0e432e37518c service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:51.860395 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3e0a0-6065-46f2-bee2-0e432e37518c service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:51.865682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e312d4c-eb8f-4132-84b2-2323523e522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:51.866275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e312d4c-eb8f-4132-84b2-2323523e522e admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:51.866545 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e312d4c-eb8f-4132-84b2-2323523e522e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:51.866807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e312d4c-eb8f-4132-84b2-2323523e522e admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:51.867432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e312d4c-eb8f-4132-84b2-2323523e522e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:51.873652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e312d4c-eb8f-4132-84b2-2323523e522e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:52.016155 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1002/2029] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:51 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:52.020448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4382b1-ce89-41d6-9918-6e87d2e9c77a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:52.031140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4382b1-ce89-41d6-9918-6e87d2e9c77a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:52.115022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b883e7a-4ec5-4ec1-bbb1-42012f6f6678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:52.115022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883e7a-4ec5-4ec1-bbb1-42012f6f6678 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:52.115022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883e7a-4ec5-4ec1-bbb1-42012f6f6678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:52.115022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883e7a-4ec5-4ec1-bbb1-42012f6f6678 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:52.115461 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b883e7a-4ec5-4ec1-bbb1-42012f6f6678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:52.115461 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b883e7a-4ec5-4ec1-bbb1-42012f6f6678 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:52.296736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1028/2030] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:52 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:52.300380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e312d4c-eb8f-4132-84b2-2323523e522e admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:52.310629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e312d4c-eb8f-4132-84b2-2323523e522e admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:52.320476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb631ab-5edb-4178-98e2-04cad8b6f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:52.321184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb631ab-5edb-4178-98e2-04cad8b6f241 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:52.321565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb631ab-5edb-4178-98e2-04cad8b6f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:52.321894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb631ab-5edb-4178-98e2-04cad8b6f241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:52.322601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb631ab-5edb-4178-98e2-04cad8b6f241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:52.324322 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb631ab-5edb-4178-98e2-04cad8b6f241 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:52.325299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf08061-5523-4d57-b38b-971594c33c69 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:52.325586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf08061-5523-4d57-b38b-971594c33c69 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:52.325863 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf08061-5523-4d57-b38b-971594c33c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:52.339812 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1003/2031] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:52.343075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb631ab-5edb-4178-98e2-04cad8b6f241 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:52.345763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cbb631ab-5edb-4178-98e2-04cad8b6f241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:52.372580 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ecf08061-5523-4d57-b38b-971594c33c69 None None] MFA Rules not processed for user `f5ca1bc84be04e61a641b18b26cb63cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:52.379682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ecf08061-5523-4d57-b38b-971594c33c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:52.379813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb631ab-5edb-4178-98e2-04cad8b6f241 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:52.380988 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:52.381616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:52.381890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:52.382160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] PATH_INFO: `/v3/projects/3a375a42e97346f796729ed9cb5d8359` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:52.383381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a375a42e97346f796729ed9cb5d8359)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:52.385339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:52.429668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1029/2032] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:52.430515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf08061-5523-4d57-b38b-971594c33c69 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:52.441759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf08061-5523-4d57-b38b-971594c33c69 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:52.446556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2b3e7-85c3-459e-a2d1-a4090b1fe003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:52.447166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2b3e7-85c3-459e-a2d1-a4090b1fe003 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:52.447446 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2b3e7-85c3-459e-a2d1-a4090b1fe003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:52.447719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2b3e7-85c3-459e-a2d1-a4090b1fe003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:52.448416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2b3e7-85c3-459e-a2d1-a4090b1fe003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:52.449978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2b3e7-85c3-459e-a2d1-a4090b1fe003 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:52.461436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1030/2033] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:52.464956 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2b3e7-85c3-459e-a2d1-a4090b1fe003 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:52.477200 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2b3e7-85c3-459e-a2d1-a4090b1fe003 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:52.480079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c03d3-171b-41b7-9114-3f1e4f3b3b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:52.480719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c03d3-171b-41b7-9114-3f1e4f3b3b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:52.480996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c03d3-171b-41b7-9114-3f1e4f3b3b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:52.481269 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c03d3-171b-41b7-9114-3f1e4f3b3b27 admin admin] PATH_INFO: `/v3/projects/2fcfd780d8b6468ca27dce5cadeab526/users/af33914f57134e97ac5a5f4d30153d2b/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:52.498314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c03d3-171b-41b7-9114-3f1e4f3b3b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcfd780d8b6468ca27dce5cadeab526, user_id=af33914f57134e97ac5a5f4d30153d2b, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:52.501128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c03d3-171b-41b7-9114-3f1e4f3b3b27 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:52.610153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1031/2034] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:52 2022] PUT /identity/v3/projects/2fcfd780d8b6468ca27dce5cadeab526/users/af33914f57134e97ac5a5f4d30153d2b/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:52.621439 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a375a42e97346f796729ed9cb5d8359', 'request_id': 'req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:52.622405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71810373-112b-43cf-92a5-e490c2091050 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:52.622747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71810373-112b-43cf-92a5-e490c2091050 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:52.622956 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71810373-112b-43cf-92a5-e490c2091050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:52.628012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a375a42e97346f796729ed9cb5d8359', 'request_id': 'req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:52.635105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a375a42e97346f796729ed9cb5d8359', 'request_id': 'req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:52.658690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-71810373-112b-43cf-92a5-e490c2091050 None None] MFA Rules not processed for user `af33914f57134e97ac5a5f4d30153d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:52.659938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-71810373-112b-43cf-92a5-e490c2091050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:52.746195 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] The token cache is being invalidate because project 3a375a42e97346f796729ed9cb5d8359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:52.746797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:52.749379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:52.752939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1004/2035] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:52 2022] DELETE /identity/v3/projects/3a375a42e97346f796729ed9cb5d8359 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:52.761804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:52.763699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:52.819787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1032/2036] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:52.820764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71810373-112b-43cf-92a5-e490c2091050 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:52.824388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-71810373-112b-43cf-92a5-e490c2091050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:52.938391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d066e-1ae2-4ef2-bea3-e6d6ff4714e8 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:52.953663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:52.955285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:52.956189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:52.971504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] PATH_INFO: `/v3/users/a3c91c41c4d7424a954d123101e058c6` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:52.972989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c91c41c4d7424a954d123101e058c6)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:52.981496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:53.014860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71810373-112b-43cf-92a5-e490c2091050 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:53.020060 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7abc93-4e40-4d66-9a8c-3708ece6dae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:53.021383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7abc93-4e40-4d66-9a8c-3708ece6dae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:53.021678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7abc93-4e40-4d66-9a8c-3708ece6dae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:53.022003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7abc93-4e40-4d66-9a8c-3708ece6dae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:53.022905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7abc93-4e40-4d66-9a8c-3708ece6dae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:53.025151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7abc93-4e40-4d66-9a8c-3708ece6dae6 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:53.079446 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:53.220333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1033/2037] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:52 2022] POST /identity/v3/projects => generated 383 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:53.221401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7abc93-4e40-4d66-9a8c-3708ece6dae6 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:53.282013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7abc93-4e40-4d66-9a8c-3708ece6dae6 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:53.287228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b89a0-9767-4f89-96ae-2110c9e1ea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:53.287924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b89a0-9767-4f89-96ae-2110c9e1ea46 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:53.288232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b89a0-9767-4f89-96ae-2110c9e1ea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:53.288506 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b89a0-9767-4f89-96ae-2110c9e1ea46 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:53.289136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b89a0-9767-4f89-96ae-2110c9e1ea46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:53.291034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b89a0-9767-4f89-96ae-2110c9e1ea46 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:53.429327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c91c41c4d7424a954d123101e058c6'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:53.436746 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c91c41c4d7424a954d123101e058c6'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:53.437431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c91c41c4d7424a954d123101e058c6'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:53.466563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1034/2038] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:53 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:53.470256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b89a0-9767-4f89-96ae-2110c9e1ea46 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:53.483920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cb4b89a0-9767-4f89-96ae-2110c9e1ea46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:53.484677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b89a0-9767-4f89-96ae-2110c9e1ea46 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:53.490155 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6325586-0af2-4ad1-a4c2-99b515230fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:53.491024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6325586-0af2-4ad1-a4c2-99b515230fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:53.491760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6325586-0af2-4ad1-a4c2-99b515230fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:53.491760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6325586-0af2-4ad1-a4c2-99b515230fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:53.492436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6325586-0af2-4ad1-a4c2-99b515230fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:53.494099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6325586-0af2-4ad1-a4c2-99b515230fbe admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:53.508044 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1035/2039] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:53.509094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6325586-0af2-4ad1-a4c2-99b515230fbe admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:53.518907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6325586-0af2-4ad1-a4c2-99b515230fbe admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:53.523675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece2392-bb54-4d2c-a904-774d3c70664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:53.524511 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece2392-bb54-4d2c-a904-774d3c70664b admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:53.524794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece2392-bb54-4d2c-a904-774d3c70664b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:53.525067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece2392-bb54-4d2c-a904-774d3c70664b admin admin] PATH_INFO: `/v3/projects/037e7ec7211d40d5ae3b5eb3af2c7aad/users/582d1fca8dfc4b50b789e3ad91e03321/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:53.545340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece2392-bb54-4d2c-a904-774d3c70664b admin admin] RBAC: Authorizing `identity:create_grant(project_id=037e7ec7211d40d5ae3b5eb3af2c7aad, user_id=582d1fca8dfc4b50b789e3ad91e03321, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:53.548266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece2392-bb54-4d2c-a904-774d3c70664b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:53.623554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c91c41c4d7424a954d123101e058c6'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:53.636016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c91c41c4d7424a954d123101e058c6'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:53.650846 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1005/2040] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:35:52 2022] DELETE /identity/v3/users/a3c91c41c4d7424a954d123101e058c6 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:53.726023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:53.922393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1036/2041] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:53 2022] PUT /identity/v3/projects/037e7ec7211d40d5ae3b5eb3af2c7aad/users/582d1fca8dfc4b50b789e3ad91e03321/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:53.926348 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:53.997165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff57d2b-0baf-4d5d-b12c-ff2543c6afaf admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:54.068233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33967468-b16c-41d7-aa32-74a23d1c7504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:54.068862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967468-b16c-41d7-aa32-74a23d1c7504 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:54.069145 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967468-b16c-41d7-aa32-74a23d1c7504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:54.069415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967468-b16c-41d7-aa32-74a23d1c7504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:54.070493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33967468-b16c-41d7-aa32-74a23d1c7504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:54.071718 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33967468-b16c-41d7-aa32-74a23d1c7504 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:54.082370 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1006/2042] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:35:54.087064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece2392-bb54-4d2c-a904-774d3c70664b admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:54.097671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece2392-bb54-4d2c-a904-774d3c70664b admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:54.103529 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f2bb9-0104-48d8-8e3d-a3f505a37129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:54.105208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f2bb9-0104-48d8-8e3d-a3f505a37129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:54.105208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f2bb9-0104-48d8-8e3d-a3f505a37129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:54.105833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f2bb9-0104-48d8-8e3d-a3f505a37129 admin admin] PATH_INFO: `/v3/projects/037e7ec7211d40d5ae3b5eb3af2c7aad/users/582d1fca8dfc4b50b789e3ad91e03321/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:54.108161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f2bb9-0104-48d8-8e3d-a3f505a37129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=037e7ec7211d40d5ae3b5eb3af2c7aad, user_id=582d1fca8dfc4b50b789e3ad91e03321, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:54.111361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f2bb9-0104-48d8-8e3d-a3f505a37129 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:54.128006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1037/2043] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:54 2022] PUT /identity/v3/projects/037e7ec7211d40d5ae3b5eb3af2c7aad/users/582d1fca8dfc4b50b789e3ad91e03321/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:54.138003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aff2f-7806-4cb0-b563-013c88ea0f6a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:54.138291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aff2f-7806-4cb0-b563-013c88ea0f6a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:54.138566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aff2f-7806-4cb0-b563-013c88ea0f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:54.168329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-cc7aff2f-7806-4cb0-b563-013c88ea0f6a None None] MFA Rules not processed for user `582d1fca8dfc4b50b789e3ad91e03321`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:54.169580 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cc7aff2f-7806-4cb0-b563-013c88ea0f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:54.250871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1007/2044] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:54.268506 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f2bb9-0104-48d8-8e3d-a3f505a37129 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:54.268975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1d1f2bb9-0104-48d8-8e3d-a3f505a37129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:54.328045 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f2bb9-0104-48d8-8e3d-a3f505a37129 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:54.331626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a6b6a-f0a2-4d75-9151-daca31f0801e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:54.332254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a6b6a-f0a2-4d75-9151-daca31f0801e service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:54.332529 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a6b6a-f0a2-4d75-9151-daca31f0801e service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:54.332797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a6b6a-f0a2-4d75-9151-daca31f0801e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:54.335157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-225a6b6a-f0a2-4d75-9151-daca31f0801e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:54.387220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7aff2f-7806-4cb0-b563-013c88ea0f6a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:54.389066 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cc7aff2f-7806-4cb0-b563-013c88ea0f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:54.395271 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a6b6a-f0a2-4d75-9151-daca31f0801e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:54.397440 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a6b6a-f0a2-4d75-9151-daca31f0801e service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:54.409536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1038/2045] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:54.486843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7aff2f-7806-4cb0-b563-013c88ea0f6a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:54.492941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a73032-9160-4164-aa23-76fbc439a743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:54.493595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a73032-9160-4164-aa23-76fbc439a743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:54.493917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a73032-9160-4164-aa23-76fbc439a743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:54.494259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a73032-9160-4164-aa23-76fbc439a743 admin admin] PATH_INFO: `/v3/projects/64471be9ebf04fa390cf409bcf609aa3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:54.495466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a73032-9160-4164-aa23-76fbc439a743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64471be9ebf04fa390cf409bcf609aa3)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:54.497757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a73032-9160-4164-aa23-76fbc439a743 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:54.673981 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04a73032-9160-4164-aa23-76fbc439a743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64471be9ebf04fa390cf409bcf609aa3', 'request_id': 'req-04a73032-9160-4164-aa23-76fbc439a743'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:54.679969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04a73032-9160-4164-aa23-76fbc439a743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64471be9ebf04fa390cf409bcf609aa3', 'request_id': 'req-04a73032-9160-4164-aa23-76fbc439a743'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:54.687743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04a73032-9160-4164-aa23-76fbc439a743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64471be9ebf04fa390cf409bcf609aa3', 'request_id': 'req-04a73032-9160-4164-aa23-76fbc439a743'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:54.786079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04a73032-9160-4164-aa23-76fbc439a743 admin admin] The token cache is being invalidate because project 64471be9ebf04fa390cf409bcf609aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:35:54.786543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04a73032-9160-4164-aa23-76fbc439a743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:54.787209 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04a73032-9160-4164-aa23-76fbc439a743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:35:54.788740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1008/2046] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:35:54 2022] DELETE /identity/v3/projects/64471be9ebf04fa390cf409bcf609aa3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:54.794468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a92f1-3980-4a3b-addc-f030dbf92526 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:54.794754 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a92f1-3980-4a3b-addc-f030dbf92526 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:54.795032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a92f1-3980-4a3b-addc-f030dbf92526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:54.814498 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4d4a92f1-3980-4a3b-addc-f030dbf92526 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:54.815835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4d4a92f1-3980-4a3b-addc-f030dbf92526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:54.878478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1039/2047] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:35:54.882162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6c6d2-ca7d-42ea-a87c-a76210873114 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:54.882451 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6c6d2-ca7d-42ea-a87c-a76210873114 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:54.882727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6c6d2-ca7d-42ea-a87c-a76210873114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:54.904737 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c7a6c6d2-ca7d-42ea-a87c-a76210873114 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:54.906044 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c7a6c6d2-ca7d-42ea-a87c-a76210873114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:54.917581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1009/2048] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:54.918708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a92f1-3980-4a3b-addc-f030dbf92526 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:54.930557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a92f1-3980-4a3b-addc-f030dbf92526 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:54.935455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0582aa-9500-41de-bed6-6f9d007c5350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:54.936165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0582aa-9500-41de-bed6-6f9d007c5350 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:54.936445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0582aa-9500-41de-bed6-6f9d007c5350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:54.936748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0582aa-9500-41de-bed6-6f9d007c5350 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:54.937441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0582aa-9500-41de-bed6-6f9d007c5350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:35:54.937871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0582aa-9500-41de-bed6-6f9d007c5350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:54.939449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0582aa-9500-41de-bed6-6f9d007c5350 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:54.953792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1040/2049] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:35:54.960000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6c6d2-ca7d-42ea-a87c-a76210873114 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:54.970748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6c6d2-ca7d-42ea-a87c-a76210873114 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:54.977660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec6572-9600-451d-9d06-a48d6dd8f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:54.978266 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec6572-9600-451d-9d06-a48d6dd8f0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:54.978539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec6572-9600-451d-9d06-a48d6dd8f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:54.978879 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec6572-9600-451d-9d06-a48d6dd8f0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:54.979635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec6572-9600-451d-9d06-a48d6dd8f0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:54.981557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec6572-9600-451d-9d06-a48d6dd8f0c0 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:55.193651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1010/2050] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:54 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:55.197814 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0582aa-9500-41de-bed6-6f9d007c5350 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:55.207756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0582aa-9500-41de-bed6-6f9d007c5350 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:55.264110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653462ab-7372-4d8f-a157-06538a217a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:55.264888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653462ab-7372-4d8f-a157-06538a217a9f admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:55.265110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653462ab-7372-4d8f-a157-06538a217a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:55.266932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653462ab-7372-4d8f-a157-06538a217a9f admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:55.266932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653462ab-7372-4d8f-a157-06538a217a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:55.268020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653462ab-7372-4d8f-a157-06538a217a9f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:55.369008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1041/2051] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:55 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:55.376223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec6572-9600-451d-9d06-a48d6dd8f0c0 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:55.392509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec6572-9600-451d-9d06-a48d6dd8f0c0 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:55.401897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddf1e2-2843-4cc9-be39-255638fb1b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:55.401897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddf1e2-2843-4cc9-be39-255638fb1b4b admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:55.401897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddf1e2-2843-4cc9-be39-255638fb1b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:55.401897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddf1e2-2843-4cc9-be39-255638fb1b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:55.402663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddf1e2-2843-4cc9-be39-255638fb1b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:55.404641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddf1e2-2843-4cc9-be39-255638fb1b4b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:55.421074 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653462ab-7372-4d8f-a157-06538a217a9f admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:55.427347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1011/2052] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:55.433681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653462ab-7372-4d8f-a157-06538a217a9f admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:55.438739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269162b5-95ee-4d08-8720-b3b874c8f215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:55.439342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269162b5-95ee-4d08-8720-b3b874c8f215 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:55.441829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269162b5-95ee-4d08-8720-b3b874c8f215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:55.441829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269162b5-95ee-4d08-8720-b3b874c8f215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:55.441829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269162b5-95ee-4d08-8720-b3b874c8f215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:55.442260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269162b5-95ee-4d08-8720-b3b874c8f215 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:55.454129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1042/2053] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:55.461003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddf1e2-2843-4cc9-be39-255638fb1b4b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:55.471060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddf1e2-2843-4cc9-be39-255638fb1b4b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:55.476050 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2573f09-059e-49a1-9c61-a928bc4588a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:55.476697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2573f09-059e-49a1-9c61-a928bc4588a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:55.476970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2573f09-059e-49a1-9c61-a928bc4588a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:55.477393 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2573f09-059e-49a1-9c61-a928bc4588a8 admin admin] PATH_INFO: `/v3/projects/2471f8afbd33469cb5ee16a39b14a183/users/90f32bb6a8cc4d67bf26a038e5c8f085/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:55.493035 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2573f09-059e-49a1-9c61-a928bc4588a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2471f8afbd33469cb5ee16a39b14a183, user_id=90f32bb6a8cc4d67bf26a038e5c8f085, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:55.495726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2573f09-059e-49a1-9c61-a928bc4588a8 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:55.586188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1012/2054] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:55 2022] PUT /identity/v3/projects/2471f8afbd33469cb5ee16a39b14a183/users/90f32bb6a8cc4d67bf26a038e5c8f085/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:55.598267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725a7b0-bed2-4899-b9cf-4510b8921eca None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:55.599175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725a7b0-bed2-4899-b9cf-4510b8921eca None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:55.599567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725a7b0-bed2-4899-b9cf-4510b8921eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:55.628481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7725a7b0-bed2-4899-b9cf-4510b8921eca None None] MFA Rules not processed for user `90f32bb6a8cc4d67bf26a038e5c8f085`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:55.629684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7725a7b0-bed2-4899-b9cf-4510b8921eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:55.694276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1043/2055] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:55.698804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2573f09-059e-49a1-9c61-a928bc4588a8 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:55.761802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2573f09-059e-49a1-9c61-a928bc4588a8 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:55.766642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a1e37-d1e3-4865-bdc5-ff6f8bfbee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:55.767271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1e37-d1e3-4865-bdc5-ff6f8bfbee12 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:55.767533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1e37-d1e3-4865-bdc5-ff6f8bfbee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:55.767808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1e37-d1e3-4865-bdc5-ff6f8bfbee12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:55.768476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a1e37-d1e3-4865-bdc5-ff6f8bfbee12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:55.770395 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a1e37-d1e3-4865-bdc5-ff6f8bfbee12 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:55.907397 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1013/2056] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:35:55 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:35:55.912766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725a7b0-bed2-4899-b9cf-4510b8921eca None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:55.914127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:55.923748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725a7b0-bed2-4899-b9cf-4510b8921eca None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:55.979849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71f87a-7840-4f08-9a8d-48ba3630f00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:55.980517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71f87a-7840-4f08-9a8d-48ba3630f00d admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:55.980739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71f87a-7840-4f08-9a8d-48ba3630f00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:55.981005 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71f87a-7840-4f08-9a8d-48ba3630f00d admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:55.981884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71f87a-7840-4f08-9a8d-48ba3630f00d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:55.983888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71f87a-7840-4f08-9a8d-48ba3630f00d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:56.094495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1044/2057] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:35:55 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:35:56.098519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a1e37-d1e3-4865-bdc5-ff6f8bfbee12 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:56.108919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a1e37-d1e3-4865-bdc5-ff6f8bfbee12 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:56.113500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495685db-e85b-47bc-a5c7-554314d236e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:56.114098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495685db-e85b-47bc-a5c7-554314d236e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:56.114885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495685db-e85b-47bc-a5c7-554314d236e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:56.115160 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495685db-e85b-47bc-a5c7-554314d236e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:56.115804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495685db-e85b-47bc-a5c7-554314d236e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:56.117430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495685db-e85b-47bc-a5c7-554314d236e2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:56.127146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1014/2058] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:56.131963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71f87a-7840-4f08-9a8d-48ba3630f00d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:56.142018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71f87a-7840-4f08-9a8d-48ba3630f00d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:56.147391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a055330-11de-44c7-90e7-ffc3aec1d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:56.148076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a055330-11de-44c7-90e7-ffc3aec1d612 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:56.148359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a055330-11de-44c7-90e7-ffc3aec1d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:56.148656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a055330-11de-44c7-90e7-ffc3aec1d612 admin admin] PATH_INFO: `/v3/projects/d6c5c8281a1449c5be8e8be1df223c77/users/a34c9912665e403b8170a3cdb0045d3f/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:56.165825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a055330-11de-44c7-90e7-ffc3aec1d612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c5c8281a1449c5be8e8be1df223c77, user_id=a34c9912665e403b8170a3cdb0045d3f, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:56.168580 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a055330-11de-44c7-90e7-ffc3aec1d612 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:56.243076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1045/2059] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:56 2022] PUT /identity/v3/projects/d6c5c8281a1449c5be8e8be1df223c77/users/a34c9912665e403b8170a3cdb0045d3f/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:35:56.247245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495685db-e85b-47bc-a5c7-554314d236e2 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:56.257019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495685db-e85b-47bc-a5c7-554314d236e2 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:56.313565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28894d18-90e6-4375-a31a-0c7148906769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:56.314553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28894d18-90e6-4375-a31a-0c7148906769 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:56.314843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28894d18-90e6-4375-a31a-0c7148906769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:56.315112 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28894d18-90e6-4375-a31a-0c7148906769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:56.315748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28894d18-90e6-4375-a31a-0c7148906769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:56.318162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28894d18-90e6-4375-a31a-0c7148906769 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:56.328462 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1015/2060] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:35:56.332837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a055330-11de-44c7-90e7-ffc3aec1d612 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:56.343529 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a055330-11de-44c7-90e7-ffc3aec1d612 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:56.348210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae3416-b346-46ee-b560-61cd56843bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:56.349029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae3416-b346-46ee-b560-61cd56843bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:56.349235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae3416-b346-46ee-b560-61cd56843bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:56.349504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae3416-b346-46ee-b560-61cd56843bf8 admin admin] PATH_INFO: `/v3/projects/d6c5c8281a1449c5be8e8be1df223c77/users/a34c9912665e403b8170a3cdb0045d3f/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:56.351372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae3416-b346-46ee-b560-61cd56843bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c5c8281a1449c5be8e8be1df223c77, user_id=a34c9912665e403b8170a3cdb0045d3f, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:56.353971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae3416-b346-46ee-b560-61cd56843bf8 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:56.366817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1046/2061] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:35:56 2022] PUT /identity/v3/projects/d6c5c8281a1449c5be8e8be1df223c77/users/a34c9912665e403b8170a3cdb0045d3f/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:35:56.384815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2ca7d-c651-45b4-a80c-bb4b15c5d122 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:56.384815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2ca7d-c651-45b4-a80c-bb4b15c5d122 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:56.384815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2ca7d-c651-45b4-a80c-bb4b15c5d122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:56.415359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3be2ca7d-c651-45b4-a80c-bb4b15c5d122 None None] MFA Rules not processed for user `a34c9912665e403b8170a3cdb0045d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:35:56.416808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3be2ca7d-c651-45b4-a80c-bb4b15c5d122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:56.546429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1016/2062] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:35:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:35:56.660404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:56.702094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae3416-b346-46ee-b560-61cd56843bf8 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:56.704221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1bae3416-b346-46ee-b560-61cd56843bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:35:56.768307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae3416-b346-46ee-b560-61cd56843bf8 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:56.772306 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c96e3e-f98a-4e13-b6d1-8c1c25ef7533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:56.772971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c96e3e-f98a-4e13-b6d1-8c1c25ef7533 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:56.773247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c96e3e-f98a-4e13-b6d1-8c1c25ef7533 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:56.773508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c96e3e-f98a-4e13-b6d1-8c1c25ef7533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:56.783523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c96e3e-f98a-4e13-b6d1-8c1c25ef7533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:56.785159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c96e3e-f98a-4e13-b6d1-8c1c25ef7533 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:56.795208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1047/2063] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:56.980915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:57.214082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2ca7d-c651-45b4-a80c-bb4b15c5d122 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:35:57.224991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2ca7d-c651-45b4-a80c-bb4b15c5d122 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:35:57.228804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d33d-dab8-4a6e-9042-0bb13fa94bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:35:57.229415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d33d-dab8-4a6e-9042-0bb13fa94bed service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:35:57.229741 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d33d-dab8-4a6e-9042-0bb13fa94bed service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:35:57.230194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d33d-dab8-4a6e-9042-0bb13fa94bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:35:57.305978 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d33d-dab8-4a6e-9042-0bb13fa94bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:35:57.307404 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d33d-dab8-4a6e-9042-0bb13fa94bed service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:35:57.316417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1017/2064] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:35:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:35:59.317964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:35:59.654680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:00.648875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c96e3e-f98a-4e13-b6d1-8c1c25ef7533 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:00.658617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c96e3e-f98a-4e13-b6d1-8c1c25ef7533 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:00.663755 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bee6d-bbe7-42bd-8ae8-892249a9452f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:00.665040 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bee6d-bbe7-42bd-8ae8-892249a9452f service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:00.666491 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bee6d-bbe7-42bd-8ae8-892249a9452f service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:00.666979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bee6d-bbe7-42bd-8ae8-892249a9452f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:00.672469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ee7bee6d-bbe7-42bd-8ae8-892249a9452f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:00.741927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bee6d-bbe7-42bd-8ae8-892249a9452f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:00.743345 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bee6d-bbe7-42bd-8ae8-892249a9452f service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:00.752845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1048/2065] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:00.848627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:01.832159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:02.741796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:02.825538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d33d-dab8-4a6e-9042-0bb13fa94bed service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:02.826955 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4600d33d-dab8-4a6e-9042-0bb13fa94bed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:02.897597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d33d-dab8-4a6e-9042-0bb13fa94bed service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:02.902353 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:02.903011 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:02.903290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:02.903752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] PATH_INFO: `/v3/users/de77603351994570b7041e2ce88110a0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:02.905023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de77603351994570b7041e2ce88110a0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:02.912905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:03.255379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de77603351994570b7041e2ce88110a0'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:03.262386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de77603351994570b7041e2ce88110a0'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:03.263052 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de77603351994570b7041e2ce88110a0'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:03.360853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de77603351994570b7041e2ce88110a0'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:03.374243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de77603351994570b7041e2ce88110a0'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:03.381038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1018/2066] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:02 2022] DELETE /identity/v3/users/de77603351994570b7041e2ce88110a0 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:03.385527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0498b-c219-492c-ba5a-099cc5680e55 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:03.385823 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0498b-c219-492c-ba5a-099cc5680e55 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:03.386268 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0498b-c219-492c-ba5a-099cc5680e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:03.408801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b3a0498b-c219-492c-ba5a-099cc5680e55 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:03.410013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b3a0498b-c219-492c-ba5a-099cc5680e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:03.480193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1049/2067] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:03.488206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:03.490642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:03.546362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05f0d3-6aa6-42ce-a09b-a2aa3d04280a admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:03.550333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93902007-9bb2-4e6d-8c11-1767b29649cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:03.550947 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93902007-9bb2-4e6d-8c11-1767b29649cd service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:03.551752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93902007-9bb2-4e6d-8c11-1767b29649cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:03.553415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93902007-9bb2-4e6d-8c11-1767b29649cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:03.561283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93902007-9bb2-4e6d-8c11-1767b29649cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:03.562689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93902007-9bb2-4e6d-8c11-1767b29649cd service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:03.573003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1019/2068] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:04.060204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0498b-c219-492c-ba5a-099cc5680e55 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:04.061857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b3a0498b-c219-492c-ba5a-099cc5680e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:04.082019 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0498b-c219-492c-ba5a-099cc5680e55 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:04.087994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:04.089631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:04.089922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:04.090192 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] PATH_INFO: `/v3/projects/68fa71f8c1184afa9432e5cd126a3325` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:04.091358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fa71f8c1184afa9432e5cd126a3325)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:04.094824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:04.198901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:04.250014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fa71f8c1184afa9432e5cd126a3325', 'request_id': 'req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:04.251584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fa71f8c1184afa9432e5cd126a3325', 'request_id': 'req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:04.334285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fa71f8c1184afa9432e5cd126a3325', 'request_id': 'req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:04.348355 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] The token cache is being invalidate because project 68fa71f8c1184afa9432e5cd126a3325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:04.348656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:04.349330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:04.350810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1050/2069] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:04 2022] DELETE /identity/v3/projects/68fa71f8c1184afa9432e5cd126a3325 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:04.354864 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93902007-9bb2-4e6d-8c11-1767b29649cd service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:04.371111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93902007-9bb2-4e6d-8c11-1767b29649cd service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:04.436244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:04.436901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:04.437185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:04.437487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] PATH_INFO: `/v3/users/b47c75126b4d4686925bb1bd03c592bb` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:04.438719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47c75126b4d4686925bb1bd03c592bb)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:04.440763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:04.708993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47c75126b4d4686925bb1bd03c592bb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:04.716553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47c75126b4d4686925bb1bd03c592bb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:04.717411 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47c75126b4d4686925bb1bd03c592bb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:04.791056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47c75126b4d4686925bb1bd03c592bb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:04.806656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47c75126b4d4686925bb1bd03c592bb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:04.813319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:04.815051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:04.815770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1020/2070] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:04 2022] DELETE /identity/v3/users/b47c75126b4d4686925bb1bd03c592bb => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:04.831576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f41cc1-e158-4e37-87bf-ea6e72bbd3b2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:04.903332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a15e2-bbb8-4999-ba8d-59f8ff5f7148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:04.904002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a15e2-bbb8-4999-ba8d-59f8ff5f7148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:04.904289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a15e2-bbb8-4999-ba8d-59f8ff5f7148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:04.904564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a15e2-bbb8-4999-ba8d-59f8ff5f7148 admin admin] PATH_INFO: `/v3/users/90f32bb6a8cc4d67bf26a038e5c8f085` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:04.905782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a15e2-bbb8-4999-ba8d-59f8ff5f7148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f32bb6a8cc4d67bf26a038e5c8f085)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:04.907686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a15e2-bbb8-4999-ba8d-59f8ff5f7148 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:05.196447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-239a15e2-bbb8-4999-ba8d-59f8ff5f7148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f32bb6a8cc4d67bf26a038e5c8f085'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:05.208217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-239a15e2-bbb8-4999-ba8d-59f8ff5f7148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f32bb6a8cc4d67bf26a038e5c8f085'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:05.208938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-239a15e2-bbb8-4999-ba8d-59f8ff5f7148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f32bb6a8cc4d67bf26a038e5c8f085'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:05.209702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-239a15e2-bbb8-4999-ba8d-59f8ff5f7148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f32bb6a8cc4d67bf26a038e5c8f085'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:05.320557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:05.322057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:05.331715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-239a15e2-bbb8-4999-ba8d-59f8ff5f7148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f32bb6a8cc4d67bf26a038e5c8f085'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:05.359270 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d7dea-78b3-4e35-a6d4-d719cd369fd5 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:05.366474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999f987-07ff-4574-a118-d8ebc2eee70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:05.367123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999f987-07ff-4574-a118-d8ebc2eee70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:05.367401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999f987-07ff-4574-a118-d8ebc2eee70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:05.367720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999f987-07ff-4574-a118-d8ebc2eee70c admin admin] PATH_INFO: `/v3/projects/91725248f6e9484897e81c1c72f6aea2` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:05.370870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999f987-07ff-4574-a118-d8ebc2eee70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=91725248f6e9484897e81c1c72f6aea2)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:05.372885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999f987-07ff-4574-a118-d8ebc2eee70c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:05.375788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1051/2071] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:04 2022] DELETE /identity/v3/users/90f32bb6a8cc4d67bf26a038e5c8f085 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:05.381499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75bcd2-0681-4a6c-9dcb-3da0fe834001 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:05.381989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75bcd2-0681-4a6c-9dcb-3da0fe834001 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:05.385606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75bcd2-0681-4a6c-9dcb-3da0fe834001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:05.412714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-aa75bcd2-0681-4a6c-9dcb-3da0fe834001 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:05.414198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-aa75bcd2-0681-4a6c-9dcb-3da0fe834001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:05.481212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1052/2072] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:05.493437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75bcd2-0681-4a6c-9dcb-3da0fe834001 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:05.495148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-aa75bcd2-0681-4a6c-9dcb-3da0fe834001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:05.547788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f999f987-07ff-4574-a118-d8ebc2eee70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91725248f6e9484897e81c1c72f6aea2', 'request_id': 'req-f999f987-07ff-4574-a118-d8ebc2eee70c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:05.554852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f999f987-07ff-4574-a118-d8ebc2eee70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91725248f6e9484897e81c1c72f6aea2', 'request_id': 'req-f999f987-07ff-4574-a118-d8ebc2eee70c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:05.559676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75bcd2-0681-4a6c-9dcb-3da0fe834001 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:05.562735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f999f987-07ff-4574-a118-d8ebc2eee70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91725248f6e9484897e81c1c72f6aea2', 'request_id': 'req-f999f987-07ff-4574-a118-d8ebc2eee70c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:05.610719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425d1ea-0294-4f30-8a78-4c4e695d5851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:05.611354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425d1ea-0294-4f30-8a78-4c4e695d5851 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:05.611666 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425d1ea-0294-4f30-8a78-4c4e695d5851 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:05.611940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425d1ea-0294-4f30-8a78-4c4e695d5851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:05.626902 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:05.654875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f999f987-07ff-4574-a118-d8ebc2eee70c admin admin] The token cache is being invalidate because project 91725248f6e9484897e81c1c72f6aea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:05.655326 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f999f987-07ff-4574-a118-d8ebc2eee70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:05.656047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f999f987-07ff-4574-a118-d8ebc2eee70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:05.657782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1021/2073] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:05 2022] DELETE /identity/v3/projects/91725248f6e9484897e81c1c72f6aea2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:05.662997 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0cff1-4e18-461c-bcaf-088ad31e4633 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:05.663286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0cff1-4e18-461c-bcaf-088ad31e4633 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:05.663561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0cff1-4e18-461c-bcaf-088ad31e4633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:05.677488 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425d1ea-0294-4f30-8a78-4c4e695d5851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:05.678908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425d1ea-0294-4f30-8a78-4c4e695d5851 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:05.683255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4df0cff1-4e18-461c-bcaf-088ad31e4633 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:05.684491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4df0cff1-4e18-461c-bcaf-088ad31e4633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:05.688616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1053/2074] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:36:05.693261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1022/2075] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:05.702063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6361df6-b8b1-49d7-b566-013b4eb584c6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:05.702352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6361df6-b8b1-49d7-b566-013b4eb584c6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:05.702622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6361df6-b8b1-49d7-b566-013b4eb584c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:05.722762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f6361df6-b8b1-49d7-b566-013b4eb584c6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:05.724539 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f6361df6-b8b1-49d7-b566-013b4eb584c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:05.735808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1054/2076] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:05.737049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0cff1-4e18-461c-bcaf-088ad31e4633 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:05.747106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0cff1-4e18-461c-bcaf-088ad31e4633 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:05.753142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca247b34-bdc1-4ef1-b075-af95906f3842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:05.753756 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca247b34-bdc1-4ef1-b075-af95906f3842 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:05.754044 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca247b34-bdc1-4ef1-b075-af95906f3842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:05.754320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca247b34-bdc1-4ef1-b075-af95906f3842 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:05.755111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca247b34-bdc1-4ef1-b075-af95906f3842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:05.755294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca247b34-bdc1-4ef1-b075-af95906f3842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:05.757107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca247b34-bdc1-4ef1-b075-af95906f3842 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:05.775373 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1023/2077] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:36:05.777250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6361df6-b8b1-49d7-b566-013b4eb584c6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:05.788026 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6361df6-b8b1-49d7-b566-013b4eb584c6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:05.795636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed864c3-56df-4ac5-a4a8-46029946f2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:05.796296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed864c3-56df-4ac5-a4a8-46029946f2cd admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:05.796729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed864c3-56df-4ac5-a4a8-46029946f2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:05.797038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed864c3-56df-4ac5-a4a8-46029946f2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:05.797711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed864c3-56df-4ac5-a4a8-46029946f2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:05.799631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed864c3-56df-4ac5-a4a8-46029946f2cd admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:05.984121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1055/2078] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:05 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:05.993898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca247b34-bdc1-4ef1-b075-af95906f3842 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:06.003909 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca247b34-bdc1-4ef1-b075-af95906f3842 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:06.061174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe42cc-e8bc-4cca-8694-cb075724d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:06.061782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe42cc-e8bc-4cca-8694-cb075724d46c admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:06.062056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe42cc-e8bc-4cca-8694-cb075724d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:06.062350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe42cc-e8bc-4cca-8694-cb075724d46c admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:06.062998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe42cc-e8bc-4cca-8694-cb075724d46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:06.064976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe42cc-e8bc-4cca-8694-cb075724d46c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:06.232332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1024/2079] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:05 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:06.233422 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed864c3-56df-4ac5-a4a8-46029946f2cd admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:06.235599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3ed864c3-56df-4ac5-a4a8-46029946f2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:06.235843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe42cc-e8bc-4cca-8694-cb075724d46c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:06.246745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe42cc-e8bc-4cca-8694-cb075724d46c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:06.251649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dc260-2202-4b1f-982c-78d2ff516ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:06.252413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dc260-2202-4b1f-982c-78d2ff516ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:06.254443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dc260-2202-4b1f-982c-78d2ff516ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:06.254443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dc260-2202-4b1f-982c-78d2ff516ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:06.254443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7dc260-2202-4b1f-982c-78d2ff516ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:06.255361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7dc260-2202-4b1f-982c-78d2ff516ac9 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:06.256650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed864c3-56df-4ac5-a4a8-46029946f2cd admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:06.266100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:06.266778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:06.267057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:06.267330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] PATH_INFO: `/v3/projects/2471f8afbd33469cb5ee16a39b14a183` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:06.267854 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1025/2080] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:36:06.268755 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=2471f8afbd33469cb5ee16a39b14a183)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:06.270750 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:06.271553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dc260-2202-4b1f-982c-78d2ff516ac9 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:06.283567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dc260-2202-4b1f-982c-78d2ff516ac9 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:06.290103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7ffc1-7de1-4270-8eda-6e76631b1fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:06.290712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7ffc1-7de1-4270-8eda-6e76631b1fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:06.290992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7ffc1-7de1-4270-8eda-6e76631b1fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:06.291264 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7ffc1-7de1-4270-8eda-6e76631b1fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:06.291916 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7ffc1-7de1-4270-8eda-6e76631b1fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:06.293874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7ffc1-7de1-4270-8eda-6e76631b1fe5 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:06.304791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1026/2081] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:36:06.308972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7ffc1-7de1-4270-8eda-6e76631b1fe5 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:06.319109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7ffc1-7de1-4270-8eda-6e76631b1fe5 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:06.323887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50212c-4b51-44ec-97b6-992df44954f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:06.324729 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50212c-4b51-44ec-97b6-992df44954f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:06.325013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50212c-4b51-44ec-97b6-992df44954f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:06.325284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50212c-4b51-44ec-97b6-992df44954f5 admin admin] PATH_INFO: `/v3/projects/5d67661fc1ef4822a2bf98d88b8fcd31/users/f0bf327a1aaa4d39be73d0bfd92c82a9/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:06.340327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50212c-4b51-44ec-97b6-992df44954f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d67661fc1ef4822a2bf98d88b8fcd31, user_id=f0bf327a1aaa4d39be73d0bfd92c82a9, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:06.342981 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50212c-4b51-44ec-97b6-992df44954f5 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:06.451405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1027/2082] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:06 2022] PUT /identity/v3/projects/5d67661fc1ef4822a2bf98d88b8fcd31/users/f0bf327a1aaa4d39be73d0bfd92c82a9/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:06.459940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2471f8afbd33469cb5ee16a39b14a183', 'request_id': 'req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:06.463995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5226aa4-8461-45c9-862a-95a41df182ec None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:06.464288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5226aa4-8461-45c9-862a-95a41df182ec None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:06.464566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5226aa4-8461-45c9-862a-95a41df182ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:06.467762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2471f8afbd33469cb5ee16a39b14a183', 'request_id': 'req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:06.500503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d5226aa4-8461-45c9-862a-95a41df182ec None None] MFA Rules not processed for user `f0bf327a1aaa4d39be73d0bfd92c82a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:06.501722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d5226aa4-8461-45c9-862a-95a41df182ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:06.539714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2471f8afbd33469cb5ee16a39b14a183', 'request_id': 'req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:06.557347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] The token cache is being invalidate because project 2471f8afbd33469cb5ee16a39b14a183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:06.557857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:06.558708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:06.563051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1056/2083] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:06 2022] DELETE /identity/v3/projects/2471f8afbd33469cb5ee16a39b14a183 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:06.568635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:06.570112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:06.621631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1028/2084] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:06.633834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5226aa4-8461-45c9-862a-95a41df182ec None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:06.635352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d5226aa4-8461-45c9-862a-95a41df182ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:06.676637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b566ac-17d4-467b-ad2a-24a3f7da96ac admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:06.682129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbca634-34e6-480d-a981-565a83b5b891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:06.682863 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbca634-34e6-480d-a981-565a83b5b891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:06.683211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbca634-34e6-480d-a981-565a83b5b891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:06.683792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbca634-34e6-480d-a981-565a83b5b891 admin admin] PATH_INFO: `/v3/users/a34c9912665e403b8170a3cdb0045d3f` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:06.685049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbca634-34e6-480d-a981-565a83b5b891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34c9912665e403b8170a3cdb0045d3f)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:06.687415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbca634-34e6-480d-a981-565a83b5b891 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:06.704109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5226aa4-8461-45c9-862a-95a41df182ec None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:06.709622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b08ec-4f8f-4bc4-9a4e-fdfe05249d6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:06.710276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b08ec-4f8f-4bc4-9a4e-fdfe05249d6c service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:06.710550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b08ec-4f8f-4bc4-9a4e-fdfe05249d6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:06.710819 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b08ec-4f8f-4bc4-9a4e-fdfe05249d6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:06.720065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b08ec-4f8f-4bc4-9a4e-fdfe05249d6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:06.721495 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b08ec-4f8f-4bc4-9a4e-fdfe05249d6c service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:06.731656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1029/2085] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:36:06.750717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b08ec-4f8f-4bc4-9a4e-fdfe05249d6c service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:06.752194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-698b08ec-4f8f-4bc4-9a4e-fdfe05249d6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:06.766174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b08ec-4f8f-4bc4-9a4e-fdfe05249d6c service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:06.771389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:06.772061 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:06.772362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:06.772631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] PATH_INFO: `/v3/users/f0bf327a1aaa4d39be73d0bfd92c82a9` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:06.773753 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0bf327a1aaa4d39be73d0bfd92c82a9)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:06.775631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:06.919397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fbbca634-34e6-480d-a981-565a83b5b891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34c9912665e403b8170a3cdb0045d3f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:06.926385 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fbbca634-34e6-480d-a981-565a83b5b891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34c9912665e403b8170a3cdb0045d3f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:06.927056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fbbca634-34e6-480d-a981-565a83b5b891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34c9912665e403b8170a3cdb0045d3f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:06.927666 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fbbca634-34e6-480d-a981-565a83b5b891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34c9912665e403b8170a3cdb0045d3f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.003973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0bf327a1aaa4d39be73d0bfd92c82a9'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.011327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0bf327a1aaa4d39be73d0bfd92c82a9'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.012107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0bf327a1aaa4d39be73d0bfd92c82a9'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.065222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fbbca634-34e6-480d-a981-565a83b5b891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34c9912665e403b8170a3cdb0045d3f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.084861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1057/2086] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:06 2022] DELETE /identity/v3/users/a34c9912665e403b8170a3cdb0045d3f => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:07.150801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0bf327a1aaa4d39be73d0bfd92c82a9'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.163752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0bf327a1aaa4d39be73d0bfd92c82a9'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.169878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1030/2087] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:06 2022] DELETE /identity/v3/users/f0bf327a1aaa4d39be73d0bfd92c82a9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:07.174440 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbd4a5-a60d-4ce4-ac63-b8be5b751e0a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:07.174726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbd4a5-a60d-4ce4-ac63-b8be5b751e0a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:07.174999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbd4a5-a60d-4ce4-ac63-b8be5b751e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:07.194895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-21fbd4a5-a60d-4ce4-ac63-b8be5b751e0a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:07.196219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-21fbd4a5-a60d-4ce4-ac63-b8be5b751e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:07.218288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:07.219690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:07.257184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1058/2088] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:07.273713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbd4a5-a60d-4ce4-ac63-b8be5b751e0a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:07.273713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-21fbd4a5-a60d-4ce4-ac63-b8be5b751e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:07.291744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca38f0-1c70-4702-b4c6-8266ac7094cb admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:07.298226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69346dfb-181c-43b0-a5e3-06983aa221b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:07.299105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69346dfb-181c-43b0-a5e3-06983aa221b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:07.299533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69346dfb-181c-43b0-a5e3-06983aa221b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:07.300020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69346dfb-181c-43b0-a5e3-06983aa221b2 admin admin] PATH_INFO: `/v3/users/af33914f57134e97ac5a5f4d30153d2b` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:07.301691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69346dfb-181c-43b0-a5e3-06983aa221b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af33914f57134e97ac5a5f4d30153d2b)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:07.304333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69346dfb-181c-43b0-a5e3-06983aa221b2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:07.350023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbd4a5-a60d-4ce4-ac63-b8be5b751e0a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:07.353786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17663f25-573b-432b-8697-a704530b4c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:07.354390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17663f25-573b-432b-8697-a704530b4c50 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:07.354670 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17663f25-573b-432b-8697-a704530b4c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:07.354942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17663f25-573b-432b-8697-a704530b4c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:07.365215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17663f25-573b-432b-8697-a704530b4c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:07.367039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17663f25-573b-432b-8697-a704530b4c50 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:07.379490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1059/2089] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:36:07.556525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-69346dfb-181c-43b0-a5e3-06983aa221b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af33914f57134e97ac5a5f4d30153d2b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.564210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-69346dfb-181c-43b0-a5e3-06983aa221b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af33914f57134e97ac5a5f4d30153d2b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.564885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-69346dfb-181c-43b0-a5e3-06983aa221b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af33914f57134e97ac5a5f4d30153d2b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.588160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17663f25-573b-432b-8697-a704530b4c50 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:07.588160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-17663f25-573b-432b-8697-a704530b4c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:07.601424 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17663f25-573b-432b-8697-a704530b4c50 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:07.608688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:07.609425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:07.609823 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:07.610104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] PATH_INFO: `/v3/projects/d6c5c8281a1449c5be8e8be1df223c77` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:07.611395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c5c8281a1449c5be8e8be1df223c77)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:07.613850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:07.687998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-69346dfb-181c-43b0-a5e3-06983aa221b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af33914f57134e97ac5a5f4d30153d2b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.701786 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-69346dfb-181c-43b0-a5e3-06983aa221b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af33914f57134e97ac5a5f4d30153d2b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.708717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1031/2090] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:07 2022] DELETE /identity/v3/users/af33914f57134e97ac5a5f4d30153d2b => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:07.713013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6991ce7-5b34-4968-90b3-7693f6b3d1c1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:07.713312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6991ce7-5b34-4968-90b3-7693f6b3d1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:07.713577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6991ce7-5b34-4968-90b3-7693f6b3d1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:07.732644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d6991ce7-5b34-4968-90b3-7693f6b3d1c1 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:07.733838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d6991ce7-5b34-4968-90b3-7693f6b3d1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:07.760600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c5c8281a1449c5be8e8be1df223c77', 'request_id': 'req-71d8539c-3a39-4d16-8761-1c2d8046d57d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.771024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c5c8281a1449c5be8e8be1df223c77', 'request_id': 'req-71d8539c-3a39-4d16-8761-1c2d8046d57d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.808470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1032/2091] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:07.820963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6991ce7-5b34-4968-90b3-7693f6b3d1c1 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:07.822546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d6991ce7-5b34-4968-90b3-7693f6b3d1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:07.896321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6991ce7-5b34-4968-90b3-7693f6b3d1c1 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:07.940032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c5c8281a1449c5be8e8be1df223c77', 'request_id': 'req-71d8539c-3a39-4d16-8761-1c2d8046d57d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.949562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] The token cache is being invalidate because project d6c5c8281a1449c5be8e8be1df223c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:07.949995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.951132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:07.956234 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1060/2092] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:07 2022] DELETE /identity/v3/projects/d6c5c8281a1449c5be8e8be1df223c77 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:07.956234 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:07.956234 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:07.992342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3fc91-399e-4c42-ab15-08727014f7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:07.992954 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3fc91-399e-4c42-ab15-08727014f7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:07.993229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3fc91-399e-4c42-ab15-08727014f7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:07.993502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3fc91-399e-4c42-ab15-08727014f7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:07.995430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7ee3fc91-399e-4c42-ab15-08727014f7f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:08.026527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8539c-3a39-4d16-8761-1c2d8046d57d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:08.031384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64d853-c310-4652-a615-e7516e8ac8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:08.032132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64d853-c310-4652-a615-e7516e8ac8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.032760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64d853-c310-4652-a615-e7516e8ac8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.032867 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64d853-c310-4652-a615-e7516e8ac8fa admin admin] PATH_INFO: `/v3/projects/5d67661fc1ef4822a2bf98d88b8fcd31` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.034099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64d853-c310-4652-a615-e7516e8ac8fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d67661fc1ef4822a2bf98d88b8fcd31)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:08.036103 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64d853-c310-4652-a615-e7516e8ac8fa admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:08.062064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3fc91-399e-4c42-ab15-08727014f7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:08.063614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3fc91-399e-4c42-ab15-08727014f7f8 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:08.073695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1033/2093] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:36:08.074945 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100884f2-969f-4fc5-9010-15d95cf908ca None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.075244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100884f2-969f-4fc5-9010-15d95cf908ca None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.075479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100884f2-969f-4fc5-9010-15d95cf908ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.095339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-100884f2-969f-4fc5-9010-15d95cf908ca None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:08.096575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-100884f2-969f-4fc5-9010-15d95cf908ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:08.104875 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1034/2094] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:08.113048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291adb-208e-49bd-8ec4-4902f3a0a88d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.113863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291adb-208e-49bd-8ec4-4902f3a0a88d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.114252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291adb-208e-49bd-8ec4-4902f3a0a88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.134243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e5291adb-208e-49bd-8ec4-4902f3a0a88d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:08.135432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e5291adb-208e-49bd-8ec4-4902f3a0a88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:08.143364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1035/2095] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:08.147378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291adb-208e-49bd-8ec4-4902f3a0a88d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:08.156577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291adb-208e-49bd-8ec4-4902f3a0a88d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:08.169620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164b94-9788-4974-95bd-53d1fa9d6c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:08.169620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164b94-9788-4974-95bd-53d1fa9d6c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.169620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164b94-9788-4974-95bd-53d1fa9d6c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.169620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164b94-9788-4974-95bd-53d1fa9d6c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.169918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04164b94-9788-4974-95bd-53d1fa9d6c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:08.169918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04164b94-9788-4974-95bd-53d1fa9d6c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:08.169918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04164b94-9788-4974-95bd-53d1fa9d6c9d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:08.185650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1036/2096] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:36:08.186591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164b94-9788-4974-95bd-53d1fa9d6c9d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:08.198560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164b94-9788-4974-95bd-53d1fa9d6c9d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:08.210905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ec64d853-c310-4652-a615-e7516e8ac8fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d67661fc1ef4822a2bf98d88b8fcd31', 'request_id': 'req-ec64d853-c310-4652-a615-e7516e8ac8fa'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:08.219853 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ec64d853-c310-4652-a615-e7516e8ac8fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d67661fc1ef4822a2bf98d88b8fcd31', 'request_id': 'req-ec64d853-c310-4652-a615-e7516e8ac8fa'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:08.259714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26b408-639a-4300-85c1-7c93e6df71e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:08.260403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26b408-639a-4300-85c1-7c93e6df71e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.260681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26b408-639a-4300-85c1-7c93e6df71e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.260953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26b408-639a-4300-85c1-7c93e6df71e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.261609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26b408-639a-4300-85c1-7c93e6df71e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:08.263493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26b408-639a-4300-85c1-7c93e6df71e6 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:08.293651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ec64d853-c310-4652-a615-e7516e8ac8fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d67661fc1ef4822a2bf98d88b8fcd31', 'request_id': 'req-ec64d853-c310-4652-a615-e7516e8ac8fa'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:08.306838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ec64d853-c310-4652-a615-e7516e8ac8fa admin admin] The token cache is being invalidate because project 5d67661fc1ef4822a2bf98d88b8fcd31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:08.307128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ec64d853-c310-4652-a615-e7516e8ac8fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:08.308424 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ec64d853-c310-4652-a615-e7516e8ac8fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:08.310320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1061/2097] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:07 2022] DELETE /identity/v3/projects/5d67661fc1ef4822a2bf98d88b8fcd31 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:08.316399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1dd4c-5962-48ee-adff-ab4b19d5e52c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.318987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1dd4c-5962-48ee-adff-ab4b19d5e52c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.318987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1dd4c-5962-48ee-adff-ab4b19d5e52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.358882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-26b1dd4c-5962-48ee-adff-ab4b19d5e52c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:08.360222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-26b1dd4c-5962-48ee-adff-ab4b19d5e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:08.376687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1062/2098] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:08.378079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e994793-aba1-4e9f-861c-58ca27f8d757 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.382637 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1037/2099] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:08 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:36:08.383977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e994793-aba1-4e9f-861c-58ca27f8d757 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.384315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e994793-aba1-4e9f-861c-58ca27f8d757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.392685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26b408-639a-4300-85c1-7c93e6df71e6 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:08.394753 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2b26b408-639a-4300-85c1-7c93e6df71e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:08.412433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6e994793-aba1-4e9f-861c-58ca27f8d757 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:08.413880 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6e994793-aba1-4e9f-861c-58ca27f8d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:08.504435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1063/2100] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:08.509377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e994793-aba1-4e9f-861c-58ca27f8d757 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:08.512868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26b408-639a-4300-85c1-7c93e6df71e6 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:08.518921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e994793-aba1-4e9f-861c-58ca27f8d757 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:08.519714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a24831-08a5-4eaf-b3bc-1d8367e409ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:08.520377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a24831-08a5-4eaf-b3bc-1d8367e409ee admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.520670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a24831-08a5-4eaf-b3bc-1d8367e409ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.521016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a24831-08a5-4eaf-b3bc-1d8367e409ee admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.521783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a24831-08a5-4eaf-b3bc-1d8367e409ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:08.524293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a24831-08a5-4eaf-b3bc-1d8367e409ee admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:08.524552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cc947-3798-40e3-9c00-3e84b1cbfec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:08.525396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cc947-3798-40e3-9c00-3e84b1cbfec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.525888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cc947-3798-40e3-9c00-3e84b1cbfec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.526358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cc947-3798-40e3-9c00-3e84b1cbfec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.527352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cc947-3798-40e3-9c00-3e84b1cbfec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:08.527730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cc947-3798-40e3-9c00-3e84b1cbfec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:08.530020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cc947-3798-40e3-9c00-3e84b1cbfec9 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:08.544100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1064/2101] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:36:08.549919 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cc947-3798-40e3-9c00-3e84b1cbfec9 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:08.561329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cc947-3798-40e3-9c00-3e84b1cbfec9 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:08.565924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2922d9-f3dc-4671-8e01-f128625c73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:08.566568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2922d9-f3dc-4671-8e01-f128625c73e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.566810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2922d9-f3dc-4671-8e01-f128625c73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.567111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2922d9-f3dc-4671-8e01-f128625c73e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.567762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2922d9-f3dc-4671-8e01-f128625c73e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:08.569666 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2922d9-f3dc-4671-8e01-f128625c73e7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:08.677405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1038/2102] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:08 2022] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:36:08.681456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a24831-08a5-4eaf-b3bc-1d8367e409ee admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:08.690999 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a24831-08a5-4eaf-b3bc-1d8367e409ee admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:08.695672 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5568bce-3096-4622-9bbd-208504cca741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:08.696268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5568bce-3096-4622-9bbd-208504cca741 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.696542 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5568bce-3096-4622-9bbd-208504cca741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.696808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5568bce-3096-4622-9bbd-208504cca741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.697432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5568bce-3096-4622-9bbd-208504cca741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:08.699092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5568bce-3096-4622-9bbd-208504cca741 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:08.709964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1039/2103] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:36:08.712367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:08.721324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5568bce-3096-4622-9bbd-208504cca741 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:08.723752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1065/2104] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:08 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:08.725223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2922d9-f3dc-4671-8e01-f128625c73e7 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:08.726856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4f2922d9-f3dc-4671-8e01-f128625c73e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:08.733357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5568bce-3096-4622-9bbd-208504cca741 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:08.792020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578412b3-e931-46c6-bb84-7b07770f53c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:08.792638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578412b3-e931-46c6-bb84-7b07770f53c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.792985 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578412b3-e931-46c6-bb84-7b07770f53c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.793292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578412b3-e931-46c6-bb84-7b07770f53c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.793940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578412b3-e931-46c6-bb84-7b07770f53c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:08.795625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578412b3-e931-46c6-bb84-7b07770f53c1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:08.804226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2922d9-f3dc-4671-8e01-f128625c73e7 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:08.809676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1040/2105] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:36:08.809676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578412b3-e931-46c6-bb84-7b07770f53c1 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:08.810170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:08.810170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.810170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.810450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] PATH_INFO: `/v3/projects/2fcfd780d8b6468ca27dce5cadeab526` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.811508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcfd780d8b6468ca27dce5cadeab526)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:08.813463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:08.817924 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578412b3-e931-46c6-bb84-7b07770f53c1 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:08.822564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9ab6-a5dd-46a5-906c-19ef9d1f5f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:08.823158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9ab6-a5dd-46a5-906c-19ef9d1f5f78 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.823440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9ab6-a5dd-46a5-906c-19ef9d1f5f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.823717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9ab6-a5dd-46a5-906c-19ef9d1f5f78 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.824376 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9ab6-a5dd-46a5-906c-19ef9d1f5f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:08.826358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9ab6-a5dd-46a5-906c-19ef9d1f5f78 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:08.920685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1041/2106] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:08 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:08.920685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9ab6-a5dd-46a5-906c-19ef9d1f5f78 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:08.928587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9ab6-a5dd-46a5-906c-19ef9d1f5f78 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:08.933616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e34db-767d-41c8-8275-d2d113a47772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:08.934297 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e34db-767d-41c8-8275-d2d113a47772 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:08.934688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e34db-767d-41c8-8275-d2d113a47772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:08.934992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e34db-767d-41c8-8275-d2d113a47772 admin admin] PATH_INFO: `/v3/projects/42915b656f0d452fbe3f86345a41b81d/users/69c0e00c938f43f084f203752631e8c4/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:08.946538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcfd780d8b6468ca27dce5cadeab526', 'request_id': 'req-f4329c56-0b54-493d-a5fd-0bedebd8c493'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:08.952351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcfd780d8b6468ca27dce5cadeab526', 'request_id': 'req-f4329c56-0b54-493d-a5fd-0bedebd8c493'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:08.956689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e34db-767d-41c8-8275-d2d113a47772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42915b656f0d452fbe3f86345a41b81d, user_id=69c0e00c938f43f084f203752631e8c4, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:08.959986 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e34db-767d-41c8-8275-d2d113a47772 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:08.996944 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:09.024465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcfd780d8b6468ca27dce5cadeab526', 'request_id': 'req-f4329c56-0b54-493d-a5fd-0bedebd8c493'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.036728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] The token cache is being invalidate because project 2fcfd780d8b6468ca27dce5cadeab526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:09.037021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.037686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.039264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1066/2107] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:08 2022] DELETE /identity/v3/projects/2fcfd780d8b6468ca27dce5cadeab526 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:09.040225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:09.041628 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:09.092540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1042/2108] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:08 2022] PUT /identity/v3/projects/42915b656f0d452fbe3f86345a41b81d/users/69c0e00c938f43f084f203752631e8c4/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:09.093592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e34db-767d-41c8-8275-d2d113a47772 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:09.095231 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7a9e34db-767d-41c8-8275-d2d113a47772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:09.104192 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4329c56-0b54-493d-a5fd-0bedebd8c493 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:09.159427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d6970-3853-429d-a278-64b258f2c5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:09.160139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d6970-3853-429d-a278-64b258f2c5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:09.160931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d6970-3853-429d-a278-64b258f2c5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:09.161200 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d6970-3853-429d-a278-64b258f2c5d2 admin admin] PATH_INFO: `/v3/users/9277204080fb4bc8801181a4903971c4` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:09.162346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d6970-3853-429d-a278-64b258f2c5d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9277204080fb4bc8801181a4903971c4)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:09.162476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e34db-767d-41c8-8275-d2d113a47772 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:09.164266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d6970-3853-429d-a278-64b258f2c5d2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:09.167181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92fdb4-5489-4c81-bac9-7449cfa930dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:09.167793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92fdb4-5489-4c81-bac9-7449cfa930dc admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:09.168102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92fdb4-5489-4c81-bac9-7449cfa930dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:09.168374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92fdb4-5489-4c81-bac9-7449cfa930dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:09.169015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92fdb4-5489-4c81-bac9-7449cfa930dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:09.170589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92fdb4-5489-4c81-bac9-7449cfa930dc admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:09.180958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1043/2109] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:09.181767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92fdb4-5489-4c81-bac9-7449cfa930dc admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:09.185543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0a92fdb4-5489-4c81-bac9-7449cfa930dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:09.198252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92fdb4-5489-4c81-bac9-7449cfa930dc admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:09.202913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd20f7-cfa8-4342-a32e-16c8f8eb882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:09.205712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd20f7-cfa8-4342-a32e-16c8f8eb882f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:09.205712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd20f7-cfa8-4342-a32e-16c8f8eb882f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:09.205712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd20f7-cfa8-4342-a32e-16c8f8eb882f admin admin] PATH_INFO: `/v3/users/582d1fca8dfc4b50b789e3ad91e03321` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:09.205712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd20f7-cfa8-4342-a32e-16c8f8eb882f admin admin] RBAC: Authorizing `identity:delete_user(user_id=582d1fca8dfc4b50b789e3ad91e03321)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:09.207103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd20f7-cfa8-4342-a32e-16c8f8eb882f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:09.392220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-904d6970-3853-429d-a278-64b258f2c5d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9277204080fb4bc8801181a4903971c4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.399501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-904d6970-3853-429d-a278-64b258f2c5d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9277204080fb4bc8801181a4903971c4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.400195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-904d6970-3853-429d-a278-64b258f2c5d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9277204080fb4bc8801181a4903971c4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.400811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-904d6970-3853-429d-a278-64b258f2c5d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9277204080fb4bc8801181a4903971c4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.404675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-35dd20f7-cfa8-4342-a32e-16c8f8eb882f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582d1fca8dfc4b50b789e3ad91e03321'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.412232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-35dd20f7-cfa8-4342-a32e-16c8f8eb882f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582d1fca8dfc4b50b789e3ad91e03321'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.412933 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-35dd20f7-cfa8-4342-a32e-16c8f8eb882f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582d1fca8dfc4b50b789e3ad91e03321'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.522263 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-904d6970-3853-429d-a278-64b258f2c5d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9277204080fb4bc8801181a4903971c4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.543806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1067/2110] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:09 2022] DELETE /identity/v3/users/9277204080fb4bc8801181a4903971c4 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:09.545169 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fc286-ed93-4688-bbc7-d35112261fcc None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:09.545463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fc286-ed93-4688-bbc7-d35112261fcc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:09.545739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fc286-ed93-4688-bbc7-d35112261fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:09.574354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a11fc286-ed93-4688-bbc7-d35112261fcc None None] MFA Rules not processed for user `69c0e00c938f43f084f203752631e8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:09.575578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a11fc286-ed93-4688-bbc7-d35112261fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:09.625460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-35dd20f7-cfa8-4342-a32e-16c8f8eb882f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582d1fca8dfc4b50b789e3ad91e03321'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.638348 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-35dd20f7-cfa8-4342-a32e-16c8f8eb882f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582d1fca8dfc4b50b789e3ad91e03321'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:09.641935 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1068/2111] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:09.643045 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fc286-ed93-4688-bbc7-d35112261fcc None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:09.651008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1044/2112] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:09 2022] DELETE /identity/v3/users/582d1fca8dfc4b50b789e3ad91e03321 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:09.652095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11e8a7-1455-41ae-84a1-ff9b5320819b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:09.652402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11e8a7-1455-41ae-84a1-ff9b5320819b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:09.652661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11e8a7-1455-41ae-84a1-ff9b5320819b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:09.656167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a11fc286-ed93-4688-bbc7-d35112261fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:09.700675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-7c11e8a7-1455-41ae-84a1-ff9b5320819b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:09.702458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7c11e8a7-1455-41ae-84a1-ff9b5320819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:09.740016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fc286-ed93-4688-bbc7-d35112261fcc None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:09.787199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1045/2113] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:09.788079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11e8a7-1455-41ae-84a1-ff9b5320819b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:09.797819 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7c11e8a7-1455-41ae-84a1-ff9b5320819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:09.811433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777ed24-0cfd-4311-b804-ead6a78f69a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:09.812092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777ed24-0cfd-4311-b804-ead6a78f69a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:09.812397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777ed24-0cfd-4311-b804-ead6a78f69a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:09.812811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777ed24-0cfd-4311-b804-ead6a78f69a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:09.813465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777ed24-0cfd-4311-b804-ead6a78f69a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:09.818840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11e8a7-1455-41ae-84a1-ff9b5320819b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:09.818963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777ed24-0cfd-4311-b804-ead6a78f69a4 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:09.820284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2c67-9bb5-4d62-8d9a-f29894427f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:09.821087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2c67-9bb5-4d62-8d9a-f29894427f8a admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:09.821558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2c67-9bb5-4d62-8d9a-f29894427f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:09.822009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2c67-9bb5-4d62-8d9a-f29894427f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:09.822847 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e2c67-9bb5-4d62-8d9a-f29894427f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:09.825205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e2c67-9bb5-4d62-8d9a-f29894427f8a admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:09.825778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1069/2114] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:09.826617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777ed24-0cfd-4311-b804-ead6a78f69a4 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:09.830347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3777ed24-0cfd-4311-b804-ead6a78f69a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:09.890160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777ed24-0cfd-4311-b804-ead6a78f69a4 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:09.895426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a599-14f4-477b-b357-fc2970bf4ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:09.895426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a599-14f4-477b-b357-fc2970bf4ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:09.895426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a599-14f4-477b-b357-fc2970bf4ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:09.895426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a599-14f4-477b-b357-fc2970bf4ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:09.904722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635a599-14f4-477b-b357-fc2970bf4ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:09.906143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635a599-14f4-477b-b357-fc2970bf4ac5 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:09.926819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1070/2115] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:09.927753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a599-14f4-477b-b357-fc2970bf4ac5 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:09.932288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1046/2116] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:09 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:09.938017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a599-14f4-477b-b357-fc2970bf4ac5 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:09.942559 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2c67-9bb5-4d62-8d9a-f29894427f8a admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:10.022236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72961d2b-8b2f-43ba-99c7-0690933a09a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:10.023221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72961d2b-8b2f-43ba-99c7-0690933a09a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:10.023698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72961d2b-8b2f-43ba-99c7-0690933a09a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:10.025307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72961d2b-8b2f-43ba-99c7-0690933a09a0 admin admin] PATH_INFO: `/v3/projects/389811cc9255401d9a7010be0ab16541/users/3e6b77e4bcd14137a60a35fe09d37de3/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:10.040223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2c67-9bb5-4d62-8d9a-f29894427f8a admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:10.045136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72961d2b-8b2f-43ba-99c7-0690933a09a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389811cc9255401d9a7010be0ab16541, user_id=3e6b77e4bcd14137a60a35fe09d37de3, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:10.048771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd489-c17c-4898-b23d-d640877489ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:10.048993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72961d2b-8b2f-43ba-99c7-0690933a09a0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:10.049867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd489-c17c-4898-b23d-d640877489ac admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:10.050225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd489-c17c-4898-b23d-d640877489ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:10.050653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd489-c17c-4898-b23d-d640877489ac admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:10.051816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfd489-c17c-4898-b23d-d640877489ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:10.054422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfd489-c17c-4898-b23d-d640877489ac admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:10.129861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1071/2117] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:09 2022] PUT /identity/v3/projects/389811cc9255401d9a7010be0ab16541/users/3e6b77e4bcd14137a60a35fe09d37de3/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:10.141458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47841bd-b214-4b5d-b22c-99441b8e17e1 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:10.141827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47841bd-b214-4b5d-b22c-99441b8e17e1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:10.142138 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47841bd-b214-4b5d-b22c-99441b8e17e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:10.174270 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1047/2118] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:09 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:10.177382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f47841bd-b214-4b5d-b22c-99441b8e17e1 None None] MFA Rules not processed for user `3e6b77e4bcd14137a60a35fe09d37de3`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:10.178892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f47841bd-b214-4b5d-b22c-99441b8e17e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:10.181864 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd489-c17c-4898-b23d-d640877489ac admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:10.201121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd489-c17c-4898-b23d-d640877489ac admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:10.256644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1072/2119] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:10.260516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47841bd-b214-4b5d-b22c-99441b8e17e1 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:10.306728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39243bb-187a-48e4-bd02-1edae038e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:10.306728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39243bb-187a-48e4-bd02-1edae038e36c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:10.306728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39243bb-187a-48e4-bd02-1edae038e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:10.306728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39243bb-187a-48e4-bd02-1edae038e36c admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:10.307279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39243bb-187a-48e4-bd02-1edae038e36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:10.309108 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39243bb-187a-48e4-bd02-1edae038e36c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:10.320738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1048/2120] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:10.325116 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39243bb-187a-48e4-bd02-1edae038e36c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:10.341062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39243bb-187a-48e4-bd02-1edae038e36c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:10.349339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab34b46-f90f-495c-bc5e-27dc135feb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:10.350235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab34b46-f90f-495c-bc5e-27dc135feb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:10.350864 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab34b46-f90f-495c-bc5e-27dc135feb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:10.351287 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab34b46-f90f-495c-bc5e-27dc135feb8c admin admin] PATH_INFO: `/v3/projects/a05effb7610d41e5a0ee49f2e001e532/users/17bfc23cfe81477d913c057d0f95dbbf/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:10.363722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47841bd-b214-4b5d-b22c-99441b8e17e1 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:10.371433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f350ff-b8c9-44e4-bda9-d393b84cf6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:10.372245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f350ff-b8c9-44e4-bda9-d393b84cf6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:10.372599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f350ff-b8c9-44e4-bda9-d393b84cf6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:10.372876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f350ff-b8c9-44e4-bda9-d393b84cf6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:10.373728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f350ff-b8c9-44e4-bda9-d393b84cf6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:10.373963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab34b46-f90f-495c-bc5e-27dc135feb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05effb7610d41e5a0ee49f2e001e532, user_id=17bfc23cfe81477d913c057d0f95dbbf, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:10.376609 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f350ff-b8c9-44e4-bda9-d393b84cf6d1 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:10.377027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab34b46-f90f-495c-bc5e-27dc135feb8c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:10.482991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1049/2121] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:10 2022] PUT /identity/v3/projects/a05effb7610d41e5a0ee49f2e001e532/users/17bfc23cfe81477d913c057d0f95dbbf/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:10.483837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab34b46-f90f-495c-bc5e-27dc135feb8c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:10.485789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4ab34b46-f90f-495c-bc5e-27dc135feb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:10.525325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1073/2122] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:10 2022] POST /identity/v3/projects => generated 373 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:10.526970 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f350ff-b8c9-44e4-bda9-d393b84cf6d1 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:10.570485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab34b46-f90f-495c-bc5e-27dc135feb8c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:10.612961 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f350ff-b8c9-44e4-bda9-d393b84cf6d1 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:10.618740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b123c-89f9-4450-91c1-fb9fd0b67361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:10.619345 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b123c-89f9-4450-91c1-fb9fd0b67361 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:10.619630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b123c-89f9-4450-91c1-fb9fd0b67361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:10.619922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b123c-89f9-4450-91c1-fb9fd0b67361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:10.620629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b123c-89f9-4450-91c1-fb9fd0b67361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:10.622212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b123c-89f9-4450-91c1-fb9fd0b67361 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:10.636333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1074/2123] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:10.636521 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:10.642899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b123c-89f9-4450-91c1-fb9fd0b67361 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:10.643028 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:10.643028 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:10.643028 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] PATH_INFO: `/v3/projects/037e7ec7211d40d5ae3b5eb3af2c7aad` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:10.643248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d56b123c-89f9-4450-91c1-fb9fd0b67361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:10.643342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=037e7ec7211d40d5ae3b5eb3af2c7aad)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:10.643342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:10.650232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b123c-89f9-4450-91c1-fb9fd0b67361 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:10.655050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:10.655743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:10.655983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:10.656263 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] PATH_INFO: `/v3/projects/7ea438a20fae4acf807f604618c2c45c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:10.657413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea438a20fae4acf807f604618c2c45c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:10.659335 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:10.792319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea438a20fae4acf807f604618c2c45c', 'request_id': 'req-3da7422a-0689-432c-a257-411b7dee867f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:10.792991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '037e7ec7211d40d5ae3b5eb3af2c7aad', 'request_id': 'req-7f26faf0-c320-412c-87fe-8c3979e3a629'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:10.798887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea438a20fae4acf807f604618c2c45c', 'request_id': 'req-3da7422a-0689-432c-a257-411b7dee867f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:10.799350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '037e7ec7211d40d5ae3b5eb3af2c7aad', 'request_id': 'req-7f26faf0-c320-412c-87fe-8c3979e3a629'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:10.806066 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '037e7ec7211d40d5ae3b5eb3af2c7aad', 'request_id': 'req-7f26faf0-c320-412c-87fe-8c3979e3a629'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:10.892336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea438a20fae4acf807f604618c2c45c', 'request_id': 'req-3da7422a-0689-432c-a257-411b7dee867f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:10.906765 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] The token cache is being invalidate because project 7ea438a20fae4acf807f604618c2c45c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:10.906989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:10.915758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:10.918209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1075/2124] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:10 2022] DELETE /identity/v3/projects/7ea438a20fae4acf807f604618c2c45c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:10.922874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:10.924362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:10.956829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] The token cache is being invalidate because project 037e7ec7211d40d5ae3b5eb3af2c7aad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:10.957538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:10.958647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:10.960401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1050/2125] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:10 2022] DELETE /identity/v3/projects/037e7ec7211d40d5ae3b5eb3af2c7aad => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:10.961209 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:10.962951 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:11.000303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7422a-0689-432c-a257-411b7dee867f admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.006051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b873bff-8a0c-47a2-953e-7b3b1f36a9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.006705 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873bff-8a0c-47a2-953e-7b3b1f36a9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.006989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873bff-8a0c-47a2-953e-7b3b1f36a9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.007276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873bff-8a0c-47a2-953e-7b3b1f36a9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.007936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b873bff-8a0c-47a2-953e-7b3b1f36a9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.009866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b873bff-8a0c-47a2-953e-7b3b1f36a9d5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:11.043100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:11.043842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26faf0-c320-412c-87fe-8c3979e3a629 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.048775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd9cca-e3f7-49ae-9a5b-1b899083a719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.049447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd9cca-e3f7-49ae-9a5b-1b899083a719 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.049726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd9cca-e3f7-49ae-9a5b-1b899083a719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.050034 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd9cca-e3f7-49ae-9a5b-1b899083a719 admin admin] PATH_INFO: `/v3/projects/a05effb7610d41e5a0ee49f2e001e532/users/17bfc23cfe81477d913c057d0f95dbbf/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.052629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd9cca-e3f7-49ae-9a5b-1b899083a719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05effb7610d41e5a0ee49f2e001e532, user_id=17bfc23cfe81477d913c057d0f95dbbf, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.055408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd9cca-e3f7-49ae-9a5b-1b899083a719 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:11.067633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1051/2126] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:10 2022] PUT /identity/v3/projects/a05effb7610d41e5a0ee49f2e001e532/users/17bfc23cfe81477d913c057d0f95dbbf/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:11.068694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87e743-9502-4ec3-bef6-e9a20fa0e6b0 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.069055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87e743-9502-4ec3-bef6-e9a20fa0e6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.069402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87e743-9502-4ec3-bef6-e9a20fa0e6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.089810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-2a87e743-9502-4ec3-bef6-e9a20fa0e6b0 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:11.091025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2a87e743-9502-4ec3-bef6-e9a20fa0e6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:11.122436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1076/2127] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:10 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:11.122436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80cbb5-0428-4ae9-89ea-480aad78ec05 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.122436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80cbb5-0428-4ae9-89ea-480aad78ec05 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.122436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80cbb5-0428-4ae9-89ea-480aad78ec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.147284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4b80cbb5-0428-4ae9-89ea-480aad78ec05 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:11.152320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4b80cbb5-0428-4ae9-89ea-480aad78ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:11.165370 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1052/2128] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:11.166571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fb244-4515-4477-bfc0-465ceebb2d1a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.167086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fb244-4515-4477-bfc0-465ceebb2d1a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.167192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fb244-4515-4477-bfc0-465ceebb2d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.201360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-7e3fb244-4515-4477-bfc0-465ceebb2d1a None None] MFA Rules not processed for user `17bfc23cfe81477d913c057d0f95dbbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:11.203034 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7e3fb244-4515-4477-bfc0-465ceebb2d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:11.225465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1077/2129] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:11.226325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80cbb5-0428-4ae9-89ea-480aad78ec05 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:11.228284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4b80cbb5-0428-4ae9-89ea-480aad78ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:11.242147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80cbb5-0428-4ae9-89ea-480aad78ec05 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.246946 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bfe48-011e-4a88-bf46-1014c5a83457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.247616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bfe48-011e-4a88-bf46-1014c5a83457 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.248020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bfe48-011e-4a88-bf46-1014c5a83457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.248376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bfe48-011e-4a88-bf46-1014c5a83457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.249092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bfe48-011e-4a88-bf46-1014c5a83457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.250738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bfe48-011e-4a88-bf46-1014c5a83457 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:11.261457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1078/2130] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:11.262724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab964ec-03ce-49bd-b566-2f8191efcd3e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.263003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab964ec-03ce-49bd-b566-2f8191efcd3e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.263275 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab964ec-03ce-49bd-b566-2f8191efcd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.282215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1053/2131] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:11.283470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8116d16-920d-48af-a636-9b322c096b10 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.283587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-eab964ec-03ce-49bd-b566-2f8191efcd3e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:11.283754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8116d16-920d-48af-a636-9b322c096b10 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.284059 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8116d16-920d-48af-a636-9b322c096b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.284911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-eab964ec-03ce-49bd-b566-2f8191efcd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:11.297626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1079/2132] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:11.298489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab964ec-03ce-49bd-b566-2f8191efcd3e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:11.307796 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e8116d16-920d-48af-a636-9b322c096b10 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:11.309107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e8116d16-920d-48af-a636-9b322c096b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:11.310749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab964ec-03ce-49bd-b566-2f8191efcd3e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.315462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2e9e7-cf43-46f2-93f3-1661b48bfe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.316112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2e9e7-cf43-46f2-93f3-1661b48bfe2a admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.316988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2e9e7-cf43-46f2-93f3-1661b48bfe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.320141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2e9e7-cf43-46f2-93f3-1661b48bfe2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.320290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1054/2133] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:11.320390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2e9e7-cf43-46f2-93f3-1661b48bfe2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.320476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8116d16-920d-48af-a636-9b322c096b10 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:11.320552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2e9e7-cf43-46f2-93f3-1661b48bfe2a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:11.322412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e8116d16-920d-48af-a636-9b322c096b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:11.331674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1080/2134] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:11.332699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2e9e7-cf43-46f2-93f3-1661b48bfe2a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:11.344441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2e9e7-cf43-46f2-93f3-1661b48bfe2a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.349717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4164-8fa5-487e-919f-ac8c55bb4cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.350309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4164-8fa5-487e-919f-ac8c55bb4cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.350588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4164-8fa5-487e-919f-ac8c55bb4cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.350860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4164-8fa5-487e-919f-ac8c55bb4cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.351501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f4164-8fa5-487e-919f-ac8c55bb4cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:11.351802 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f4164-8fa5-487e-919f-ac8c55bb4cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.353481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f4164-8fa5-487e-919f-ac8c55bb4cd0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:11.365726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1081/2135] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:36:11.366630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4164-8fa5-487e-919f-ac8c55bb4cd0 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:11.376331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4164-8fa5-487e-919f-ac8c55bb4cd0 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.381528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a3227-9c68-4999-aef3-0f96ef0f85ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.382118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a3227-9c68-4999-aef3-0f96ef0f85ff admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.382383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a3227-9c68-4999-aef3-0f96ef0f85ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.382654 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a3227-9c68-4999-aef3-0f96ef0f85ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.383286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a3227-9c68-4999-aef3-0f96ef0f85ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:11.383588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a3227-9c68-4999-aef3-0f96ef0f85ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.383698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8116d16-920d-48af-a636-9b322c096b10 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.385178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a3227-9c68-4999-aef3-0f96ef0f85ff admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:11.387386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd74ae-7ff7-4eca-8ce4-0f769da851be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.388137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd74ae-7ff7-4eca-8ce4-0f769da851be service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.388417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd74ae-7ff7-4eca-8ce4-0f769da851be service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.388687 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd74ae-7ff7-4eca-8ce4-0f769da851be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.397307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1082/2136] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:36:11.398075 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a3227-9c68-4999-aef3-0f96ef0f85ff admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:11.401948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd74ae-7ff7-4eca-8ce4-0f769da851be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.403419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd74ae-7ff7-4eca-8ce4-0f769da851be service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:11.415505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a3227-9c68-4999-aef3-0f96ef0f85ff admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.415505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a245b7b-508c-427d-9d78-72eb67fef0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.415505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a245b7b-508c-427d-9d78-72eb67fef0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.415505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a245b7b-508c-427d-9d78-72eb67fef0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.415993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1055/2137] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:11.416106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a245b7b-508c-427d-9d78-72eb67fef0fc admin admin] PATH_INFO: `/v3/projects/50bcf3875f9c4962823263faab5366e5/users/1dd56036c919401383a001557ecfd75a/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.416208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd74ae-7ff7-4eca-8ce4-0f769da851be service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:11.424332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd74ae-7ff7-4eca-8ce4-0f769da851be service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.429542 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7237bc-9af3-4a11-8b8d-c1b203173fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.429790 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a245b7b-508c-427d-9d78-72eb67fef0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=50bcf3875f9c4962823263faab5366e5, user_id=1dd56036c919401383a001557ecfd75a, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.430265 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7237bc-9af3-4a11-8b8d-c1b203173fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.430604 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7237bc-9af3-4a11-8b8d-c1b203173fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.431060 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7237bc-9af3-4a11-8b8d-c1b203173fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.431755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7237bc-9af3-4a11-8b8d-c1b203173fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.432804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a245b7b-508c-427d-9d78-72eb67fef0fc admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:11.433793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7237bc-9af3-4a11-8b8d-c1b203173fa1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:11.522164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:11.576129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1083/2138] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:11 2022] PUT /identity/v3/projects/50bcf3875f9c4962823263faab5366e5/users/1dd56036c919401383a001557ecfd75a/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:11.589751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a245b7b-508c-427d-9d78-72eb67fef0fc admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:11.590758 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1056/2139] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:11 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:11.593762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bd55c-2f02-4a13-80f4-01bf36221b6b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.594056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bd55c-2f02-4a13-80f4-01bf36221b6b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.594330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bd55c-2f02-4a13-80f4-01bf36221b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.627973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3a7bd55c-2f02-4a13-80f4-01bf36221b6b None None] MFA Rules not processed for user `1dd56036c919401383a001557ecfd75a`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:11.629824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3a7bd55c-2f02-4a13-80f4-01bf36221b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:11.686171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a245b7b-508c-427d-9d78-72eb67fef0fc admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.719829 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1057/2140] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:11.720839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bd55c-2f02-4a13-80f4-01bf36221b6b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:11.750508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9daec-009b-491b-b388-43c825fff8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.751190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9daec-009b-491b-b388-43c825fff8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.752300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9daec-009b-491b-b388-43c825fff8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.752300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9daec-009b-491b-b388-43c825fff8e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.752778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9daec-009b-491b-b388-43c825fff8e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.756746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9daec-009b-491b-b388-43c825fff8e0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:11.790110 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bd55c-2f02-4a13-80f4-01bf36221b6b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.794876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4ee6a-0428-40ea-a512-09da0960ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.797549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ee6a-0428-40ea-a512-09da0960ccd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.797733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ee6a-0428-40ea-a512-09da0960ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.798010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ee6a-0428-40ea-a512-09da0960ccd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.798653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4ee6a-0428-40ea-a512-09da0960ccd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.801234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4ee6a-0428-40ea-a512-09da0960ccd8 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:11.846778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1084/2141] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:11 2022] POST /identity/v3/projects => generated 375 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:11.846778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9daec-009b-491b-b388-43c825fff8e0 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:11.918278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9daec-009b-491b-b388-43c825fff8e0 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.923358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dae1e-c7f6-409e-9b72-dc493d7b9887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.923986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dae1e-c7f6-409e-9b72-dc493d7b9887 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.924263 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dae1e-c7f6-409e-9b72-dc493d7b9887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.924533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dae1e-c7f6-409e-9b72-dc493d7b9887 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.925246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dae1e-c7f6-409e-9b72-dc493d7b9887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.930220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dae1e-c7f6-409e-9b72-dc493d7b9887 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:11.934896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1058/2142] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:11 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:11.939528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4ee6a-0428-40ea-a512-09da0960ccd8 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:11.951491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4ee6a-0428-40ea-a512-09da0960ccd8 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:11.956382 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e3915-f63c-44fe-a059-6f79d020f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:11.957562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e3915-f63c-44fe-a059-6f79d020f1aa admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:11.957844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e3915-f63c-44fe-a059-6f79d020f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:11.958115 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e3915-f63c-44fe-a059-6f79d020f1aa admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:11.958745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e3915-f63c-44fe-a059-6f79d020f1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:11.960704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e3915-f63c-44fe-a059-6f79d020f1aa admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:12.093046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1059/2143] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:11 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:12.093046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e3915-f63c-44fe-a059-6f79d020f1aa admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:12.096015 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1085/2144] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:11 2022] POST /identity/v3/projects => generated 377 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:12.097326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dae1e-c7f6-409e-9b72-dc493d7b9887 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:12.102377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e3915-f63c-44fe-a059-6f79d020f1aa admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:12.163037 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75984644-e24b-45a3-90a3-51144d900a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:12.163660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75984644-e24b-45a3-90a3-51144d900a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.163935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75984644-e24b-45a3-90a3-51144d900a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.164257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75984644-e24b-45a3-90a3-51144d900a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.164910 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75984644-e24b-45a3-90a3-51144d900a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:12.165381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dae1e-c7f6-409e-9b72-dc493d7b9887 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:12.166521 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75984644-e24b-45a3-90a3-51144d900a0a admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:12.170685 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:12.171320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.171688 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.171908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] PATH_INFO: `/v3/users/69c0e00c938f43f084f203752631e8c4` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.176177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c0e00c938f43f084f203752631e8c4)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:12.176177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:12.177435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1060/2145] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:12.178248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75984644-e24b-45a3-90a3-51144d900a0a admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:12.188000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75984644-e24b-45a3-90a3-51144d900a0a admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:12.193179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea1c2b-7dbb-4a2b-a0fa-396c90d765f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:12.193762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea1c2b-7dbb-4a2b-a0fa-396c90d765f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.194036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea1c2b-7dbb-4a2b-a0fa-396c90d765f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.194306 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea1c2b-7dbb-4a2b-a0fa-396c90d765f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.194953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea1c2b-7dbb-4a2b-a0fa-396c90d765f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:12.196748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea1c2b-7dbb-4a2b-a0fa-396c90d765f2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:12.207719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1061/2146] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:12.208726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea1c2b-7dbb-4a2b-a0fa-396c90d765f2 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:12.218442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea1c2b-7dbb-4a2b-a0fa-396c90d765f2 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:12.223884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716170f4-39b6-4f1f-8c43-809c0b554c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:12.224506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716170f4-39b6-4f1f-8c43-809c0b554c71 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.224810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716170f4-39b6-4f1f-8c43-809c0b554c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.225079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716170f4-39b6-4f1f-8c43-809c0b554c71 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.225691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716170f4-39b6-4f1f-8c43-809c0b554c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:12.227560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716170f4-39b6-4f1f-8c43-809c0b554c71 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:12.326698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1062/2147] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:12 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:12.326698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716170f4-39b6-4f1f-8c43-809c0b554c71 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:12.334491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716170f4-39b6-4f1f-8c43-809c0b554c71 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:12.339257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6127-5aeb-47ea-8f00-60c1e3301f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:12.339851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6127-5aeb-47ea-8f00-60c1e3301f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.340182 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6127-5aeb-47ea-8f00-60c1e3301f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.340459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6127-5aeb-47ea-8f00-60c1e3301f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.341103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d6127-5aeb-47ea-8f00-60c1e3301f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:12.342681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d6127-5aeb-47ea-8f00-60c1e3301f7f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:12.353369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1063/2148] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:12.354189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6127-5aeb-47ea-8f00-60c1e3301f7f admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:12.366046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6127-5aeb-47ea-8f00-60c1e3301f7f admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:12.370894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c2b79-5655-4392-a3a9-2263430ebbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:12.372215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c2b79-5655-4392-a3a9-2263430ebbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.372584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c2b79-5655-4392-a3a9-2263430ebbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.372857 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c2b79-5655-4392-a3a9-2263430ebbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.373499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c2b79-5655-4392-a3a9-2263430ebbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:12.375079 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c2b79-5655-4392-a3a9-2263430ebbb8 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:12.386187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1064/2149] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:12.387087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c2b79-5655-4392-a3a9-2263430ebbb8 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:12.392990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c0e00c938f43f084f203752631e8c4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:12.399791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c2b79-5655-4392-a3a9-2263430ebbb8 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:12.401459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c0e00c938f43f084f203752631e8c4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:12.402137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c0e00c938f43f084f203752631e8c4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:12.403347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c0e00c938f43f084f203752631e8c4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:12.405380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517d70f-4f8a-4cf1-b0c3-57e15ecc5266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:12.406111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517d70f-4f8a-4cf1-b0c3-57e15ecc5266 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.406579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517d70f-4f8a-4cf1-b0c3-57e15ecc5266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.407091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517d70f-4f8a-4cf1-b0c3-57e15ecc5266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.407695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517d70f-4f8a-4cf1-b0c3-57e15ecc5266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:12.409375 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517d70f-4f8a-4cf1-b0c3-57e15ecc5266 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:12.410912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:12.419961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1065/2150] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:12.420701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517d70f-4f8a-4cf1-b0c3-57e15ecc5266 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:12.422963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7517d70f-4f8a-4cf1-b0c3-57e15ecc5266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:12.435564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517d70f-4f8a-4cf1-b0c3-57e15ecc5266 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:12.440162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbad828-e8d3-4cd9-9f75-dd9fba7b89e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:12.440782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbad828-e8d3-4cd9-9f75-dd9fba7b89e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.441058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbad828-e8d3-4cd9-9f75-dd9fba7b89e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.450097 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbad828-e8d3-4cd9-9f75-dd9fba7b89e4 admin admin] PATH_INFO: `/v3/projects/6dee7cc197cd409a81a42688c1822773/users/c705c6c099984e81bb19accec1602e31/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.455177 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbad828-e8d3-4cd9-9f75-dd9fba7b89e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dee7cc197cd409a81a42688c1822773, user_id=c705c6c099984e81bb19accec1602e31, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:12.458759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbad828-e8d3-4cd9-9f75-dd9fba7b89e4 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:12.499143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c0e00c938f43f084f203752631e8c4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:12.517068 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1086/2151] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:12 2022] DELETE /identity/v3/users/69c0e00c938f43f084f203752631e8c4 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:12.520774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:12.520774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:12.579292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1066/2152] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:12 2022] PUT /identity/v3/projects/6dee7cc197cd409a81a42688c1822773/users/c705c6c099984e81bb19accec1602e31/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:12.582397 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbad828-e8d3-4cd9-9f75-dd9fba7b89e4 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:12.583324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5bbad828-e8d3-4cd9-9f75-dd9fba7b89e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:12.584728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a598e94-f7ec-41b1-a490-3d817c46482c admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:12.644130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19abba1-ff81-4641-aaae-2e110fda3826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:12.645315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19abba1-ff81-4641-aaae-2e110fda3826 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.645597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19abba1-ff81-4641-aaae-2e110fda3826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.645875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19abba1-ff81-4641-aaae-2e110fda3826 admin admin] PATH_INFO: `/v3/projects/c5ce65180c104c678af797f1001548fa/users/5a0322e46e56463ca97f73e3a7d0e6fb/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.653245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbad828-e8d3-4cd9-9f75-dd9fba7b89e4 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:12.657881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58a539-2fc0-468f-a1dd-6dde36fd982f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:12.658532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58a539-2fc0-468f-a1dd-6dde36fd982f admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.658816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58a539-2fc0-468f-a1dd-6dde36fd982f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.659080 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58a539-2fc0-468f-a1dd-6dde36fd982f admin admin] PATH_INFO: `/v3/projects/87fc84b3dbb74d37ae57d77c7d3e7dde/users/37616e4fea314e75832fbaddcab7238f/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.660775 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19abba1-ff81-4641-aaae-2e110fda3826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ce65180c104c678af797f1001548fa, user_id=5a0322e46e56463ca97f73e3a7d0e6fb, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:12.663650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19abba1-ff81-4641-aaae-2e110fda3826 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:12.674327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58a539-2fc0-468f-a1dd-6dde36fd982f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fc84b3dbb74d37ae57d77c7d3e7dde, user_id=37616e4fea314e75832fbaddcab7238f, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:12.677369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58a539-2fc0-468f-a1dd-6dde36fd982f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:12.727331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1087/2153] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:12 2022] PUT /identity/v3/projects/c5ce65180c104c678af797f1001548fa/users/5a0322e46e56463ca97f73e3a7d0e6fb/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:12.729251 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7ab46-5a09-47e1-9270-51498782af8d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.729590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7ab46-5a09-47e1-9270-51498782af8d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.729897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7ab46-5a09-47e1-9270-51498782af8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.748514 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2ca7ab46-5a09-47e1-9270-51498782af8d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:12.749723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2ca7ab46-5a09-47e1-9270-51498782af8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:12.806769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1088/2154] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:12.808030 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ef650-fe6c-433e-87e8-e4d18ae2013c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.808319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ef650-fe6c-433e-87e8-e4d18ae2013c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.808590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ef650-fe6c-433e-87e8-e4d18ae2013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.817429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1067/2155] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:12 2022] PUT /identity/v3/projects/87fc84b3dbb74d37ae57d77c7d3e7dde/users/37616e4fea314e75832fbaddcab7238f/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:12.818688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c046-17bc-4273-8106-17b5cfcbc96d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.818967 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c046-17bc-4273-8106-17b5cfcbc96d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.819727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c046-17bc-4273-8106-17b5cfcbc96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.839931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d98ef650-fe6c-433e-87e8-e4d18ae2013c None None] MFA Rules not processed for user `c705c6c099984e81bb19accec1602e31`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:12.841152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d98ef650-fe6c-433e-87e8-e4d18ae2013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:12.847284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-32a1c046-17bc-4273-8106-17b5cfcbc96d None None] MFA Rules not processed for user `5a0322e46e56463ca97f73e3a7d0e6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:12.848491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-32a1c046-17bc-4273-8106-17b5cfcbc96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:12.904565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1089/2156] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:12.905499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ef650-fe6c-433e-87e8-e4d18ae2013c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:12.909562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d98ef650-fe6c-433e-87e8-e4d18ae2013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:12.922023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1068/2157] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:12.922023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1c046-17bc-4273-8106-17b5cfcbc96d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:12.974557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ef650-fe6c-433e-87e8-e4d18ae2013c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:12.978349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef20d9-9c6a-4670-bd13-533dbeac43f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:12.978950 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef20d9-9c6a-4670-bd13-533dbeac43f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.979231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef20d9-9c6a-4670-bd13-533dbeac43f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.979512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef20d9-9c6a-4670-bd13-533dbeac43f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.983752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1c046-17bc-4273-8106-17b5cfcbc96d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:12.988532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54e5d0-ed1d-4772-bee5-86fb903b23d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:12.989038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef20d9-9c6a-4670-bd13-533dbeac43f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:12.989274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54e5d0-ed1d-4772-bee5-86fb903b23d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:12.989614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54e5d0-ed1d-4772-bee5-86fb903b23d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:12.989945 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54e5d0-ed1d-4772-bee5-86fb903b23d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:12.990466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef20d9-9c6a-4670-bd13-533dbeac43f1 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:12.990713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54e5d0-ed1d-4772-bee5-86fb903b23d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:12.992380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54e5d0-ed1d-4772-bee5-86fb903b23d1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:13.000381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1090/2158] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:13.001243 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef20d9-9c6a-4670-bd13-533dbeac43f1 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:13.006429 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-32ef20d9-9c6a-4670-bd13-533dbeac43f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:13.006567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1069/2159] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:13.006567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54e5d0-ed1d-4772-bee5-86fb903b23d1 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:13.007780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6e54e5d0-ed1d-4772-bee5-86fb903b23d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:13.079002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54e5d0-ed1d-4772-bee5-86fb903b23d1 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:13.084203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022d3bb-5b32-4094-9111-95fc7d7886d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6462736c485545d8a26766360ebe0c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:13.085052 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022d3bb-5b32-4094-9111-95fc7d7886d3 service glance] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:13.085332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022d3bb-5b32-4094-9111-95fc7d7886d3 service glance] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:13.085601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022d3bb-5b32-4094-9111-95fc7d7886d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:13.092044 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef20d9-9c6a-4670-bd13-533dbeac43f1 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:13.095246 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022d3bb-5b32-4094-9111-95fc7d7886d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:13.096722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022d3bb-5b32-4094-9111-95fc7d7886d3 service glance] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:13.097062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5a630-683c-4e2b-8af0-cb31630aa1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:13.097757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5a630-683c-4e2b-8af0-cb31630aa1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:13.098039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5a630-683c-4e2b-8af0-cb31630aa1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:13.098313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5a630-683c-4e2b-8af0-cb31630aa1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:13.107478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1070/2160] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:13.107656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5a630-683c-4e2b-8af0-cb31630aa1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:13.108447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022d3bb-5b32-4094-9111-95fc7d7886d3 service glance] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:13.109261 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5a630-683c-4e2b-8af0-cb31630aa1b9 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:13.119412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1091/2161] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:13.123246 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022d3bb-5b32-4094-9111-95fc7d7886d3 service glance] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:13.132646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d71b4-5a64-4a25-89d5-221a8864e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:13.133317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d71b4-5a64-4a25-89d5-221a8864e7d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:13.133643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d71b4-5a64-4a25-89d5-221a8864e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:13.134083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d71b4-5a64-4a25-89d5-221a8864e7d1 admin admin] PATH_INFO: `/v3/projects/87fc84b3dbb74d37ae57d77c7d3e7dde/users/37616e4fea314e75832fbaddcab7238f/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:13.136017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d71b4-5a64-4a25-89d5-221a8864e7d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fc84b3dbb74d37ae57d77c7d3e7dde, user_id=37616e4fea314e75832fbaddcab7238f, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:13.140197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d71b4-5a64-4a25-89d5-221a8864e7d1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:13.152198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1071/2162] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:13 2022] PUT /identity/v3/projects/87fc84b3dbb74d37ae57d77c7d3e7dde/users/37616e4fea314e75832fbaddcab7238f/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:13.156653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5a630-683c-4e2b-8af0-cb31630aa1b9 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:13.163017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a669502-3569-42b2-a475-717e6355f9e8 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:13.163101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a669502-3569-42b2-a475-717e6355f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:13.163380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a669502-3569-42b2-a475-717e6355f9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:13.171138 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5a630-683c-4e2b-8af0-cb31630aa1b9 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:13.195880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9a669502-3569-42b2-a475-717e6355f9e8 None None] MFA Rules not processed for user `37616e4fea314e75832fbaddcab7238f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:13.197597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9a669502-3569-42b2-a475-717e6355f9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:13.305320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c52a3-1cef-4bc3-89cc-f3618ba7d1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:13.306387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c52a3-1cef-4bc3-89cc-f3618ba7d1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:13.306769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c52a3-1cef-4bc3-89cc-f3618ba7d1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:13.307163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c52a3-1cef-4bc3-89cc-f3618ba7d1f6 admin admin] PATH_INFO: `/v3/users/c705c6c099984e81bb19accec1602e31` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:13.310049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c52a3-1cef-4bc3-89cc-f3618ba7d1f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c705c6c099984e81bb19accec1602e31)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:13.314358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c52a3-1cef-4bc3-89cc-f3618ba7d1f6 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:13.324562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1072/2163] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:13.340303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:13.395921 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a669502-3569-42b2-a475-717e6355f9e8 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:13.397619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9a669502-3569-42b2-a475-717e6355f9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:13.461762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a669502-3569-42b2-a475-717e6355f9e8 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:13.466966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e498f-7f8f-4795-98ca-2beccd951eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:13.466966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e498f-7f8f-4795-98ca-2beccd951eca service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:13.468343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e498f-7f8f-4795-98ca-2beccd951eca service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:13.468641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e498f-7f8f-4795-98ca-2beccd951eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:13.470898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e35e498f-7f8f-4795-98ca-2beccd951eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:13.527101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-311c52a3-1cef-4bc3-89cc-f3618ba7d1f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c705c6c099984e81bb19accec1602e31'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:13.535049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-311c52a3-1cef-4bc3-89cc-f3618ba7d1f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c705c6c099984e81bb19accec1602e31'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:13.535718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-311c52a3-1cef-4bc3-89cc-f3618ba7d1f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c705c6c099984e81bb19accec1602e31'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:13.536360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-311c52a3-1cef-4bc3-89cc-f3618ba7d1f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c705c6c099984e81bb19accec1602e31'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:13.540416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:13.542280 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e498f-7f8f-4795-98ca-2beccd951eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:13.543735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e498f-7f8f-4795-98ca-2beccd951eca service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:13.554417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1073/2164] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:36:13.560915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e498f-7f8f-4795-98ca-2beccd951eca service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:13.562593 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e35e498f-7f8f-4795-98ca-2beccd951eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:13.577994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e498f-7f8f-4795-98ca-2beccd951eca service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:13.588919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:13.589998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:13.590529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:13.590865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] PATH_INFO: `/v3/projects/42915b656f0d452fbe3f86345a41b81d` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:13.592269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42915b656f0d452fbe3f86345a41b81d)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:13.594374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:13.616320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-311c52a3-1cef-4bc3-89cc-f3618ba7d1f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c705c6c099984e81bb19accec1602e31'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:13.636720 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1092/2165] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:13 2022] DELETE /identity/v3/users/c705c6c099984e81bb19accec1602e31 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:13.641158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502a949-2061-4b53-9bd4-fe351bf3d789 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:13.641534 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502a949-2061-4b53-9bd4-fe351bf3d789 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:13.641912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502a949-2061-4b53-9bd4-fe351bf3d789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:13.661779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e502a949-2061-4b53-9bd4-fe351bf3d789 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:13.663096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e502a949-2061-4b53-9bd4-fe351bf3d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:13.728246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1093/2166] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:13.734711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502a949-2061-4b53-9bd4-fe351bf3d789 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:13.734860 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42915b656f0d452fbe3f86345a41b81d', 'request_id': 'req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:13.736089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e502a949-2061-4b53-9bd4-fe351bf3d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:13.740394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42915b656f0d452fbe3f86345a41b81d', 'request_id': 'req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:13.746840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42915b656f0d452fbe3f86345a41b81d', 'request_id': 'req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:13.794475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502a949-2061-4b53-9bd4-fe351bf3d789 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:13.841763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] The token cache is being invalidate because project 42915b656f0d452fbe3f86345a41b81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:13.842344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:13.842905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:13.843659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f093b-6fad-47a0-8820-fed13397404f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:13.844361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f093b-6fad-47a0-8820-fed13397404f service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:13.844599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1074/2167] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:13 2022] DELETE /identity/v3/projects/42915b656f0d452fbe3f86345a41b81d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:13.844757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f093b-6fad-47a0-8820-fed13397404f service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:13.847728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f093b-6fad-47a0-8820-fed13397404f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:13.848536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:13.849708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0f4f093b-6fad-47a0-8820-fed13397404f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:13.849894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:13.915673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f093b-6fad-47a0-8820-fed13397404f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:13.917602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f093b-6fad-47a0-8820-fed13397404f service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:13.932620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1094/2168] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:36:13.932979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66194d67-6fb3-4cc8-8737-d1ea2d1c8a19 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:13.938468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e1874-74b9-4fd7-b1c4-6a0abf8ce26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:13.939115 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e1874-74b9-4fd7-b1c4-6a0abf8ce26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:13.939393 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e1874-74b9-4fd7-b1c4-6a0abf8ce26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:13.939665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e1874-74b9-4fd7-b1c4-6a0abf8ce26f admin admin] PATH_INFO: `/v3/users/17bfc23cfe81477d913c057d0f95dbbf` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:13.940851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e1874-74b9-4fd7-b1c4-6a0abf8ce26f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bfc23cfe81477d913c057d0f95dbbf)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:13.942792 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e1874-74b9-4fd7-b1c4-6a0abf8ce26f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:14.223460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f68e1874-74b9-4fd7-b1c4-6a0abf8ce26f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bfc23cfe81477d913c057d0f95dbbf'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:14.232420 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f68e1874-74b9-4fd7-b1c4-6a0abf8ce26f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bfc23cfe81477d913c057d0f95dbbf'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:14.233206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f68e1874-74b9-4fd7-b1c4-6a0abf8ce26f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bfc23cfe81477d913c057d0f95dbbf'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:14.322085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f68e1874-74b9-4fd7-b1c4-6a0abf8ce26f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bfc23cfe81477d913c057d0f95dbbf'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:14.340481 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f68e1874-74b9-4fd7-b1c4-6a0abf8ce26f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bfc23cfe81477d913c057d0f95dbbf'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:14.350247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1075/2169] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:13 2022] DELETE /identity/v3/users/17bfc23cfe81477d913c057d0f95dbbf => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:14.402981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f093b-6fad-47a0-8820-fed13397404f service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:14.404545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0f4f093b-6fad-47a0-8820-fed13397404f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:14.416400 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f093b-6fad-47a0-8820-fed13397404f service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:14.496378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3462e5-b515-42db-80ff-3306b3875e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:14.496378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3462e5-b515-42db-80ff-3306b3875e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:14.496764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3462e5-b515-42db-80ff-3306b3875e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:14.496868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3462e5-b515-42db-80ff-3306b3875e54 admin admin] PATH_INFO: `/v3/projects/6dee7cc197cd409a81a42688c1822773` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:14.498572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3462e5-b515-42db-80ff-3306b3875e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dee7cc197cd409a81a42688c1822773)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:14.501062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3462e5-b515-42db-80ff-3306b3875e54 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:14.670625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1a3462e5-b515-42db-80ff-3306b3875e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dee7cc197cd409a81a42688c1822773', 'request_id': 'req-1a3462e5-b515-42db-80ff-3306b3875e54'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:14.678275 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1a3462e5-b515-42db-80ff-3306b3875e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dee7cc197cd409a81a42688c1822773', 'request_id': 'req-1a3462e5-b515-42db-80ff-3306b3875e54'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:14.722748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:14.756013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1a3462e5-b515-42db-80ff-3306b3875e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dee7cc197cd409a81a42688c1822773', 'request_id': 'req-1a3462e5-b515-42db-80ff-3306b3875e54'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:14.768749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1a3462e5-b515-42db-80ff-3306b3875e54 admin admin] The token cache is being invalidate because project 6dee7cc197cd409a81a42688c1822773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:14.769046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1a3462e5-b515-42db-80ff-3306b3875e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:14.769776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1a3462e5-b515-42db-80ff-3306b3875e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:14.771839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1095/2170] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:14 2022] DELETE /identity/v3/projects/6dee7cc197cd409a81a42688c1822773 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:14.776568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bbd5f-2a90-422e-8b0a-bba43a10f012 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:14.776848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bbd5f-2a90-422e-8b0a-bba43a10f012 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:14.777117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bbd5f-2a90-422e-8b0a-bba43a10f012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:14.802026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c03bbd5f-2a90-422e-8b0a-bba43a10f012 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:14.803460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c03bbd5f-2a90-422e-8b0a-bba43a10f012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:14.866693 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1076/2171] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:14.874497 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439b4d-b87a-4287-bad0-03929555d630 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:14.874785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439b4d-b87a-4287-bad0-03929555d630 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:14.875134 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439b4d-b87a-4287-bad0-03929555d630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:14.881072 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bbd5f-2a90-422e-8b0a-bba43a10f012 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:14.884396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c03bbd5f-2a90-422e-8b0a-bba43a10f012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:14.898030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bbd5f-2a90-422e-8b0a-bba43a10f012 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:14.903768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b2382-6d7d-4d60-8143-4f47a9b6e803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:14.904658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b2382-6d7d-4d60-8143-4f47a9b6e803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:14.904937 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b2382-6d7d-4d60-8143-4f47a9b6e803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:14.905207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b2382-6d7d-4d60-8143-4f47a9b6e803 admin admin] PATH_INFO: `/v3/projects/a05effb7610d41e5a0ee49f2e001e532` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:14.906394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b2382-6d7d-4d60-8143-4f47a9b6e803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05effb7610d41e5a0ee49f2e001e532)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:14.909199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b2382-6d7d-4d60-8143-4f47a9b6e803 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:14.912002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8f439b4d-b87a-4287-bad0-03929555d630 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:14.913569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8f439b4d-b87a-4287-bad0-03929555d630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:14.929822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1096/2172] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:14.929822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439b4d-b87a-4287-bad0-03929555d630 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:14.939210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439b4d-b87a-4287-bad0-03929555d630 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:14.944871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b49bf-2c33-4647-a2bb-ce97e483c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:14.945496 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b49bf-2c33-4647-a2bb-ce97e483c56d admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:14.945753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b49bf-2c33-4647-a2bb-ce97e483c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:14.946022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b49bf-2c33-4647-a2bb-ce97e483c56d admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:14.946674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b49bf-2c33-4647-a2bb-ce97e483c56d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:14.946980 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b49bf-2c33-4647-a2bb-ce97e483c56d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:14.948679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b49bf-2c33-4647-a2bb-ce97e483c56d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:14.964509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1097/2173] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:36:14.968989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b49bf-2c33-4647-a2bb-ce97e483c56d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:14.979577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b49bf-2c33-4647-a2bb-ce97e483c56d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:14.985424 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470f16c-d865-434f-85af-483884b7d4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:14.996532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470f16c-d865-434f-85af-483884b7d4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:14.996532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470f16c-d865-434f-85af-483884b7d4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:14.996532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470f16c-d865-434f-85af-483884b7d4d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:14.996532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470f16c-d865-434f-85af-483884b7d4d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:14.996532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470f16c-d865-434f-85af-483884b7d4d7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.042552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-db4b2382-6d7d-4d60-8143-4f47a9b6e803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05effb7610d41e5a0ee49f2e001e532', 'request_id': 'req-db4b2382-6d7d-4d60-8143-4f47a9b6e803'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:15.048669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-db4b2382-6d7d-4d60-8143-4f47a9b6e803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05effb7610d41e5a0ee49f2e001e532', 'request_id': 'req-db4b2382-6d7d-4d60-8143-4f47a9b6e803'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:15.057058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-db4b2382-6d7d-4d60-8143-4f47a9b6e803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05effb7610d41e5a0ee49f2e001e532', 'request_id': 'req-db4b2382-6d7d-4d60-8143-4f47a9b6e803'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:15.155654 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-db4b2382-6d7d-4d60-8143-4f47a9b6e803 admin admin] The token cache is being invalidate because project a05effb7610d41e5a0ee49f2e001e532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:15.156027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-db4b2382-6d7d-4d60-8143-4f47a9b6e803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:15.162565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1098/2174] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:14 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:15.163036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-db4b2382-6d7d-4d60-8143-4f47a9b6e803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:15.163036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1077/2175] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:14 2022] DELETE /identity/v3/projects/a05effb7610d41e5a0ee49f2e001e532 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:15.167405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470f16c-d865-434f-85af-483884b7d4d7 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:15.169238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d470f16c-d865-434f-85af-483884b7d4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:15.172827 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b709c81-9afb-488f-a0f6-c7685c9e9318 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.173198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b709c81-9afb-488f-a0f6-c7685c9e9318 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.173591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b709c81-9afb-488f-a0f6-c7685c9e9318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.195312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-8b709c81-9afb-488f-a0f6-c7685c9e9318 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:15.196838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8b709c81-9afb-488f-a0f6-c7685c9e9318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:15.243095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470f16c-d865-434f-85af-483884b7d4d7 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:15.248888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32004a-71f0-4009-a301-d55222ed6fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:15.249564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32004a-71f0-4009-a301-d55222ed6fce admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.249850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32004a-71f0-4009-a301-d55222ed6fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.250129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32004a-71f0-4009-a301-d55222ed6fce admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.250770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32004a-71f0-4009-a301-d55222ed6fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:15.252715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32004a-71f0-4009-a301-d55222ed6fce admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.268293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1078/2176] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:15.276517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a4d74-541e-4332-b40c-4ec591fd0d8f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.276801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a4d74-541e-4332-b40c-4ec591fd0d8f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.277102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a4d74-541e-4332-b40c-4ec591fd0d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.296650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-303a4d74-541e-4332-b40c-4ec591fd0d8f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:15.297863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-303a4d74-541e-4332-b40c-4ec591fd0d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:15.306803 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1079/2177] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:15.311024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a4d74-541e-4332-b40c-4ec591fd0d8f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:15.320251 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a4d74-541e-4332-b40c-4ec591fd0d8f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:15.325172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbd9ee-91ec-43ea-bb11-ddad425b1643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:15.325768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbd9ee-91ec-43ea-bb11-ddad425b1643 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.326229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbd9ee-91ec-43ea-bb11-ddad425b1643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.326390 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbd9ee-91ec-43ea-bb11-ddad425b1643 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.326991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbd9ee-91ec-43ea-bb11-ddad425b1643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:15.327324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbd9ee-91ec-43ea-bb11-ddad425b1643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:15.328927 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbd9ee-91ec-43ea-bb11-ddad425b1643 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.340740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1080/2178] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:36:15.345073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbd9ee-91ec-43ea-bb11-ddad425b1643 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:15.355439 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbd9ee-91ec-43ea-bb11-ddad425b1643 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:15.366741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1099/2179] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:15 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:15.367008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d281a81-1a25-43ae-9962-8521a5438924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:15.367008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d281a81-1a25-43ae-9962-8521a5438924 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.369899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d281a81-1a25-43ae-9962-8521a5438924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.369899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d281a81-1a25-43ae-9962-8521a5438924 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.369899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d281a81-1a25-43ae-9962-8521a5438924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:15.370470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d281a81-1a25-43ae-9962-8521a5438924 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.370681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32004a-71f0-4009-a301-d55222ed6fce admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:15.382883 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32004a-71f0-4009-a301-d55222ed6fce admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:15.392691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b23ed2-51a8-4f46-8b0b-cc251beeef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:15.393614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b23ed2-51a8-4f46-8b0b-cc251beeef7b admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.394002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b23ed2-51a8-4f46-8b0b-cc251beeef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.394538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b23ed2-51a8-4f46-8b0b-cc251beeef7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.395203 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b23ed2-51a8-4f46-8b0b-cc251beeef7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:15.397003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b23ed2-51a8-4f46-8b0b-cc251beeef7b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.412083 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1100/2180] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:15.413128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b23ed2-51a8-4f46-8b0b-cc251beeef7b admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:15.423359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b23ed2-51a8-4f46-8b0b-cc251beeef7b admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:15.432310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85e974-9d2e-44c5-be2b-460348d04009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:15.433017 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85e974-9d2e-44c5-be2b-460348d04009 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.433302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85e974-9d2e-44c5-be2b-460348d04009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.436387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85e974-9d2e-44c5-be2b-460348d04009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.436387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85e974-9d2e-44c5-be2b-460348d04009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:15.436387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85e974-9d2e-44c5-be2b-460348d04009 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.447633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1101/2181] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:15.451578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85e974-9d2e-44c5-be2b-460348d04009 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:15.462608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85e974-9d2e-44c5-be2b-460348d04009 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:15.468493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f431ed-ec6f-4428-8249-fcb22e125d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:15.469583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f431ed-ec6f-4428-8249-fcb22e125d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.469976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f431ed-ec6f-4428-8249-fcb22e125d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.470350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f431ed-ec6f-4428-8249-fcb22e125d4d admin admin] PATH_INFO: `/v3/projects/4f563ab6038b44498848da63418a438f/users/bc360d9cc7384c4d9e1d1a0eeeaedf83/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.489967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f431ed-ec6f-4428-8249-fcb22e125d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f563ab6038b44498848da63418a438f, user_id=bc360d9cc7384c4d9e1d1a0eeeaedf83, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:15.492702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f431ed-ec6f-4428-8249-fcb22e125d4d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.530308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1081/2182] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:15 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:36:15.534422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d281a81-1a25-43ae-9962-8521a5438924 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:15.598124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d281a81-1a25-43ae-9962-8521a5438924 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:15.603126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e3c2b-3153-4d37-9561-e05be121e187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:15.603732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e3c2b-3153-4d37-9561-e05be121e187 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.604107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e3c2b-3153-4d37-9561-e05be121e187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.604379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e3c2b-3153-4d37-9561-e05be121e187 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.605008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e3c2b-3153-4d37-9561-e05be121e187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:15.607211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e3c2b-3153-4d37-9561-e05be121e187 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.652633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1102/2183] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:15 2022] PUT /identity/v3/projects/4f563ab6038b44498848da63418a438f/users/bc360d9cc7384c4d9e1d1a0eeeaedf83/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:15.664485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e56a7-2748-4ef5-9cb0-c3bad6d84c4c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.664828 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e56a7-2748-4ef5-9cb0-c3bad6d84c4c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.665108 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e56a7-2748-4ef5-9cb0-c3bad6d84c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.694046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ef6e56a7-2748-4ef5-9cb0-c3bad6d84c4c None None] MFA Rules not processed for user `bc360d9cc7384c4d9e1d1a0eeeaedf83`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:15.695211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ef6e56a7-2748-4ef5-9cb0-c3bad6d84c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:15.757565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1082/2184] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:15 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:36:15.764712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e3c2b-3153-4d37-9561-e05be121e187 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:15.779227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1103/2185] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:15.779391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e3c2b-3153-4d37-9561-e05be121e187 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:15.787550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e56a7-2748-4ef5-9cb0-c3bad6d84c4c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:15.788908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ef6e56a7-2748-4ef5-9cb0-c3bad6d84c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:15.836975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d869c-6db8-49b2-8571-ecdc76cff67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:15.837591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d869c-6db8-49b2-8571-ecdc76cff67d admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.837861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d869c-6db8-49b2-8571-ecdc76cff67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.838126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d869c-6db8-49b2-8571-ecdc76cff67d admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.838769 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d869c-6db8-49b2-8571-ecdc76cff67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:15.840373 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d869c-6db8-49b2-8571-ecdc76cff67d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.848763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e56a7-2748-4ef5-9cb0-c3bad6d84c4c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:15.853477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1083/2186] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:15.853477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d869c-6db8-49b2-8571-ecdc76cff67d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:15.853477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-475d869c-6db8-49b2-8571-ecdc76cff67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:15.855666 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c66b81-a949-4971-8427-df9a12b7274b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:15.856847 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c66b81-a949-4971-8427-df9a12b7274b service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.857159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c66b81-a949-4971-8427-df9a12b7274b service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.857560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c66b81-a949-4971-8427-df9a12b7274b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.866547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d869c-6db8-49b2-8571-ecdc76cff67d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:15.867935 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c66b81-a949-4971-8427-df9a12b7274b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:15.870116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c66b81-a949-4971-8427-df9a12b7274b service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.870576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a2342-a586-40d8-ba4a-827842d82ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:15.871873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a2342-a586-40d8-ba4a-827842d82ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.872231 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a2342-a586-40d8-ba4a-827842d82ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.873669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a2342-a586-40d8-ba4a-827842d82ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.874611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7e1a2342-a586-40d8-ba4a-827842d82ad0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:15.882221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1104/2187] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:36:15.883076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c66b81-a949-4971-8427-df9a12b7274b service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:15.896591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c66b81-a949-4971-8427-df9a12b7274b service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:15.902796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d366134-3f04-4bb7-baaa-6f8144c75aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:15.903456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d366134-3f04-4bb7-baaa-6f8144c75aac admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.903873 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d366134-3f04-4bb7-baaa-6f8144c75aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.904242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d366134-3f04-4bb7-baaa-6f8144c75aac admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.904953 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d366134-3f04-4bb7-baaa-6f8144c75aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:15.906638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d366134-3f04-4bb7-baaa-6f8144c75aac admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.923829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:15.926023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1105/2188] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:15.926872 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d366134-3f04-4bb7-baaa-6f8144c75aac admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:15.937203 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d366134-3f04-4bb7-baaa-6f8144c75aac admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:15.944155 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb6a1-ecd4-48e8-ad82-7e46711442d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:15.947914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb6a1-ecd4-48e8-ad82-7e46711442d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:15.947914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb6a1-ecd4-48e8-ad82-7e46711442d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:15.947914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb6a1-ecd4-48e8-ad82-7e46711442d5 admin admin] PATH_INFO: `/v3/projects/f9d392b884cd4959b9c3dba1b9e9fce8/users/73660e87938c44069bccc4a3c752d375/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:15.958177 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a2342-a586-40d8-ba4a-827842d82ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:15.960004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a2342-a586-40d8-ba4a-827842d82ad0 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.968293 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acb6a1-ecd4-48e8-ad82-7e46711442d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d392b884cd4959b9c3dba1b9e9fce8, user_id=73660e87938c44069bccc4a3c752d375, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:15.971469 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acb6a1-ecd4-48e8-ad82-7e46711442d5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:15.972397 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1084/2189] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:16.072132 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1106/2190] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:15 2022] PUT /identity/v3/projects/f9d392b884cd4959b9c3dba1b9e9fce8/users/73660e87938c44069bccc4a3c752d375/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:16.084429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799e1d-228a-486f-af8e-be9cd361e633 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:16.084709 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799e1d-228a-486f-af8e-be9cd361e633 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:16.084976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799e1d-228a-486f-af8e-be9cd361e633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:16.114777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-7e799e1d-228a-486f-af8e-be9cd361e633 None None] MFA Rules not processed for user `73660e87938c44069bccc4a3c752d375`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:16.116195 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7e799e1d-228a-486f-af8e-be9cd361e633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:16.187518 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1085/2191] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:16.192522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb6a1-ecd4-48e8-ad82-7e46711442d5 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:16.219169 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:16.254940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb6a1-ecd4-48e8-ad82-7e46711442d5 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:16.260238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98db10-06b0-4ce7-aacf-9b863ec077c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:16.260841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98db10-06b0-4ce7-aacf-9b863ec077c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:16.261122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98db10-06b0-4ce7-aacf-9b863ec077c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:16.261395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98db10-06b0-4ce7-aacf-9b863ec077c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:16.262094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98db10-06b0-4ce7-aacf-9b863ec077c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:16.264041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98db10-06b0-4ce7-aacf-9b863ec077c3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:16.380449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1107/2192] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:16 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:36:16.384528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e799e1d-228a-486f-af8e-be9cd361e633 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:16.397306 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e799e1d-228a-486f-af8e-be9cd361e633 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:16.458142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75b6e9-29f6-4806-8ba0-13b4fe58bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:16.458770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75b6e9-29f6-4806-8ba0-13b4fe58bf55 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:16.459072 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75b6e9-29f6-4806-8ba0-13b4fe58bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:16.459341 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75b6e9-29f6-4806-8ba0-13b4fe58bf55 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:16.460030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75b6e9-29f6-4806-8ba0-13b4fe58bf55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:16.462063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75b6e9-29f6-4806-8ba0-13b4fe58bf55 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:16.774655 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1086/2193] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:16 2022] POST /identity/v3/users => generated 294 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:16.781143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98db10-06b0-4ce7-aacf-9b863ec077c3 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:16.790889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98db10-06b0-4ce7-aacf-9b863ec077c3 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:16.793839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107863ac-4e7f-442c-9382-0a900e420b6a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:16.794119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107863ac-4e7f-442c-9382-0a900e420b6a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:16.794389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107863ac-4e7f-442c-9382-0a900e420b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:16.796111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afe259-f0f4-4711-a964-eeb49f66e149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:16.796806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afe259-f0f4-4711-a964-eeb49f66e149 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:16.797150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afe259-f0f4-4711-a964-eeb49f66e149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:16.797542 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afe259-f0f4-4711-a964-eeb49f66e149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:16.798259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afe259-f0f4-4711-a964-eeb49f66e149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:16.800031 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afe259-f0f4-4711-a964-eeb49f66e149 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:16.812786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1108/2194] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:16.814202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-107863ac-4e7f-442c-9382-0a900e420b6a None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:16.815446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-107863ac-4e7f-442c-9382-0a900e420b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:16.817729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afe259-f0f4-4711-a964-eeb49f66e149 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:16.829029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afe259-f0f4-4711-a964-eeb49f66e149 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:16.833687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2935c68-6bc8-49b5-883b-d55101cf9a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:16.834341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2935c68-6bc8-49b5-883b-d55101cf9a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:16.834618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2935c68-6bc8-49b5-883b-d55101cf9a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:16.834889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2935c68-6bc8-49b5-883b-d55101cf9a32 admin admin] PATH_INFO: `/v3/projects/cc4ceb50a1ae473b92a3a9bcaa53c08a/users/ba149721d3854625b23fb0a9ef7d8b6a/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:16.851136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2935c68-6bc8-49b5-883b-d55101cf9a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4ceb50a1ae473b92a3a9bcaa53c08a, user_id=ba149721d3854625b23fb0a9ef7d8b6a, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:16.853929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2935c68-6bc8-49b5-883b-d55101cf9a32 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:16.874288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1087/2195] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:36:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:16.945747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107863ac-4e7f-442c-9382-0a900e420b6a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:16.947385 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-107863ac-4e7f-442c-9382-0a900e420b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:16.992773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1109/2196] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:16 2022] PUT /identity/v3/projects/cc4ceb50a1ae473b92a3a9bcaa53c08a/users/ba149721d3854625b23fb0a9ef7d8b6a/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:16.996681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2935c68-6bc8-49b5-883b-d55101cf9a32 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:17.023561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107863ac-4e7f-442c-9382-0a900e420b6a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:17.062977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2935c68-6bc8-49b5-883b-d55101cf9a32 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:17.072485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e3658-a808-4aa9-8278-bc0addba1aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:17.075504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e3658-a808-4aa9-8278-bc0addba1aca admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:17.075504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e3658-a808-4aa9-8278-bc0addba1aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:17.075504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e3658-a808-4aa9-8278-bc0addba1aca admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:17.075504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e3658-a808-4aa9-8278-bc0addba1aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:17.075914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e3658-a808-4aa9-8278-bc0addba1aca admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:17.088270 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1110/2197] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:36:17.092809 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e3658-a808-4aa9-8278-bc0addba1aca admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:17.104013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e3658-a808-4aa9-8278-bc0addba1aca admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:17.106640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1319ac-8709-406c-bcbd-ededc6352cca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:17.107378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1319ac-8709-406c-bcbd-ededc6352cca service swift] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:17.107738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1319ac-8709-406c-bcbd-ededc6352cca service swift] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:17.108118 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1319ac-8709-406c-bcbd-ededc6352cca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:17.110262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86048250-c7c3-4c1b-8573-8d2797f80a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:17.110913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86048250-c7c3-4c1b-8573-8d2797f80a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:17.111194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86048250-c7c3-4c1b-8573-8d2797f80a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:17.111471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86048250-c7c3-4c1b-8573-8d2797f80a11 admin admin] PATH_INFO: `/v3/projects/cc4ceb50a1ae473b92a3a9bcaa53c08a/users/ba149721d3854625b23fb0a9ef7d8b6a/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:17.113837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86048250-c7c3-4c1b-8573-8d2797f80a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4ceb50a1ae473b92a3a9bcaa53c08a, user_id=ba149721d3854625b23fb0a9ef7d8b6a, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:17.116773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86048250-c7c3-4c1b-8573-8d2797f80a11 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:17.131849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1111/2198] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:17 2022] PUT /identity/v3/projects/cc4ceb50a1ae473b92a3a9bcaa53c08a/users/ba149721d3854625b23fb0a9ef7d8b6a/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:17.142080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76999c-94bc-4377-b7be-f18d136e507d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:17.144673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76999c-94bc-4377-b7be-f18d136e507d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:17.144673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76999c-94bc-4377-b7be-f18d136e507d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:17.180656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1319ac-8709-406c-bcbd-ededc6352cca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:17.182365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1319ac-8709-406c-bcbd-ededc6352cca service swift] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:17.184863 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ce76999c-94bc-4377-b7be-f18d136e507d None None] MFA Rules not processed for user `ba149721d3854625b23fb0a9ef7d8b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:17.186533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ce76999c-94bc-4377-b7be-f18d136e507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:17.192336 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1088/2199] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:36:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 10:36:17.291988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1112/2200] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:17.300752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1319ac-8709-406c-bcbd-ededc6352cca service swift] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:17.364463 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1319ac-8709-406c-bcbd-ededc6352cca service swift] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:17.415349 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff0277-7c7a-4051-a2f2-d135f81ff057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:17.415987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff0277-7c7a-4051-a2f2-d135f81ff057 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:17.416410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff0277-7c7a-4051-a2f2-d135f81ff057 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:17.416687 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff0277-7c7a-4051-a2f2-d135f81ff057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:17.484934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff0277-7c7a-4051-a2f2-d135f81ff057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:17.486509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff0277-7c7a-4051-a2f2-d135f81ff057 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:17.504524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1089/2201] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:17.653747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:17.899499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:18.993124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c22abf-662c-404e-8338-6466317c3e3e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:18.993760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c22abf-662c-404e-8338-6466317c3e3e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:18.993760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c22abf-662c-404e-8338-6466317c3e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:19.014606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b9c22abf-662c-404e-8338-6466317c3e3e None None] MFA Rules not processed for user `bc360d9cc7384c4d9e1d1a0eeeaedf83`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:19.038401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b9c22abf-662c-404e-8338-6466317c3e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:19.132217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1113/2202] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:19.200053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff0277-7c7a-4051-a2f2-d135f81ff057 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:19.211702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff0277-7c7a-4051-a2f2-d135f81ff057 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:19.215343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d9596-4482-4d77-88ee-66b8e3cf8432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:19.218268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9596-4482-4d77-88ee-66b8e3cf8432 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:19.218268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9596-4482-4d77-88ee-66b8e3cf8432 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:19.218268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9596-4482-4d77-88ee-66b8e3cf8432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:19.218640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-633d9596-4482-4d77-88ee-66b8e3cf8432 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:19.316969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d9596-4482-4d77-88ee-66b8e3cf8432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:19.318932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d9596-4482-4d77-88ee-66b8e3cf8432 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:19.332587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1090/2203] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:19.655111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:19.842061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:20.913139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:21.465015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:21.544222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c22abf-662c-404e-8338-6466317c3e3e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:21.634087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c22abf-662c-404e-8338-6466317c3e3e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:21.650844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:21.651709 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:21.658272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:21.658272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] PATH_INFO: `/v3/users/73660e87938c44069bccc4a3c752d375` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:21.658272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73660e87938c44069bccc4a3c752d375)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:21.658272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:21.739150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:21.945095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73660e87938c44069bccc4a3c752d375'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:21.952140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73660e87938c44069bccc4a3c752d375'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:21.952792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73660e87938c44069bccc4a3c752d375'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:21.953393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73660e87938c44069bccc4a3c752d375'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:22.041570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73660e87938c44069bccc4a3c752d375'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:22.064389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1114/2204] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:21 2022] DELETE /identity/v3/users/73660e87938c44069bccc4a3c752d375 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:22.068956 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13960f0c-a312-464c-b4ba-00d6800f6faa None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:22.069459 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13960f0c-a312-464c-b4ba-00d6800f6faa None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:22.069619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13960f0c-a312-464c-b4ba-00d6800f6faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:22.090135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-13960f0c-a312-464c-b4ba-00d6800f6faa None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:22.091521 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-13960f0c-a312-464c-b4ba-00d6800f6faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:22.160964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1091/2205] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:22.171320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:22.173566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:22.251123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b94d4a-47b8-4981-b40e-d4e6a05afda2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:22.255026 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6df8ba-518a-47a2-b575-adb5057801c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:22.255724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6df8ba-518a-47a2-b575-adb5057801c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:22.256198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6df8ba-518a-47a2-b575-adb5057801c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:22.256479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6df8ba-518a-47a2-b575-adb5057801c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:22.266134 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6df8ba-518a-47a2-b575-adb5057801c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:22.267644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6df8ba-518a-47a2-b575-adb5057801c5 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:22.285193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1115/2206] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:22.578787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:22.748481 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13960f0c-a312-464c-b4ba-00d6800f6faa None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:22.750364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-13960f0c-a312-464c-b4ba-00d6800f6faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:22.765068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13960f0c-a312-464c-b4ba-00d6800f6faa None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:22.791867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:22.792563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:22.792935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:22.793301 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] PATH_INFO: `/v3/projects/f9d392b884cd4959b9c3dba1b9e9fce8` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:22.794626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d392b884cd4959b9c3dba1b9e9fce8)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:22.797514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:23.027099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d392b884cd4959b9c3dba1b9e9fce8', 'request_id': 'req-2320cd4d-d8b9-4380-9b05-23fef0737630'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:23.034570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d392b884cd4959b9c3dba1b9e9fce8', 'request_id': 'req-2320cd4d-d8b9-4380-9b05-23fef0737630'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:23.042290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d392b884cd4959b9c3dba1b9e9fce8', 'request_id': 'req-2320cd4d-d8b9-4380-9b05-23fef0737630'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:23.224247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] The token cache is being invalidate because project f9d392b884cd4959b9c3dba1b9e9fce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:23.225010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:23.225345 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:23.226962 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1092/2207] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:22 2022] DELETE /identity/v3/projects/f9d392b884cd4959b9c3dba1b9e9fce8 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:23.231404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6df8ba-518a-47a2-b575-adb5057801c5 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:23.242195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6df8ba-518a-47a2-b575-adb5057801c5 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:23.308062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e26e66-980a-4312-82ae-d1a37fd4538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:23.308694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e26e66-980a-4312-82ae-d1a37fd4538d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:23.308975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e26e66-980a-4312-82ae-d1a37fd4538d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:23.309279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e26e66-980a-4312-82ae-d1a37fd4538d admin admin] PATH_INFO: `/v3/users/ba149721d3854625b23fb0a9ef7d8b6a` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:23.310932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e26e66-980a-4312-82ae-d1a37fd4538d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba149721d3854625b23fb0a9ef7d8b6a)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:23.312879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e26e66-980a-4312-82ae-d1a37fd4538d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:23.558793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-86e26e66-980a-4312-82ae-d1a37fd4538d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba149721d3854625b23fb0a9ef7d8b6a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:23.569427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-86e26e66-980a-4312-82ae-d1a37fd4538d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba149721d3854625b23fb0a9ef7d8b6a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:23.580406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-86e26e66-980a-4312-82ae-d1a37fd4538d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba149721d3854625b23fb0a9ef7d8b6a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:23.580406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-86e26e66-980a-4312-82ae-d1a37fd4538d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba149721d3854625b23fb0a9ef7d8b6a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:23.653964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-86e26e66-980a-4312-82ae-d1a37fd4538d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba149721d3854625b23fb0a9ef7d8b6a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:23.675487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1116/2208] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:23 2022] DELETE /identity/v3/users/ba149721d3854625b23fb0a9ef7d8b6a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:23.834983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:24.193027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:24.194824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:24.209348 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320cd4d-d8b9-4380-9b05-23fef0737630 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:24.213248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:24.294581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:24.296101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:24.296695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:24.296983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] PATH_INFO: `/v3/projects/cc4ceb50a1ae473b92a3a9bcaa53c08a` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:24.298290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc4ceb50a1ae473b92a3a9bcaa53c08a)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:24.301175 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:24.468696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4ceb50a1ae473b92a3a9bcaa53c08a', 'request_id': 'req-04a2fecb-1454-459a-8727-6663be58292d'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:24.475127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4ceb50a1ae473b92a3a9bcaa53c08a', 'request_id': 'req-04a2fecb-1454-459a-8727-6663be58292d'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:24.482038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4ceb50a1ae473b92a3a9bcaa53c08a', 'request_id': 'req-04a2fecb-1454-459a-8727-6663be58292d'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:24.568653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] The token cache is being invalidate because project cc4ceb50a1ae473b92a3a9bcaa53c08a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:24.568653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:24.568653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:24.571868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1093/2209] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:24 2022] DELETE /identity/v3/projects/cc4ceb50a1ae473b92a3a9bcaa53c08a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:24.573619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f168c5-2afc-4e74-aebe-43d00c57e230 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:24.574021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f168c5-2afc-4e74-aebe-43d00c57e230 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:24.574412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f168c5-2afc-4e74-aebe-43d00c57e230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:24.604462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c2f168c5-2afc-4e74-aebe-43d00c57e230 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:24.605811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c2f168c5-2afc-4e74-aebe-43d00c57e230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:24.621609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:24.623575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:24.728825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1117/2210] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:24.734602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2fecb-1454-459a-8727-6663be58292d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:24.741795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd94a6b-c49f-4fd7-bc4c-ec541d561cf6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:24.742091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd94a6b-c49f-4fd7-bc4c-ec541d561cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:24.742721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd94a6b-c49f-4fd7-bc4c-ec541d561cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:24.759430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeecd44-1b38-4b1e-86a0-0493a6956034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:24.760453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeecd44-1b38-4b1e-86a0-0493a6956034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:24.760922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeecd44-1b38-4b1e-86a0-0493a6956034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:24.766504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeecd44-1b38-4b1e-86a0-0493a6956034 admin admin] PATH_INFO: `/v3/users/3e6b77e4bcd14137a60a35fe09d37de3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:24.766504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeecd44-1b38-4b1e-86a0-0493a6956034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6b77e4bcd14137a60a35fe09d37de3)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:24.766504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeecd44-1b38-4b1e-86a0-0493a6956034 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:24.781560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8bd94a6b-c49f-4fd7-bc4c-ec541d561cf6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:24.783257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8bd94a6b-c49f-4fd7-bc4c-ec541d561cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:24.789132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:24.796885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1118/2211] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:24.797950 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd94a6b-c49f-4fd7-bc4c-ec541d561cf6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:24.808086 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd94a6b-c49f-4fd7-bc4c-ec541d561cf6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:24.813794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d16e1c-1a55-4104-88c7-3d0826a27847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:24.814414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d16e1c-1a55-4104-88c7-3d0826a27847 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:24.814694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d16e1c-1a55-4104-88c7-3d0826a27847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:24.814977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d16e1c-1a55-4104-88c7-3d0826a27847 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:24.816409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d16e1c-1a55-4104-88c7-3d0826a27847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:24.816707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d16e1c-1a55-4104-88c7-3d0826a27847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:24.818839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d16e1c-1a55-4104-88c7-3d0826a27847 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:24.832801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1119/2212] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:36:24.837054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d16e1c-1a55-4104-88c7-3d0826a27847 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:24.847054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d16e1c-1a55-4104-88c7-3d0826a27847 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:24.852185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84df76-f0c0-4ee3-882c-cd1810c08f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:24.852838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84df76-f0c0-4ee3-882c-cd1810c08f78 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:24.853110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84df76-f0c0-4ee3-882c-cd1810c08f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:24.853391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84df76-f0c0-4ee3-882c-cd1810c08f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:24.854027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84df76-f0c0-4ee3-882c-cd1810c08f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:24.856206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84df76-f0c0-4ee3-882c-cd1810c08f78 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:24.971977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1120/2213] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:24 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:24.974638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84df76-f0c0-4ee3-882c-cd1810c08f78 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:25.035784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cbeecd44-1b38-4b1e-86a0-0493a6956034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6b77e4bcd14137a60a35fe09d37de3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:25.043837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cbeecd44-1b38-4b1e-86a0-0493a6956034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6b77e4bcd14137a60a35fe09d37de3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:25.044566 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cbeecd44-1b38-4b1e-86a0-0493a6956034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6b77e4bcd14137a60a35fe09d37de3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:25.046836 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84df76-f0c0-4ee3-882c-cd1810c08f78 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:25.053590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82184a-08d6-4d20-976e-e94887319dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:25.054242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82184a-08d6-4d20-976e-e94887319dec admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:25.054516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82184a-08d6-4d20-976e-e94887319dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:25.054792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82184a-08d6-4d20-976e-e94887319dec admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:25.055451 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82184a-08d6-4d20-976e-e94887319dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:25.057542 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82184a-08d6-4d20-976e-e94887319dec admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:25.138926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cbeecd44-1b38-4b1e-86a0-0493a6956034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6b77e4bcd14137a60a35fe09d37de3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:25.154120 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cbeecd44-1b38-4b1e-86a0-0493a6956034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6b77e4bcd14137a60a35fe09d37de3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:25.160430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1094/2214] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:24 2022] DELETE /identity/v3/users/3e6b77e4bcd14137a60a35fe09d37de3 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:25.164867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541b878-1379-45c5-a4da-9a1fe92d6057 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:25.165221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541b878-1379-45c5-a4da-9a1fe92d6057 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:25.165572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541b878-1379-45c5-a4da-9a1fe92d6057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:25.174322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1121/2215] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:24 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:25.180048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82184a-08d6-4d20-976e-e94887319dec admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:25.182539 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3b82184a-08d6-4d20-976e-e94887319dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:25.189884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c541b878-1379-45c5-a4da-9a1fe92d6057 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:25.191593 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c541b878-1379-45c5-a4da-9a1fe92d6057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:25.197195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82184a-08d6-4d20-976e-e94887319dec admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:25.263003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1095/2216] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:25.272922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541b878-1379-45c5-a4da-9a1fe92d6057 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:25.273759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239be719-49d1-401d-ad49-538f5b96edc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:25.278436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c541b878-1379-45c5-a4da-9a1fe92d6057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:25.278571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be719-49d1-401d-ad49-538f5b96edc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:25.278571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be719-49d1-401d-ad49-538f5b96edc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:25.278571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be719-49d1-401d-ad49-538f5b96edc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:25.278571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239be719-49d1-401d-ad49-538f5b96edc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:25.278571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239be719-49d1-401d-ad49-538f5b96edc4 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:25.289166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1122/2217] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:25.293315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239be719-49d1-401d-ad49-538f5b96edc4 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:25.305758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239be719-49d1-401d-ad49-538f5b96edc4 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:25.312480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391fca9-179b-49ab-a611-5ac71e7a5531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:25.312919 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391fca9-179b-49ab-a611-5ac71e7a5531 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:25.313230 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391fca9-179b-49ab-a611-5ac71e7a5531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:25.313501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391fca9-179b-49ab-a611-5ac71e7a5531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:25.314197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391fca9-179b-49ab-a611-5ac71e7a5531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:25.316833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391fca9-179b-49ab-a611-5ac71e7a5531 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:25.332127 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1123/2218] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:36:25.333839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391fca9-179b-49ab-a611-5ac71e7a5531 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:25.347061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391fca9-179b-49ab-a611-5ac71e7a5531 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:25.354282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13758d-19b1-4e3b-8aca-577b93c67795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:25.355153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13758d-19b1-4e3b-8aca-577b93c67795 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:25.358850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13758d-19b1-4e3b-8aca-577b93c67795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:25.358850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13758d-19b1-4e3b-8aca-577b93c67795 admin admin] PATH_INFO: `/v3/projects/1744870dad474171abb158ad84d05514/users/7d90e176c3f44a63a64c0f90141d6783/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:25.359197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541b878-1379-45c5-a4da-9a1fe92d6057 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:25.361457 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458566c-0b65-4ed8-a2fd-eaf7d8a56cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:25.362673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458566c-0b65-4ed8-a2fd-eaf7d8a56cfb service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:25.363084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458566c-0b65-4ed8-a2fd-eaf7d8a56cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:25.363360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458566c-0b65-4ed8-a2fd-eaf7d8a56cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:25.378899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458566c-0b65-4ed8-a2fd-eaf7d8a56cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:25.380640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458566c-0b65-4ed8-a2fd-eaf7d8a56cfb service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:25.394847 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13758d-19b1-4e3b-8aca-577b93c67795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1744870dad474171abb158ad84d05514, user_id=7d90e176c3f44a63a64c0f90141d6783, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:25.401098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1096/2219] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:36:25.405762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13758d-19b1-4e3b-8aca-577b93c67795 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:25.495256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1124/2220] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:25 2022] PUT /identity/v3/projects/1744870dad474171abb158ad84d05514/users/7d90e176c3f44a63a64c0f90141d6783/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:25.507878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125d4cb-3211-4dd8-9c3f-ded65553fbc0 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:25.508283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125d4cb-3211-4dd8-9c3f-ded65553fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:25.508642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125d4cb-3211-4dd8-9c3f-ded65553fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:25.524050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:25.550252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4125d4cb-3211-4dd8-9c3f-ded65553fbc0 None None] MFA Rules not processed for user `7d90e176c3f44a63a64c0f90141d6783`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:25.551578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4125d4cb-3211-4dd8-9c3f-ded65553fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:25.631503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1097/2221] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:25.632430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13758d-19b1-4e3b-8aca-577b93c67795 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:25.730781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13758d-19b1-4e3b-8aca-577b93c67795 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:25.739972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2642bf-fe94-4517-a5d8-cb4f16fed0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:25.740244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2642bf-fe94-4517-a5d8-cb4f16fed0bb admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:25.740717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2642bf-fe94-4517-a5d8-cb4f16fed0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:25.740988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2642bf-fe94-4517-a5d8-cb4f16fed0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:25.741638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2642bf-fe94-4517-a5d8-cb4f16fed0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:25.743591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2642bf-fe94-4517-a5d8-cb4f16fed0bb admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:25.866039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1125/2222] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:25 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:36:25.870205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125d4cb-3211-4dd8-9c3f-ded65553fbc0 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:25.883429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125d4cb-3211-4dd8-9c3f-ded65553fbc0 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:25.885361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:25.929280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2642bf-fe94-4517-a5d8-cb4f16fed0bb admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:25.932783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2f2642bf-fe94-4517-a5d8-cb4f16fed0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:25.996630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feea7c-fda5-4c43-bdd5-6a6b033ae42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:25.997421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feea7c-fda5-4c43-bdd5-6a6b033ae42e admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:25.998043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feea7c-fda5-4c43-bdd5-6a6b033ae42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:25.998327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feea7c-fda5-4c43-bdd5-6a6b033ae42e admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:25.998971 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67feea7c-fda5-4c43-bdd5-6a6b033ae42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:26.001278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67feea7c-fda5-4c43-bdd5-6a6b033ae42e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:26.025249 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:26.029416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2642bf-fe94-4517-a5d8-cb4f16fed0bb admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:26.034697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:26.035347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:26.035642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:26.035922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] PATH_INFO: `/v3/projects/389811cc9255401d9a7010be0ab16541` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:26.037203 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=389811cc9255401d9a7010be0ab16541)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:26.038981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:26.139646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1098/2223] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:25 2022] POST /identity/v3/users => generated 292 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:26.143604 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feea7c-fda5-4c43-bdd5-6a6b033ae42e admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:26.154889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feea7c-fda5-4c43-bdd5-6a6b033ae42e admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:26.159824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755950-98a5-4b22-b510-d99ff6f4b6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:26.160487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755950-98a5-4b22-b510-d99ff6f4b6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:26.160762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755950-98a5-4b22-b510-d99ff6f4b6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:26.161038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755950-98a5-4b22-b510-d99ff6f4b6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:26.161682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b755950-98a5-4b22-b510-d99ff6f4b6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:26.163340 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b755950-98a5-4b22-b510-d99ff6f4b6a6 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:26.179382 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1099/2224] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:26.188652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755950-98a5-4b22-b510-d99ff6f4b6a6 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:26.196639 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755950-98a5-4b22-b510-d99ff6f4b6a6 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:26.199358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389811cc9255401d9a7010be0ab16541', 'request_id': 'req-8fea9a39-9a00-43be-adec-b2efea065a8a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:26.211120 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389811cc9255401d9a7010be0ab16541', 'request_id': 'req-8fea9a39-9a00-43be-adec-b2efea065a8a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:26.266343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeb878-f53b-4cd6-8cc7-d02cf2e7daf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:26.267012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeb878-f53b-4cd6-8cc7-d02cf2e7daf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:26.267403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeb878-f53b-4cd6-8cc7-d02cf2e7daf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:26.267677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeb878-f53b-4cd6-8cc7-d02cf2e7daf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:26.270456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfeb878-f53b-4cd6-8cc7-d02cf2e7daf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:26.270689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfeb878-f53b-4cd6-8cc7-d02cf2e7daf5 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:26.282848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1100/2225] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:26.287231 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeb878-f53b-4cd6-8cc7-d02cf2e7daf5 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:26.297740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeb878-f53b-4cd6-8cc7-d02cf2e7daf5 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:26.303164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fdd5f-42cb-4a27-9b1e-48c9f1e6b4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:26.303809 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fdd5f-42cb-4a27-9b1e-48c9f1e6b4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:26.304119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fdd5f-42cb-4a27-9b1e-48c9f1e6b4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:26.304640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fdd5f-42cb-4a27-9b1e-48c9f1e6b4c8 admin admin] PATH_INFO: `/v3/projects/607bda672b5d4f66b0963cdcb9508b76/users/32fae8e14c474268b58f83406ba99871/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:26.320825 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fdd5f-42cb-4a27-9b1e-48c9f1e6b4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=607bda672b5d4f66b0963cdcb9508b76, user_id=32fae8e14c474268b58f83406ba99871, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:26.323833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fdd5f-42cb-4a27-9b1e-48c9f1e6b4c8 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:26.332669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389811cc9255401d9a7010be0ab16541', 'request_id': 'req-8fea9a39-9a00-43be-adec-b2efea065a8a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:26.347653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] The token cache is being invalidate because project 389811cc9255401d9a7010be0ab16541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:26.348040 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:26.348717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:26.353379 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1126/2226] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:25 2022] DELETE /identity/v3/projects/389811cc9255401d9a7010be0ab16541 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:26.354567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:26.356449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:26.370294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea9a39-9a00-43be-adec-b2efea065a8a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:26.375641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:26.376343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:26.383290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:26.383290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] PATH_INFO: `/v3/users/1dd56036c919401383a001557ecfd75a` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:26.383290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd56036c919401383a001557ecfd75a)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:26.383290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:26.453698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1101/2227] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:26 2022] PUT /identity/v3/projects/607bda672b5d4f66b0963cdcb9508b76/users/32fae8e14c474268b58f83406ba99871/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:26.465392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b3fa5-71e2-43c2-938f-3a30689971b7 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:26.465683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b3fa5-71e2-43c2-938f-3a30689971b7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:26.465956 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b3fa5-71e2-43c2-938f-3a30689971b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:26.496535 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d32b3fa5-71e2-43c2-938f-3a30689971b7 None None] MFA Rules not processed for user `32fae8e14c474268b58f83406ba99871`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:26.498142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d32b3fa5-71e2-43c2-938f-3a30689971b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:26.588401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1102/2228] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:26.593102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b3fa5-71e2-43c2-938f-3a30689971b7 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:26.594516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d32b3fa5-71e2-43c2-938f-3a30689971b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:26.636453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd56036c919401383a001557ecfd75a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:26.657372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd56036c919401383a001557ecfd75a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:26.658191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd56036c919401383a001557ecfd75a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:26.659497 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd56036c919401383a001557ecfd75a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:26.681742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b3fa5-71e2-43c2-938f-3a30689971b7 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:26.691671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6c3fe-f649-40bf-b019-0b190dfb8a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:26.692450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6c3fe-f649-40bf-b019-0b190dfb8a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:26.692727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6c3fe-f649-40bf-b019-0b190dfb8a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:26.693000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6c3fe-f649-40bf-b019-0b190dfb8a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:26.693822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6c3fe-f649-40bf-b019-0b190dfb8a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:26.697009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6c3fe-f649-40bf-b019-0b190dfb8a23 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:26.731754 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd56036c919401383a001557ecfd75a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:26.755933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1127/2229] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:26 2022] DELETE /identity/v3/users/1dd56036c919401383a001557ecfd75a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:26.791127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1103/2230] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:26 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:26.795568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:26.797021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:26.881640 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:26.893448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c416f4-764e-4724-bf6c-979f3512c7a8 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:26.962923 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:26.990107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6255990-9aa2-47eb-8bed-8c0eb685140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:26.991164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6255990-9aa2-47eb-8bed-8c0eb685140e admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:26.991620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6255990-9aa2-47eb-8bed-8c0eb685140e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:26.992153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6255990-9aa2-47eb-8bed-8c0eb685140e admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:26.993224 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6255990-9aa2-47eb-8bed-8c0eb685140e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:26.996507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6255990-9aa2-47eb-8bed-8c0eb685140e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:27.097871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1128/2231] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:26 2022] POST /identity/v3/users => generated 298 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:27.099466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6c3fe-f649-40bf-b019-0b190dfb8a23 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:27.111410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6c3fe-f649-40bf-b019-0b190dfb8a23 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:27.117427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4bfbc-cccb-4c2e-86fb-8b10775de93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:27.118043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4bfbc-cccb-4c2e-86fb-8b10775de93b admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:27.118323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4bfbc-cccb-4c2e-86fb-8b10775de93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:27.118869 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4bfbc-cccb-4c2e-86fb-8b10775de93b admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:27.119530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4bfbc-cccb-4c2e-86fb-8b10775de93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:27.121447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4bfbc-cccb-4c2e-86fb-8b10775de93b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:27.147710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1104/2232] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:27.152167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6255990-9aa2-47eb-8bed-8c0eb685140e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:27.163991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6255990-9aa2-47eb-8bed-8c0eb685140e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:27.178836 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e75103-5daa-4935-84dd-75d76b440e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:27.180264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e75103-5daa-4935-84dd-75d76b440e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:27.180558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e75103-5daa-4935-84dd-75d76b440e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:27.180834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e75103-5daa-4935-84dd-75d76b440e25 admin admin] PATH_INFO: `/v3/projects/76001a5ffaa44c93ac7e43878a1946bb/users/71de9982834941ea9d8d74bb83a10e15/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:27.201981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e75103-5daa-4935-84dd-75d76b440e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76001a5ffaa44c93ac7e43878a1946bb, user_id=71de9982834941ea9d8d74bb83a10e15, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:27.205545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e75103-5daa-4935-84dd-75d76b440e25 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:27.261419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4bfbc-cccb-4c2e-86fb-8b10775de93b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:27.263479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cbc4bfbc-cccb-4c2e-86fb-8b10775de93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:27.279017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4bfbc-cccb-4c2e-86fb-8b10775de93b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:27.291169 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:27.297821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1129/2233] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:27 2022] PUT /identity/v3/projects/76001a5ffaa44c93ac7e43878a1946bb/users/71de9982834941ea9d8d74bb83a10e15/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:27.298461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:27.298461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:27.298461 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] PATH_INFO: `/v3/projects/50bcf3875f9c4962823263faab5366e5` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:27.299063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] RBAC: Authorizing `identity:delete_project(project_id=50bcf3875f9c4962823263faab5366e5)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:27.300647 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e75103-5daa-4935-84dd-75d76b440e25 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:27.304170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:27.398615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e75103-5daa-4935-84dd-75d76b440e25 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:27.403739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545da5-1c0e-4657-8088-17cfa43b4d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:27.404750 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545da5-1c0e-4657-8088-17cfa43b4d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:27.405205 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545da5-1c0e-4657-8088-17cfa43b4d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:27.405624 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545da5-1c0e-4657-8088-17cfa43b4d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:27.406475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5545da5-1c0e-4657-8088-17cfa43b4d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:27.408259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5545da5-1c0e-4657-8088-17cfa43b4d59 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:27.429856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1130/2234] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:36:27.431272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545da5-1c0e-4657-8088-17cfa43b4d59 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:27.444399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545da5-1c0e-4657-8088-17cfa43b4d59 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:27.449799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e37b6a-8271-4ac4-81ab-e79ebc3aa9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:27.450038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37b6a-8271-4ac4-81ab-e79ebc3aa9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:27.450279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37b6a-8271-4ac4-81ab-e79ebc3aa9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:27.450553 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37b6a-8271-4ac4-81ab-e79ebc3aa9b5 admin admin] PATH_INFO: `/v3/projects/76001a5ffaa44c93ac7e43878a1946bb/users/71de9982834941ea9d8d74bb83a10e15/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:27.452838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e37b6a-8271-4ac4-81ab-e79ebc3aa9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76001a5ffaa44c93ac7e43878a1946bb, user_id=71de9982834941ea9d8d74bb83a10e15, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:27.456182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e37b6a-8271-4ac4-81ab-e79ebc3aa9b5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:27.477002 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1131/2235] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:27 2022] PUT /identity/v3/projects/76001a5ffaa44c93ac7e43878a1946bb/users/71de9982834941ea9d8d74bb83a10e15/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:27.488324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6d0d4-bbb5-4dd5-a054-fe18af8651c2 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:27.488612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6d0d4-bbb5-4dd5-a054-fe18af8651c2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:27.488886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6d0d4-bbb5-4dd5-a054-fe18af8651c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:27.514940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50bcf3875f9c4962823263faab5366e5', 'request_id': 'req-955a5f14-cc09-40f4-9a73-32747569611c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:27.517716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c0f6d0d4-bbb5-4dd5-a054-fe18af8651c2 None None] MFA Rules not processed for user `71de9982834941ea9d8d74bb83a10e15`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:27.519476 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c0f6d0d4-bbb5-4dd5-a054-fe18af8651c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:27.524519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50bcf3875f9c4962823263faab5366e5', 'request_id': 'req-955a5f14-cc09-40f4-9a73-32747569611c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:27.533546 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50bcf3875f9c4962823263faab5366e5', 'request_id': 'req-955a5f14-cc09-40f4-9a73-32747569611c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:27.599093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1132/2236] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:27.601341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:27.611008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6d0d4-bbb5-4dd5-a054-fe18af8651c2 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:27.616224 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c0f6d0d4-bbb5-4dd5-a054-fe18af8651c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:27.645504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] The token cache is being invalidate because project 50bcf3875f9c4962823263faab5366e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:27.645504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:27.645504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:27.645504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1105/2237] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:27 2022] DELETE /identity/v3/projects/50bcf3875f9c4962823263faab5366e5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:27.648165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:27.649688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:27.686587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6d0d4-bbb5-4dd5-a054-fe18af8651c2 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:27.691373 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c2666-1824-4074-9a32-ce22c03be8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:27.692812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2666-1824-4074-9a32-ce22c03be8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:27.693310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2666-1824-4074-9a32-ce22c03be8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:27.693808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2666-1824-4074-9a32-ce22c03be8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:27.702457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-241c2666-1824-4074-9a32-ce22c03be8d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:27.734979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a5f14-cc09-40f4-9a73-32747569611c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:27.740226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6686f-09aa-4559-a427-2db1a460e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:27.740872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6686f-09aa-4559-a427-2db1a460e74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:27.741156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6686f-09aa-4559-a427-2db1a460e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:27.741551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6686f-09aa-4559-a427-2db1a460e74e admin admin] PATH_INFO: `/v3/users/37616e4fea314e75832fbaddcab7238f` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:27.742794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6686f-09aa-4559-a427-2db1a460e74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=37616e4fea314e75832fbaddcab7238f)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:27.744775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6686f-09aa-4559-a427-2db1a460e74e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:27.768070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:27.787802 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c2666-1824-4074-9a32-ce22c03be8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:27.789603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c2666-1824-4074-9a32-ce22c03be8d5 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:27.810733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1133/2238] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:36:27.990803 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-73d6686f-09aa-4559-a427-2db1a460e74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37616e4fea314e75832fbaddcab7238f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:27.999426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-73d6686f-09aa-4559-a427-2db1a460e74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37616e4fea314e75832fbaddcab7238f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:28.000367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-73d6686f-09aa-4559-a427-2db1a460e74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37616e4fea314e75832fbaddcab7238f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:28.105007 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-73d6686f-09aa-4559-a427-2db1a460e74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37616e4fea314e75832fbaddcab7238f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:28.122919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-73d6686f-09aa-4559-a427-2db1a460e74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37616e4fea314e75832fbaddcab7238f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:28.145764 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1106/2239] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:27 2022] DELETE /identity/v3/users/37616e4fea314e75832fbaddcab7238f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:28.167321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:28.407579 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:28.763418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c2666-1824-4074-9a32-ce22c03be8d5 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:28.780707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c2666-1824-4074-9a32-ce22c03be8d5 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:28.859769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ca785-bd46-457c-aba5-3c8b7c4b4524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:28.860552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ca785-bd46-457c-aba5-3c8b7c4b4524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:28.860899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ca785-bd46-457c-aba5-3c8b7c4b4524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:28.861348 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ca785-bd46-457c-aba5-3c8b7c4b4524 admin admin] PATH_INFO: `/v3/projects/87fc84b3dbb74d37ae57d77c7d3e7dde` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:28.862778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ca785-bd46-457c-aba5-3c8b7c4b4524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87fc84b3dbb74d37ae57d77c7d3e7dde)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:28.864900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ca785-bd46-457c-aba5-3c8b7c4b4524 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:29.088074 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-db1ca785-bd46-457c-aba5-3c8b7c4b4524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87fc84b3dbb74d37ae57d77c7d3e7dde', 'request_id': 'req-db1ca785-bd46-457c-aba5-3c8b7c4b4524'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:29.093907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-db1ca785-bd46-457c-aba5-3c8b7c4b4524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87fc84b3dbb74d37ae57d77c7d3e7dde', 'request_id': 'req-db1ca785-bd46-457c-aba5-3c8b7c4b4524'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:29.218544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-db1ca785-bd46-457c-aba5-3c8b7c4b4524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87fc84b3dbb74d37ae57d77c7d3e7dde', 'request_id': 'req-db1ca785-bd46-457c-aba5-3c8b7c4b4524'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:29.236008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-db1ca785-bd46-457c-aba5-3c8b7c4b4524 admin admin] The token cache is being invalidate because project 87fc84b3dbb74d37ae57d77c7d3e7dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:29.237352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-db1ca785-bd46-457c-aba5-3c8b7c4b4524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:29.238263 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-db1ca785-bd46-457c-aba5-3c8b7c4b4524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:29.240327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1134/2240] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:28 2022] DELETE /identity/v3/projects/87fc84b3dbb74d37ae57d77c7d3e7dde => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:29.245183 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9a2e3-18fe-4c20-b67e-68f79859eea9 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:29.250793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9a2e3-18fe-4c20-b67e-68f79859eea9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:29.250793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9a2e3-18fe-4c20-b67e-68f79859eea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:29.268751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a2b9a2e3-18fe-4c20-b67e-68f79859eea9 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:29.270031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a2b9a2e3-18fe-4c20-b67e-68f79859eea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:29.336180 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1107/2241] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:29.345372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7b295-44c5-40a1-a20c-bbecb09802ce None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:29.346106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7b295-44c5-40a1-a20c-bbecb09802ce None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:29.347210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7b295-44c5-40a1-a20c-bbecb09802ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:29.372276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-bbc7b295-44c5-40a1-a20c-bbecb09802ce None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:29.374361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bbc7b295-44c5-40a1-a20c-bbecb09802ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:29.385388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1135/2242] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:29.389960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9a2e3-18fe-4c20-b67e-68f79859eea9 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:29.403073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9a2e3-18fe-4c20-b67e-68f79859eea9 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:29.410153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d118b-92a4-4a0b-a9af-a077f2455849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:29.410854 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d118b-92a4-4a0b-a9af-a077f2455849 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:29.411158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d118b-92a4-4a0b-a9af-a077f2455849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:29.411436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d118b-92a4-4a0b-a9af-a077f2455849 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:29.412129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d118b-92a4-4a0b-a9af-a077f2455849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:29.412431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d118b-92a4-4a0b-a9af-a077f2455849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:29.414428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d118b-92a4-4a0b-a9af-a077f2455849 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:29.437817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1108/2243] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:36:29.438926 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7b295-44c5-40a1-a20c-bbecb09802ce None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:29.449522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7b295-44c5-40a1-a20c-bbecb09802ce None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:29.455024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50edae1-f9df-4ba9-8222-fb4f76390664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:29.455739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50edae1-f9df-4ba9-8222-fb4f76390664 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:29.456128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50edae1-f9df-4ba9-8222-fb4f76390664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:29.456588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50edae1-f9df-4ba9-8222-fb4f76390664 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:29.457499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50edae1-f9df-4ba9-8222-fb4f76390664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:29.459541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50edae1-f9df-4ba9-8222-fb4f76390664 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:29.555932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1136/2244] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:29 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:36:29.557189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d118b-92a4-4a0b-a9af-a077f2455849 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:29.567420 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d118b-92a4-4a0b-a9af-a077f2455849 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:29.638278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d920e29-0d97-44f6-8c6c-b21cc8e89d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:29.639216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d920e29-0d97-44f6-8c6c-b21cc8e89d4b admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:29.639530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d920e29-0d97-44f6-8c6c-b21cc8e89d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:29.640016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d920e29-0d97-44f6-8c6c-b21cc8e89d4b admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:29.640701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d920e29-0d97-44f6-8c6c-b21cc8e89d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:29.642618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d920e29-0d97-44f6-8c6c-b21cc8e89d4b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:29.647136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:29.807456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1109/2245] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:29 2022] POST /identity/v3/users => generated 283 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:29.813182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50edae1-f9df-4ba9-8222-fb4f76390664 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:29.839737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50edae1-f9df-4ba9-8222-fb4f76390664 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:29.852681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9c943-e186-4065-b2f9-fdc5349b652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:29.852681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9c943-e186-4065-b2f9-fdc5349b652e admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:29.852681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9c943-e186-4065-b2f9-fdc5349b652e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:29.852681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9c943-e186-4065-b2f9-fdc5349b652e admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:29.853298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9c943-e186-4065-b2f9-fdc5349b652e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:29.854393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9c943-e186-4065-b2f9-fdc5349b652e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:29.870908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1137/2246] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:29.876513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d920e29-0d97-44f6-8c6c-b21cc8e89d4b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:29.891973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d920e29-0d97-44f6-8c6c-b21cc8e89d4b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:29.899572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22323873-1204-4c8c-90da-ae4d37a16cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:29.900535 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22323873-1204-4c8c-90da-ae4d37a16cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:29.901006 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22323873-1204-4c8c-90da-ae4d37a16cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:29.901496 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22323873-1204-4c8c-90da-ae4d37a16cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:29.902492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22323873-1204-4c8c-90da-ae4d37a16cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:29.905294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22323873-1204-4c8c-90da-ae4d37a16cd2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:29.968012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1110/2247] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:29.970354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9c943-e186-4065-b2f9-fdc5349b652e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:29.989522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22323873-1204-4c8c-90da-ae4d37a16cd2 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:29.989837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9c943-e186-4065-b2f9-fdc5349b652e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:29.991870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-22323873-1204-4c8c-90da-ae4d37a16cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:29.997575 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f9d14-780b-4198-8c98-89ae0b48dcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:29.999231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f9d14-780b-4198-8c98-89ae0b48dcd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:29.999405 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f9d14-780b-4198-8c98-89ae0b48dcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:29.999778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f9d14-780b-4198-8c98-89ae0b48dcd9 admin admin] PATH_INFO: `/v3/projects/d7a7308a63bb4471a3450efc55330aa1/users/1360961f519740be938c8a6c1cc3b785/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:30.032402 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f9d14-780b-4198-8c98-89ae0b48dcd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a7308a63bb4471a3450efc55330aa1, user_id=1360961f519740be938c8a6c1cc3b785, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:30.039338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f9d14-780b-4198-8c98-89ae0b48dcd9 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:30.069016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22323873-1204-4c8c-90da-ae4d37a16cd2 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:30.073711 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e3714-d89d-477a-905b-bf975ff8b4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:30.074434 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e3714-d89d-477a-905b-bf975ff8b4bc service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:30.074720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e3714-d89d-477a-905b-bf975ff8b4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:30.075067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e3714-d89d-477a-905b-bf975ff8b4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:30.076894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-277e3714-d89d-477a-905b-bf975ff8b4bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:30.083394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:30.166498 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1138/2248] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:29 2022] PUT /identity/v3/projects/d7a7308a63bb4471a3450efc55330aa1/users/1360961f519740be938c8a6c1cc3b785/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:30.177611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e3714-d89d-477a-905b-bf975ff8b4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:30.179086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e3714-d89d-477a-905b-bf975ff8b4bc service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:30.189806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086203bf-0551-4a0f-8b21-ce5ae23f5c32 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:30.191999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086203bf-0551-4a0f-8b21-ce5ae23f5c32 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:30.195104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086203bf-0551-4a0f-8b21-ce5ae23f5c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:30.195898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1111/2249] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:30.247126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-086203bf-0551-4a0f-8b21-ce5ae23f5c32 None None] MFA Rules not processed for user `1360961f519740be938c8a6c1cc3b785`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:30.249004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-086203bf-0551-4a0f-8b21-ce5ae23f5c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:30.406227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1139/2250] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:30.419691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e3714-d89d-477a-905b-bf975ff8b4bc service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:30.424694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-277e3714-d89d-477a-905b-bf975ff8b4bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:30.443930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e3714-d89d-477a-905b-bf975ff8b4bc service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:30.577791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fbd6b-68cc-4303-8536-09f14ccb8226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:30.578706 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fbd6b-68cc-4303-8536-09f14ccb8226 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:30.579004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fbd6b-68cc-4303-8536-09f14ccb8226 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:30.579620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fbd6b-68cc-4303-8536-09f14ccb8226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:30.608953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fbd6b-68cc-4303-8536-09f14ccb8226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:30.613479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fbd6b-68cc-4303-8536-09f14ccb8226 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:30.633225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1112/2251] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:31.156239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:31.378906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:32.256055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:32.359066 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086203bf-0551-4a0f-8b21-ce5ae23f5c32 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:32.373674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086203bf-0551-4a0f-8b21-ce5ae23f5c32 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:32.387776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9ddb1-66e4-4446-a9b5-c585f68b7b7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:32.389221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9ddb1-66e4-4446-a9b5-c585f68b7b7d service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:32.389654 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9ddb1-66e4-4446-a9b5-c585f68b7b7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:32.390077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9ddb1-66e4-4446-a9b5-c585f68b7b7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:32.392894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-69e9ddb1-66e4-4446-a9b5-c585f68b7b7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:32.441696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:32.510498 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9ddb1-66e4-4446-a9b5-c585f68b7b7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:32.512753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9ddb1-66e4-4446-a9b5-c585f68b7b7d service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:32.544788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1140/2252] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:36:33.089063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:34.065217 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:34.177301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:35.275658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:35.534690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:37.306993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fbd6b-68cc-4303-8536-09f14ccb8226 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:37.310782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-236fbd6b-68cc-4303-8536-09f14ccb8226 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:37.412942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fbd6b-68cc-4303-8536-09f14ccb8226 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:37.421025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:37.435972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:37.436212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:37.436585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] PATH_INFO: `/v3/users/5a0322e46e56463ca97f73e3a7d0e6fb` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:37.437780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0322e46e56463ca97f73e3a7d0e6fb)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:37.439823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:37.738112 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0322e46e56463ca97f73e3a7d0e6fb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:37.747796 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0322e46e56463ca97f73e3a7d0e6fb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:37.748680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0322e46e56463ca97f73e3a7d0e6fb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:37.887404 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0322e46e56463ca97f73e3a7d0e6fb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:37.911320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0322e46e56463ca97f73e3a7d0e6fb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:37.920424 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1113/2253] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:37 2022] DELETE /identity/v3/users/5a0322e46e56463ca97f73e3a7d0e6fb => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:37.931968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48148188-3def-4e3a-b385-aa3b44f3d169 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:37.932675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48148188-3def-4e3a-b385-aa3b44f3d169 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:37.933109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48148188-3def-4e3a-b385-aa3b44f3d169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:37.967787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-48148188-3def-4e3a-b385-aa3b44f3d169 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:37.969436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-48148188-3def-4e3a-b385-aa3b44f3d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:37.995213 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:38.098150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:38.114428 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1141/2254] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:38.124033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:38.124033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:38.246968 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f249b-8d8a-44f6-bc6d-689396326246 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:38.251397 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e12fc-1c70-4f7c-82c7-71fbfc8cef8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:38.252619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e12fc-1c70-4f7c-82c7-71fbfc8cef8e service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:38.252901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e12fc-1c70-4f7c-82c7-71fbfc8cef8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:38.253174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e12fc-1c70-4f7c-82c7-71fbfc8cef8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:38.265384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e12fc-1c70-4f7c-82c7-71fbfc8cef8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:38.270578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e12fc-1c70-4f7c-82c7-71fbfc8cef8e service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:38.292059 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1114/2255] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:38.314122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48148188-3def-4e3a-b385-aa3b44f3d169 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:38.316475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-48148188-3def-4e3a-b385-aa3b44f3d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:38.357490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48148188-3def-4e3a-b385-aa3b44f3d169 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:38.370147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:38.370815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:38.372715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:38.372715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] PATH_INFO: `/v3/users/7d90e176c3f44a63a64c0f90141d6783` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:38.373792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d90e176c3f44a63a64c0f90141d6783)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:38.375899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:38.592215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d90e176c3f44a63a64c0f90141d6783'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:38.607658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d90e176c3f44a63a64c0f90141d6783'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:38.608448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d90e176c3f44a63a64c0f90141d6783'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:38.609072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d90e176c3f44a63a64c0f90141d6783'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:38.744240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d90e176c3f44a63a64c0f90141d6783'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:38.766027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1142/2256] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:38 2022] DELETE /identity/v3/users/7d90e176c3f44a63a64c0f90141d6783 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:38.771258 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d011959-d8f1-4ea0-84f3-557b67cf5293 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:38.771752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d011959-d8f1-4ea0-84f3-557b67cf5293 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:38.771854 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d011959-d8f1-4ea0-84f3-557b67cf5293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:38.796565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1d011959-d8f1-4ea0-84f3-557b67cf5293 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:38.798052 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1d011959-d8f1-4ea0-84f3-557b67cf5293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:38.897862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1115/2257] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:38.906424 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:38.906723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:38.980260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d011959-d8f1-4ea0-84f3-557b67cf5293 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:38.982818 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1d011959-d8f1-4ea0-84f3-557b67cf5293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:38.991046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d014e3-15dd-4abe-ac12-9a59fe1fd523 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:38.995689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf2a09-91b5-42bb-add8-5504b3d552d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:38.996680 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf2a09-91b5-42bb-add8-5504b3d552d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:38.997163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf2a09-91b5-42bb-add8-5504b3d552d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:38.997638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf2a09-91b5-42bb-add8-5504b3d552d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:39.004333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d011959-d8f1-4ea0-84f3-557b67cf5293 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:39.011585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf2a09-91b5-42bb-add8-5504b3d552d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:39.013601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf2a09-91b5-42bb-add8-5504b3d552d4 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:39.018932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40520dcf-b172-425a-9d67-be1687c7f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:39.020076 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40520dcf-b172-425a-9d67-be1687c7f5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:39.021391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40520dcf-b172-425a-9d67-be1687c7f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:39.021770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40520dcf-b172-425a-9d67-be1687c7f5ff admin admin] PATH_INFO: `/v3/projects/c5ce65180c104c678af797f1001548fa` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:39.023298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40520dcf-b172-425a-9d67-be1687c7f5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ce65180c104c678af797f1001548fa)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:39.025933 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40520dcf-b172-425a-9d67-be1687c7f5ff admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:39.030785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1143/2258] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:39.292117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-40520dcf-b172-425a-9d67-be1687c7f5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ce65180c104c678af797f1001548fa', 'request_id': 'req-40520dcf-b172-425a-9d67-be1687c7f5ff'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:39.332752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-40520dcf-b172-425a-9d67-be1687c7f5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ce65180c104c678af797f1001548fa', 'request_id': 'req-40520dcf-b172-425a-9d67-be1687c7f5ff'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:39.341673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-40520dcf-b172-425a-9d67-be1687c7f5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ce65180c104c678af797f1001548fa', 'request_id': 'req-40520dcf-b172-425a-9d67-be1687c7f5ff'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:39.492066 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-40520dcf-b172-425a-9d67-be1687c7f5ff admin admin] The token cache is being invalidate because project c5ce65180c104c678af797f1001548fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:39.492360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-40520dcf-b172-425a-9d67-be1687c7f5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:39.493269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-40520dcf-b172-425a-9d67-be1687c7f5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:39.494770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1116/2259] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:38 2022] DELETE /identity/v3/projects/c5ce65180c104c678af797f1001548fa => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:39.502293 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7869-ab4c-4ea7-8334-46ab006bfe3e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:39.502833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7869-ab4c-4ea7-8334-46ab006bfe3e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:39.505071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7869-ab4c-4ea7-8334-46ab006bfe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:39.571888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-959a7869-ab4c-4ea7-8334-46ab006bfe3e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:39.573171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-959a7869-ab4c-4ea7-8334-46ab006bfe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:39.676050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1144/2260] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:39.676805 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82672507-31ea-4a8a-b62a-c8de5e3a540a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:39.677107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82672507-31ea-4a8a-b62a-c8de5e3a540a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:39.677385 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82672507-31ea-4a8a-b62a-c8de5e3a540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:39.722205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-82672507-31ea-4a8a-b62a-c8de5e3a540a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:39.726396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-82672507-31ea-4a8a-b62a-c8de5e3a540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:39.742109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1117/2261] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:39.746504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a7869-ab4c-4ea7-8334-46ab006bfe3e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:39.758429 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a7869-ab4c-4ea7-8334-46ab006bfe3e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:39.763936 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a74cb-cc41-4f62-a8a3-e00ce6601cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:39.764578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a74cb-cc41-4f62-a8a3-e00ce6601cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:39.764904 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a74cb-cc41-4f62-a8a3-e00ce6601cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:39.765227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a74cb-cc41-4f62-a8a3-e00ce6601cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:39.766491 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a74cb-cc41-4f62-a8a3-e00ce6601cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:39.766491 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a74cb-cc41-4f62-a8a3-e00ce6601cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:39.768334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a74cb-cc41-4f62-a8a3-e00ce6601cf5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:39.791627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1145/2262] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:36:39.791868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82672507-31ea-4a8a-b62a-c8de5e3a540a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:39.808850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82672507-31ea-4a8a-b62a-c8de5e3a540a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:39.820812 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8de49d-25a2-4720-a6d4-d732b04abb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:39.823885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8de49d-25a2-4720-a6d4-d732b04abb53 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:39.823885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8de49d-25a2-4720-a6d4-d732b04abb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:39.823885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8de49d-25a2-4720-a6d4-d732b04abb53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:39.823885 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8de49d-25a2-4720-a6d4-d732b04abb53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:39.826282 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8de49d-25a2-4720-a6d4-d732b04abb53 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:39.916326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:40.008272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1118/2263] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:39 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:36:40.009290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a74cb-cc41-4f62-a8a3-e00ce6601cf5 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:40.022782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8de49d-25a2-4720-a6d4-d732b04abb53 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:40.024170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-107a74cb-cc41-4f62-a8a3-e00ce6601cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:40.074183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a74cb-cc41-4f62-a8a3-e00ce6601cf5 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:40.107474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8de49d-25a2-4720-a6d4-d732b04abb53 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:40.118670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4a1a7-76f3-4f44-bed4-bf90d12114fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:40.119301 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a1a7-76f3-4f44-bed4-bf90d12114fc admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:40.119582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a1a7-76f3-4f44-bed4-bf90d12114fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:40.120070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a1a7-76f3-4f44-bed4-bf90d12114fc admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:40.123005 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4a1a7-76f3-4f44-bed4-bf90d12114fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:40.126412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4a1a7-76f3-4f44-bed4-bf90d12114fc admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:40.155714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:40.156511 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:40.156854 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:40.157202 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] PATH_INFO: `/v3/projects/1744870dad474171abb158ad84d05514` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:40.159439 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1744870dad474171abb158ad84d05514)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:40.161940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:40.260545 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1119/2264] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:40 2022] POST /identity/v3/users => generated 281 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:40.269981 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4a1a7-76f3-4f44-bed4-bf90d12114fc admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:40.309333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4a1a7-76f3-4f44-bed4-bf90d12114fc admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:40.326012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81be42-3747-4558-b407-5e992e12cb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:40.326741 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81be42-3747-4558-b407-5e992e12cb3d admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:40.327635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81be42-3747-4558-b407-5e992e12cb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:40.328029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81be42-3747-4558-b407-5e992e12cb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:40.342325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81be42-3747-4558-b407-5e992e12cb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:40.345219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81be42-3747-4558-b407-5e992e12cb3d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:40.362291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1120/2265] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:40.363853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81be42-3747-4558-b407-5e992e12cb3d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:40.372093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1744870dad474171abb158ad84d05514', 'request_id': 'req-df5e8e2a-007b-4efb-829a-3febcecaf27a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:40.377741 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81be42-3747-4558-b407-5e992e12cb3d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:40.381550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1744870dad474171abb158ad84d05514', 'request_id': 'req-df5e8e2a-007b-4efb-829a-3febcecaf27a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:40.566651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550384f-de35-4cff-a270-a1810042ef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:40.566651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550384f-de35-4cff-a270-a1810042ef65 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:40.566651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550384f-de35-4cff-a270-a1810042ef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:40.566651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550384f-de35-4cff-a270-a1810042ef65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:40.568614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550384f-de35-4cff-a270-a1810042ef65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:40.568614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550384f-de35-4cff-a270-a1810042ef65 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:40.586394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1121/2266] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:40.587383 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550384f-de35-4cff-a270-a1810042ef65 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:40.601651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550384f-de35-4cff-a270-a1810042ef65 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:40.621275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a4e43-daec-40f8-92bc-a6dde77fbd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:40.621960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a4e43-daec-40f8-92bc-a6dde77fbd69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:40.622279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a4e43-daec-40f8-92bc-a6dde77fbd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:40.622597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a4e43-daec-40f8-92bc-a6dde77fbd69 admin admin] PATH_INFO: `/v3/projects/21225320d3ae4b79a330d7f7a84f5d90/users/e5f70bf5ef9c4168a00726175e702bb8/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:40.651229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a4e43-daec-40f8-92bc-a6dde77fbd69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21225320d3ae4b79a330d7f7a84f5d90, user_id=e5f70bf5ef9c4168a00726175e702bb8, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:40.654247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a4e43-daec-40f8-92bc-a6dde77fbd69 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:40.680119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1744870dad474171abb158ad84d05514', 'request_id': 'req-df5e8e2a-007b-4efb-829a-3febcecaf27a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:40.692878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] The token cache is being invalidate because project 1744870dad474171abb158ad84d05514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:40.693173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:40.693828 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:40.695983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1146/2267] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:40 2022] DELETE /identity/v3/projects/1744870dad474171abb158ad84d05514 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:40.699223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:40.700756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:40.723238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8e2a-007b-4efb-829a-3febcecaf27a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:40.723238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf0a9a-7f89-4d41-a772-babb250b68d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:40.723238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf0a9a-7f89-4d41-a772-babb250b68d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:40.723238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf0a9a-7f89-4d41-a772-babb250b68d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:40.728434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf0a9a-7f89-4d41-a772-babb250b68d0 admin admin] PATH_INFO: `/v3/users/32fae8e14c474268b58f83406ba99871` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:40.728434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf0a9a-7f89-4d41-a772-babb250b68d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32fae8e14c474268b58f83406ba99871)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:40.728434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf0a9a-7f89-4d41-a772-babb250b68d0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:40.755743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1122/2268] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:40 2022] PUT /identity/v3/projects/21225320d3ae4b79a330d7f7a84f5d90/users/e5f70bf5ef9c4168a00726175e702bb8/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:40.767134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87e573-ac6b-44d4-9b46-bad3e134c98a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:40.768292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87e573-ac6b-44d4-9b46-bad3e134c98a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:40.768593 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87e573-ac6b-44d4-9b46-bad3e134c98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:40.797914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-de87e573-ac6b-44d4-9b46-bad3e134c98a None None] MFA Rules not processed for user `e5f70bf5ef9c4168a00726175e702bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:40.799401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-de87e573-ac6b-44d4-9b46-bad3e134c98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:40.917331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1123/2269] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:40.923380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:40.959271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87e573-ac6b-44d4-9b46-bad3e134c98a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:40.964750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-de87e573-ac6b-44d4-9b46-bad3e134c98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:40.995684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bacf0a9a-7f89-4d41-a772-babb250b68d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32fae8e14c474268b58f83406ba99871'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:41.018717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bacf0a9a-7f89-4d41-a772-babb250b68d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32fae8e14c474268b58f83406ba99871'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:41.021435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bacf0a9a-7f89-4d41-a772-babb250b68d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32fae8e14c474268b58f83406ba99871'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:41.022454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bacf0a9a-7f89-4d41-a772-babb250b68d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32fae8e14c474268b58f83406ba99871'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:41.065087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87e573-ac6b-44d4-9b46-bad3e134c98a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:41.069466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d1144-7f6f-44e7-8922-fdb2d9acad69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:41.070509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d1144-7f6f-44e7-8922-fdb2d9acad69 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:41.071053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d1144-7f6f-44e7-8922-fdb2d9acad69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:41.071838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d1144-7f6f-44e7-8922-fdb2d9acad69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:41.077734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-df3d1144-7f6f-44e7-8922-fdb2d9acad69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:41.096863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d1144-7f6f-44e7-8922-fdb2d9acad69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:41.098910 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d1144-7f6f-44e7-8922-fdb2d9acad69 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:41.112467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1124/2270] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:41.131192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d1144-7f6f-44e7-8922-fdb2d9acad69 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:41.132899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-df3d1144-7f6f-44e7-8922-fdb2d9acad69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:41.201377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bacf0a9a-7f89-4d41-a772-babb250b68d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32fae8e14c474268b58f83406ba99871'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:41.250554 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1147/2271] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:40 2022] DELETE /identity/v3/users/32fae8e14c474268b58f83406ba99871 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:41.267355 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d1144-7f6f-44e7-8922-fdb2d9acad69 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:41.384754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:41.385406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:41.385685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:41.385958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] PATH_INFO: `/v3/users/e5f70bf5ef9c4168a00726175e702bb8` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:41.387577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f70bf5ef9c4168a00726175e702bb8)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:41.389560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:41.720905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f70bf5ef9c4168a00726175e702bb8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:41.736944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f70bf5ef9c4168a00726175e702bb8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:41.738221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f70bf5ef9c4168a00726175e702bb8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:41.825031 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f70bf5ef9c4168a00726175e702bb8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:41.854482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f70bf5ef9c4168a00726175e702bb8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:41.873573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1125/2272] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:41 2022] DELETE /identity/v3/users/e5f70bf5ef9c4168a00726175e702bb8 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:41.875813 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdebaf-47f2-49d1-ade6-b131b0f566b3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:41.879361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdebaf-47f2-49d1-ade6-b131b0f566b3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:41.879361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdebaf-47f2-49d1-ade6-b131b0f566b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:41.900335 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-23cdebaf-47f2-49d1-ade6-b131b0f566b3 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:41.902246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-23cdebaf-47f2-49d1-ade6-b131b0f566b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:42.017956 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1148/2273] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:42.027477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:42.028948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:42.104659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d02b7-72e2-4523-9a98-25529b49b1b9 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:42.109719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23945bb-135e-4ad8-83ef-cda5b9a3afe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:42.110499 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23945bb-135e-4ad8-83ef-cda5b9a3afe9 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:42.110776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23945bb-135e-4ad8-83ef-cda5b9a3afe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:42.111075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23945bb-135e-4ad8-83ef-cda5b9a3afe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:42.123193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23945bb-135e-4ad8-83ef-cda5b9a3afe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:42.123376 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23945bb-135e-4ad8-83ef-cda5b9a3afe9 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:42.147272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1126/2274] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:36:42.349614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdebaf-47f2-49d1-ade6-b131b0f566b3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:42.351597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-23cdebaf-47f2-49d1-ade6-b131b0f566b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:42.365399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdebaf-47f2-49d1-ade6-b131b0f566b3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:42.382616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:42.383366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:42.383709 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:42.384464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] PATH_INFO: `/v3/projects/607bda672b5d4f66b0963cdcb9508b76` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:42.385857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=607bda672b5d4f66b0963cdcb9508b76)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:42.389869 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:42.586613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '607bda672b5d4f66b0963cdcb9508b76', 'request_id': 'req-65acd545-d929-4cf2-b15c-9e46b0632784'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:42.592894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '607bda672b5d4f66b0963cdcb9508b76', 'request_id': 'req-65acd545-d929-4cf2-b15c-9e46b0632784'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:42.703181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '607bda672b5d4f66b0963cdcb9508b76', 'request_id': 'req-65acd545-d929-4cf2-b15c-9e46b0632784'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:42.714880 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] The token cache is being invalidate because project 607bda672b5d4f66b0963cdcb9508b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:42.715581 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:42.715933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:42.717431 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1149/2275] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:42 2022] DELETE /identity/v3/projects/607bda672b5d4f66b0963cdcb9508b76 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:42.721619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23945bb-135e-4ad8-83ef-cda5b9a3afe9 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:42.731798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23945bb-135e-4ad8-83ef-cda5b9a3afe9 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:42.786854 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f1d90-ed6a-4980-a14b-c820b62baf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:42.787471 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f1d90-ed6a-4980-a14b-c820b62baf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:42.787753 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f1d90-ed6a-4980-a14b-c820b62baf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:42.788065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f1d90-ed6a-4980-a14b-c820b62baf37 admin admin] PATH_INFO: `/v3/users/71de9982834941ea9d8d74bb83a10e15` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:42.789186 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f1d90-ed6a-4980-a14b-c820b62baf37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71de9982834941ea9d8d74bb83a10e15)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:42.791114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f1d90-ed6a-4980-a14b-c820b62baf37 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:43.126127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-3b9f1d90-ed6a-4980-a14b-c820b62baf37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71de9982834941ea9d8d74bb83a10e15'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:43.133689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-3b9f1d90-ed6a-4980-a14b-c820b62baf37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71de9982834941ea9d8d74bb83a10e15'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:43.134396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-3b9f1d90-ed6a-4980-a14b-c820b62baf37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71de9982834941ea9d8d74bb83a10e15'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:43.174406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:43.175872 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:43.189143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acd545-d929-4cf2-b15c-9e46b0632784 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:43.194524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bd617-9a6d-4b92-b7c9-28c49ab89a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:43.195198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bd617-9a6d-4b92-b7c9-28c49ab89a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:43.195479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bd617-9a6d-4b92-b7c9-28c49ab89a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:43.195748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bd617-9a6d-4b92-b7c9-28c49ab89a86 admin admin] PATH_INFO: `/v3/projects/21225320d3ae4b79a330d7f7a84f5d90` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:43.198510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bd617-9a6d-4b92-b7c9-28c49ab89a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21225320d3ae4b79a330d7f7a84f5d90)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:43.198788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bd617-9a6d-4b92-b7c9-28c49ab89a86 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:43.257558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-3b9f1d90-ed6a-4980-a14b-c820b62baf37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71de9982834941ea9d8d74bb83a10e15'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:43.270330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-3b9f1d90-ed6a-4980-a14b-c820b62baf37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71de9982834941ea9d8d74bb83a10e15'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:43.276476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1127/2276] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:42 2022] DELETE /identity/v3/users/71de9982834941ea9d8d74bb83a10e15 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:43.360345 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-371bd617-9a6d-4b92-b7c9-28c49ab89a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21225320d3ae4b79a330d7f7a84f5d90', 'request_id': 'req-371bd617-9a6d-4b92-b7c9-28c49ab89a86'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:43.368180 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-371bd617-9a6d-4b92-b7c9-28c49ab89a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21225320d3ae4b79a330d7f7a84f5d90', 'request_id': 'req-371bd617-9a6d-4b92-b7c9-28c49ab89a86'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:43.460653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-371bd617-9a6d-4b92-b7c9-28c49ab89a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21225320d3ae4b79a330d7f7a84f5d90', 'request_id': 'req-371bd617-9a6d-4b92-b7c9-28c49ab89a86'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:43.475908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-371bd617-9a6d-4b92-b7c9-28c49ab89a86 admin admin] The token cache is being invalidate because project 21225320d3ae4b79a330d7f7a84f5d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:43.476246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-371bd617-9a6d-4b92-b7c9-28c49ab89a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:43.476906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-371bd617-9a6d-4b92-b7c9-28c49ab89a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:43.478729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1150/2277] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:43 2022] DELETE /identity/v3/projects/21225320d3ae4b79a330d7f7a84f5d90 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:43.483794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc19544-8239-48f0-901e-d32bd10f5b82 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:43.484124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc19544-8239-48f0-901e-d32bd10f5b82 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:43.484421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc19544-8239-48f0-901e-d32bd10f5b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:43.504832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-8cc19544-8239-48f0-901e-d32bd10f5b82 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:43.506187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8cc19544-8239-48f0-901e-d32bd10f5b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:43.577348 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1128/2278] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:43.585930 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8cdff-7d87-46d8-8049-b9d7f1b1f139 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:43.586498 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8cdff-7d87-46d8-8049-b9d7f1b1f139 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:43.587057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8cdff-7d87-46d8-8049-b9d7f1b1f139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:43.609752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-09e8cdff-7d87-46d8-8049-b9d7f1b1f139 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:43.611269 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-09e8cdff-7d87-46d8-8049-b9d7f1b1f139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:43.621445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1151/2279] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:43.625952 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc19544-8239-48f0-901e-d32bd10f5b82 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:43.637511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc19544-8239-48f0-901e-d32bd10f5b82 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:43.642817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cb714-a094-40f9-8210-0444b8086a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:43.643799 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cb714-a094-40f9-8210-0444b8086a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:43.645535 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cb714-a094-40f9-8210-0444b8086a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:43.645535 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cb714-a094-40f9-8210-0444b8086a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:43.645535 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cb714-a094-40f9-8210-0444b8086a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:43.645535 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cb714-a094-40f9-8210-0444b8086a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:43.647327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cb714-a094-40f9-8210-0444b8086a9b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:43.659018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1129/2280] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:36:43.663159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8cdff-7d87-46d8-8049-b9d7f1b1f139 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:43.672516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8cdff-7d87-46d8-8049-b9d7f1b1f139 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:43.677499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb7434-02ee-45c2-98f5-d4afb3ec6885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:43.678159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb7434-02ee-45c2-98f5-d4afb3ec6885 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:43.678467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb7434-02ee-45c2-98f5-d4afb3ec6885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:43.678779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb7434-02ee-45c2-98f5-d4afb3ec6885 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:43.679421 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb7434-02ee-45c2-98f5-d4afb3ec6885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:43.681397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb7434-02ee-45c2-98f5-d4afb3ec6885 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:43.788421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:43.789192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cb714-a094-40f9-8210-0444b8086a9b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:43.793394 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1152/2281] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:43 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:43.795681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-918cb714-a094-40f9-8210-0444b8086a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:43.797078 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb7434-02ee-45c2-98f5-d4afb3ec6885 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:43.835363 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cb714-a094-40f9-8210-0444b8086a9b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:43.890096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb7434-02ee-45c2-98f5-d4afb3ec6885 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:43.895866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a52c86-29cf-4c11-9d48-55ab5585a2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:43.896503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52c86-29cf-4c11-9d48-55ab5585a2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:43.896781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52c86-29cf-4c11-9d48-55ab5585a2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:43.897051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52c86-29cf-4c11-9d48-55ab5585a2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:43.897687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a52c86-29cf-4c11-9d48-55ab5585a2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:43.899634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a52c86-29cf-4c11-9d48-55ab5585a2f3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:43.905674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:43.906324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:43.906607 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:43.906880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] PATH_INFO: `/v3/projects/76001a5ffaa44c93ac7e43878a1946bb` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:43.910836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76001a5ffaa44c93ac7e43878a1946bb)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:43.913742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:43.937580 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:44.052920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1153/2282] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:43 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:44.054010 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085c1d9-d2ca-49a3-9863-4494ab8762ab None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.054291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085c1d9-d2ca-49a3-9863-4494ab8762ab None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.054568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085c1d9-d2ca-49a3-9863-4494ab8762ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.069327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76001a5ffaa44c93ac7e43878a1946bb', 'request_id': 'req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:44.074394 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a085c1d9-d2ca-49a3-9863-4494ab8762ab None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:44.094214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76001a5ffaa44c93ac7e43878a1946bb', 'request_id': 'req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:44.094369 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a085c1d9-d2ca-49a3-9863-4494ab8762ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:44.094469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76001a5ffaa44c93ac7e43878a1946bb', 'request_id': 'req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:44.131505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1154/2283] 10.222.0.33 () {58 vars in 967 bytes} [Tue Oct 4 10:36:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:44.132516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085c1d9-d2ca-49a3-9863-4494ab8762ab None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:44.198095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085c1d9-d2ca-49a3-9863-4494ab8762ab None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:44.204569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1aaf-1367-4913-be72-6a05c4e3a9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:44.204569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1aaf-1367-4913-be72-6a05c4e3a9de admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.205099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1aaf-1367-4913-be72-6a05c4e3a9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.205302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1aaf-1367-4913-be72-6a05c4e3a9de admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.206026 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e1aaf-1367-4913-be72-6a05c4e3a9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:44.207741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e1aaf-1367-4913-be72-6a05c4e3a9de admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:44.221070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1155/2284] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:44.221070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1aaf-1367-4913-be72-6a05c4e3a9de admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:44.221070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ca3e1aaf-1367-4913-be72-6a05c4e3a9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:44.240942 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] The token cache is being invalidate because project 76001a5ffaa44c93ac7e43878a1946bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:44.241490 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:44.242241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:44.244159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1130/2285] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:43 2022] DELETE /identity/v3/projects/76001a5ffaa44c93ac7e43878a1946bb => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:44.244997 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:44.246399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:44.260830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9377fb-b8c3-4ef8-a02f-1e67dd315848 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:44.265645 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b62d9e-da16-4edf-892a-037f961cab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:44.266252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b62d9e-da16-4edf-892a-037f961cab46 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.266772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b62d9e-da16-4edf-892a-037f961cab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.267235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b62d9e-da16-4edf-892a-037f961cab46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.267889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b62d9e-da16-4edf-892a-037f961cab46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:44.269515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b62d9e-da16-4edf-892a-037f961cab46 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:44.280369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1131/2286] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:44.281612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437933-bb86-4c06-8fa4-ce1e5dfa38d3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.281896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437933-bb86-4c06-8fa4-ce1e5dfa38d3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.282168 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437933-bb86-4c06-8fa4-ce1e5dfa38d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.310539 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1aaf-1367-4913-be72-6a05c4e3a9de admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:44.314588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-aa437933-bb86-4c06-8fa4-ce1e5dfa38d3 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:44.316065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-aa437933-bb86-4c06-8fa4-ce1e5dfa38d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:44.324893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cdb10-3517-4d3a-aabd-c97ed1fee44b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:44.326176 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cdb10-3517-4d3a-aabd-c97ed1fee44b service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.326573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1132/2287] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:44.326792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cdb10-3517-4d3a-aabd-c97ed1fee44b service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.327241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cdb10-3517-4d3a-aabd-c97ed1fee44b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.327598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437933-bb86-4c06-8fa4-ce1e5dfa38d3 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:44.329637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-111cdb10-3517-4d3a-aabd-c97ed1fee44b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:44.338109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437933-bb86-4c06-8fa4-ce1e5dfa38d3 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:44.343063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa89ef-7486-4a5c-bb8b-0932cea685ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:44.343721 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa89ef-7486-4a5c-bb8b-0932cea685ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.344038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa89ef-7486-4a5c-bb8b-0932cea685ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.344300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa89ef-7486-4a5c-bb8b-0932cea685ef admin admin] PATH_INFO: `/v3/projects/8f947e01b5c94e4abf8f96daa46bd61e/users/602b605145384996a9e11cf918db9ede/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.351383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cdb10-3517-4d3a-aabd-c97ed1fee44b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:44.353251 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cdb10-3517-4d3a-aabd-c97ed1fee44b service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:44.360372 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa89ef-7486-4a5c-bb8b-0932cea685ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f947e01b5c94e4abf8f96daa46bd61e, user_id=602b605145384996a9e11cf918db9ede, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:44.363624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa89ef-7486-4a5c-bb8b-0932cea685ef admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:44.370663 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1156/2288] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:36:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:36:44.372037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60bd0c-a5c0-4f9f-b9d6-3e6d76aaa14e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.372534 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60bd0c-a5c0-4f9f-b9d6-3e6d76aaa14e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.372890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60bd0c-a5c0-4f9f-b9d6-3e6d76aaa14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.393087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7b60bd0c-a5c0-4f9f-b9d6-3e6d76aaa14e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:44.394230 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7b60bd0c-a5c0-4f9f-b9d6-3e6d76aaa14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:44.402380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1157/2289] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:44.406514 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60bd0c-a5c0-4f9f-b9d6-3e6d76aaa14e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:44.415723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60bd0c-a5c0-4f9f-b9d6-3e6d76aaa14e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:44.420327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321aa88-d821-4c14-9a05-d991c783dcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:44.420892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321aa88-d821-4c14-9a05-d991c783dcba admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.421170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321aa88-d821-4c14-9a05-d991c783dcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.421440 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321aa88-d821-4c14-9a05-d991c783dcba admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.422070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321aa88-d821-4c14-9a05-d991c783dcba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:44.422397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321aa88-d821-4c14-9a05-d991c783dcba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:44.424641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321aa88-d821-4c14-9a05-d991c783dcba admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:44.436473 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1158/2290] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:36:44.442094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321aa88-d821-4c14-9a05-d991c783dcba admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:44.451981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321aa88-d821-4c14-9a05-d991c783dcba admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:44.456877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee38ea5-c316-49ff-85c4-7a1f168758f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:44.457460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38ea5-c316-49ff-85c4-7a1f168758f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.457738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38ea5-c316-49ff-85c4-7a1f168758f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.458007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38ea5-c316-49ff-85c4-7a1f168758f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.458627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee38ea5-c316-49ff-85c4-7a1f168758f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:44.460625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee38ea5-c316-49ff-85c4-7a1f168758f3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:44.572934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1133/2291] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:44 2022] PUT /identity/v3/projects/8f947e01b5c94e4abf8f96daa46bd61e/users/602b605145384996a9e11cf918db9ede/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:44.583127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c5de-da7e-4723-9269-64ad7c739e75 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.583421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c5de-da7e-4723-9269-64ad7c739e75 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.584244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c5de-da7e-4723-9269-64ad7c739e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.599254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1159/2292] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:44 2022] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:36:44.602679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee38ea5-c316-49ff-85c4-7a1f168758f3 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:44.618243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-7179c5de-da7e-4723-9269-64ad7c739e75 None None] MFA Rules not processed for user `602b605145384996a9e11cf918db9ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:44.619514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7179c5de-da7e-4723-9269-64ad7c739e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:44.690744 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee38ea5-c316-49ff-85c4-7a1f168758f3 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:44.695583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11874993-1552-48dd-a8cb-fcdfd03f99f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:44.698419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11874993-1552-48dd-a8cb-fcdfd03f99f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.698707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11874993-1552-48dd-a8cb-fcdfd03f99f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.698988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11874993-1552-48dd-a8cb-fcdfd03f99f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.699644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11874993-1552-48dd-a8cb-fcdfd03f99f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:44.702743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11874993-1552-48dd-a8cb-fcdfd03f99f5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:44.714349 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1134/2293] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:44.715281 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c5de-da7e-4723-9269-64ad7c739e75 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:44.727597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c5de-da7e-4723-9269-64ad7c739e75 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:44.736992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2992c-6ba9-40f4-865f-7352dcb36a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:44.737835 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2992c-6ba9-40f4-865f-7352dcb36a11 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.738340 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2992c-6ba9-40f4-865f-7352dcb36a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.738862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2992c-6ba9-40f4-865f-7352dcb36a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.739647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2992c-6ba9-40f4-865f-7352dcb36a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:44.741775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2992c-6ba9-40f4-865f-7352dcb36a11 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:44.846585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1160/2294] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:44 2022] POST /identity/v3/users => generated 284 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:44.850456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11874993-1552-48dd-a8cb-fcdfd03f99f5 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:44.860119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11874993-1552-48dd-a8cb-fcdfd03f99f5 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:44.864706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb447985-ad2e-47f5-8f1b-8f57229e1332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:44.865271 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb447985-ad2e-47f5-8f1b-8f57229e1332 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.865550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb447985-ad2e-47f5-8f1b-8f57229e1332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.865815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb447985-ad2e-47f5-8f1b-8f57229e1332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.866442 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb447985-ad2e-47f5-8f1b-8f57229e1332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:44.868241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb447985-ad2e-47f5-8f1b-8f57229e1332 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:44.878119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1161/2295] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:36:44.881955 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb447985-ad2e-47f5-8f1b-8f57229e1332 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:44.891875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb447985-ad2e-47f5-8f1b-8f57229e1332 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:44.897090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57b093-8673-4411-bbd6-e9c7d9a23eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:44.897616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b093-8673-4411-bbd6-e9c7d9a23eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.897895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b093-8673-4411-bbd6-e9c7d9a23eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.898176 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b093-8673-4411-bbd6-e9c7d9a23eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.898810 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57b093-8673-4411-bbd6-e9c7d9a23eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:44.900942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57b093-8673-4411-bbd6-e9c7d9a23eb8 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:44.914244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1162/2296] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:44.918046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57b093-8673-4411-bbd6-e9c7d9a23eb8 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:44.922278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1135/2297] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:44 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:44.923888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2992c-6ba9-40f4-865f-7352dcb36a11 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:44.929289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57b093-8673-4411-bbd6-e9c7d9a23eb8 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:44.992864 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bfe57-7e77-44f8-9c72-49827556118a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:44.993091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2992c-6ba9-40f4-865f-7352dcb36a11 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:44.993649 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bfe57-7e77-44f8-9c72-49827556118a admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.993923 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bfe57-7e77-44f8-9c72-49827556118a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.994197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bfe57-7e77-44f8-9c72-49827556118a admin admin] PATH_INFO: `/v3/projects/4612db572cf64a719597104b74db3a51/users/db066a72956f473b900a4cc4f10adfe2/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.997919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a867092-bd88-4ada-950f-8bfbc299e2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:44.998610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a867092-bd88-4ada-950f-8bfbc299e2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:44.998893 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a867092-bd88-4ada-950f-8bfbc299e2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:44.999168 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a867092-bd88-4ada-950f-8bfbc299e2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:44.999809 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a867092-bd88-4ada-950f-8bfbc299e2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:45.002053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a867092-bd88-4ada-950f-8bfbc299e2f2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:45.012471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bfe57-7e77-44f8-9c72-49827556118a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4612db572cf64a719597104b74db3a51, user_id=db066a72956f473b900a4cc4f10adfe2, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:45.015198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bfe57-7e77-44f8-9c72-49827556118a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:45.178768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1163/2298] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:44 2022] PUT /identity/v3/projects/4612db572cf64a719597104b74db3a51/users/db066a72956f473b900a4cc4f10adfe2/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:45.179133 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1136/2299] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:44 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:45.188244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bfe57-7e77-44f8-9c72-49827556118a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:45.189005 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59a653-bf77-4b70-b63d-5d28752522e2 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:45.189310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59a653-bf77-4b70-b63d-5d28752522e2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:45.189585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59a653-bf77-4b70-b63d-5d28752522e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:45.218407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3c59a653-bf77-4b70-b63d-5d28752522e2 None None] MFA Rules not processed for user `db066a72956f473b900a4cc4f10adfe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:45.219616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3c59a653-bf77-4b70-b63d-5d28752522e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:45.255655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bfe57-7e77-44f8-9c72-49827556118a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:45.260885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9990c-48f2-4185-84b8-b44023004bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:45.261547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9990c-48f2-4185-84b8-b44023004bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:45.261829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9990c-48f2-4185-84b8-b44023004bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:45.262102 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9990c-48f2-4185-84b8-b44023004bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:45.262749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9990c-48f2-4185-84b8-b44023004bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:45.264381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9990c-48f2-4185-84b8-b44023004bd4 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:45.274423 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1164/2300] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:36:45.283657 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9990c-48f2-4185-84b8-b44023004bd4 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:45.286600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1137/2301] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:45.295980 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9990c-48f2-4185-84b8-b44023004bd4 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:45.298138 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59a653-bf77-4b70-b63d-5d28752522e2 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:45.300131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3c59a653-bf77-4b70-b63d-5d28752522e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:45.302075 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2634b1-0eb5-4c6e-88d2-3e11e05b0563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:45.302683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2634b1-0eb5-4c6e-88d2-3e11e05b0563 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:45.303010 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2634b1-0eb5-4c6e-88d2-3e11e05b0563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:45.303287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2634b1-0eb5-4c6e-88d2-3e11e05b0563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:45.304427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2634b1-0eb5-4c6e-88d2-3e11e05b0563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:45.306147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2634b1-0eb5-4c6e-88d2-3e11e05b0563 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:45.323381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1165/2302] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:36:45.327327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2634b1-0eb5-4c6e-88d2-3e11e05b0563 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:45.339673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2634b1-0eb5-4c6e-88d2-3e11e05b0563 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:45.344888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e4d74-57fc-4924-b9af-d12cb423de22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:45.346206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e4d74-57fc-4924-b9af-d12cb423de22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:45.346322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e4d74-57fc-4924-b9af-d12cb423de22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:45.346573 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e4d74-57fc-4924-b9af-d12cb423de22 admin admin] PATH_INFO: `/v3/projects/bf87a0037a9e49918be7364a86b3c223/users/6d64f0b9931c46758fd4861d545c49ee/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:45.371584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59a653-bf77-4b70-b63d-5d28752522e2 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:45.375339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e4d74-57fc-4924-b9af-d12cb423de22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf87a0037a9e49918be7364a86b3c223, user_id=6d64f0b9931c46758fd4861d545c49ee, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:45.377563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd446a-5bf4-4161-bad6-6dd76929516d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6462736c485545d8a26766360ebe0c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:45.377563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd446a-5bf4-4161-bad6-6dd76929516d service glance] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:45.377563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd446a-5bf4-4161-bad6-6dd76929516d service glance] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:45.377563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd446a-5bf4-4161-bad6-6dd76929516d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:45.378156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e4d74-57fc-4924-b9af-d12cb423de22 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:45.386475 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd446a-5bf4-4161-bad6-6dd76929516d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:45.387772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd446a-5bf4-4161-bad6-6dd76929516d service glance] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:45.396964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1138/2303] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:45.493415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1166/2304] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:45 2022] PUT /identity/v3/projects/bf87a0037a9e49918be7364a86b3c223/users/6d64f0b9931c46758fd4861d545c49ee/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:45.504838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d22f9-649d-425d-9642-b9afb5d153c2 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:45.505193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d22f9-649d-425d-9642-b9afb5d153c2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:45.505577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d22f9-649d-425d-9642-b9afb5d153c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:45.551107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-740d22f9-649d-425d-9642-b9afb5d153c2 None None] MFA Rules not processed for user `6d64f0b9931c46758fd4861d545c49ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:45.553039 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-740d22f9-649d-425d-9642-b9afb5d153c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:45.631368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1139/2305] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:45.643211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e4d74-57fc-4924-b9af-d12cb423de22 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:45.707238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e4d74-57fc-4924-b9af-d12cb423de22 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:45.712172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed0a8c-8df4-47ce-8e3d-cda32c485990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:45.712903 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed0a8c-8df4-47ce-8e3d-cda32c485990 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:45.713534 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed0a8c-8df4-47ce-8e3d-cda32c485990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:45.713945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed0a8c-8df4-47ce-8e3d-cda32c485990 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:45.714745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed0a8c-8df4-47ce-8e3d-cda32c485990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:45.716808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed0a8c-8df4-47ce-8e3d-cda32c485990 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:45.883344 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1167/2306] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:45 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:45.887580 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d22f9-649d-425d-9642-b9afb5d153c2 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:45.899718 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d22f9-649d-425d-9642-b9afb5d153c2 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:45.989325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1dd10-80d8-46cb-9e58-c2b3c5bfe73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:45.990091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1dd10-80d8-46cb-9e58-c2b3c5bfe73f admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:45.990369 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1dd10-80d8-46cb-9e58-c2b3c5bfe73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:45.990651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1dd10-80d8-46cb-9e58-c2b3c5bfe73f admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:45.991298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1dd10-80d8-46cb-9e58-c2b3c5bfe73f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:45.993261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1dd10-80d8-46cb-9e58-c2b3c5bfe73f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:46.143561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1140/2307] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:45 2022] POST /identity/v3/users => generated 299 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:46.147473 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed0a8c-8df4-47ce-8e3d-cda32c485990 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:46.161524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed0a8c-8df4-47ce-8e3d-cda32c485990 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:46.168012 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e817f9-c695-48f8-9273-e33102a92abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:46.168605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e817f9-c695-48f8-9273-e33102a92abc admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:46.168982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e817f9-c695-48f8-9273-e33102a92abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:46.169452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e817f9-c695-48f8-9273-e33102a92abc admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:46.170683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e817f9-c695-48f8-9273-e33102a92abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:46.172512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e817f9-c695-48f8-9273-e33102a92abc admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:46.190726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1168/2308] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:46.195046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1dd10-80d8-46cb-9e58-c2b3c5bfe73f admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:46.217946 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1dd10-80d8-46cb-9e58-c2b3c5bfe73f admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:46.223768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d2caa-6be7-4b56-8fc7-4481d4a2eda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:46.224579 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d2caa-6be7-4b56-8fc7-4481d4a2eda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:46.224956 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d2caa-6be7-4b56-8fc7-4481d4a2eda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:46.225726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d2caa-6be7-4b56-8fc7-4481d4a2eda7 admin admin] PATH_INFO: `/v3/projects/b86d80e176474f6f86ad01be91c757e7/users/024f21813e8944b8b0f545268ff7b806/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:46.252359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d2caa-6be7-4b56-8fc7-4481d4a2eda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86d80e176474f6f86ad01be91c757e7, user_id=024f21813e8944b8b0f545268ff7b806, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:46.255022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d2caa-6be7-4b56-8fc7-4481d4a2eda7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:46.334222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1141/2309] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:46 2022] PUT /identity/v3/projects/b86d80e176474f6f86ad01be91c757e7/users/024f21813e8944b8b0f545268ff7b806/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:46.338706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e817f9-c695-48f8-9273-e33102a92abc admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:46.350653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e817f9-c695-48f8-9273-e33102a92abc admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:46.438205 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcded78-cc30-4a57-ab98-104319c054cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:46.439105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcded78-cc30-4a57-ab98-104319c054cd admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:46.439391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcded78-cc30-4a57-ab98-104319c054cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:46.439860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcded78-cc30-4a57-ab98-104319c054cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:46.440540 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcded78-cc30-4a57-ab98-104319c054cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:46.442866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcded78-cc30-4a57-ab98-104319c054cd admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:46.453830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1169/2310] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:36:46.458463 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d2caa-6be7-4b56-8fc7-4481d4a2eda7 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:46.470708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d2caa-6be7-4b56-8fc7-4481d4a2eda7 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:46.480235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7d264-746b-457c-882f-97e0d266be22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:46.480235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d264-746b-457c-882f-97e0d266be22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:46.480235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d264-746b-457c-882f-97e0d266be22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:46.480235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d264-746b-457c-882f-97e0d266be22 admin admin] PATH_INFO: `/v3/projects/b86d80e176474f6f86ad01be91c757e7/users/024f21813e8944b8b0f545268ff7b806/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:46.485515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7d264-746b-457c-882f-97e0d266be22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86d80e176474f6f86ad01be91c757e7, user_id=024f21813e8944b8b0f545268ff7b806, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:46.488314 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7d264-746b-457c-882f-97e0d266be22 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:46.509249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1142/2311] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:46 2022] PUT /identity/v3/projects/b86d80e176474f6f86ad01be91c757e7/users/024f21813e8944b8b0f545268ff7b806/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:46.520166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bac37-ebde-4c48-854d-f197c64773fe None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:46.520621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bac37-ebde-4c48-854d-f197c64773fe None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:46.521118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bac37-ebde-4c48-854d-f197c64773fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:46.556655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-563bac37-ebde-4c48-854d-f197c64773fe None None] MFA Rules not processed for user `024f21813e8944b8b0f545268ff7b806`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:46.561064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-563bac37-ebde-4c48-854d-f197c64773fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:46.638860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1170/2312] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:46.650990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7d264-746b-457c-882f-97e0d266be22 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:46.652817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3af7d264-746b-457c-882f-97e0d266be22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:46.729127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7d264-746b-457c-882f-97e0d266be22 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:46.734775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a122fc3-56a6-4069-9308-c34b3279fd8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:46.735776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a122fc3-56a6-4069-9308-c34b3279fd8a service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:46.736086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a122fc3-56a6-4069-9308-c34b3279fd8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:46.736392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a122fc3-56a6-4069-9308-c34b3279fd8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:46.801660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a122fc3-56a6-4069-9308-c34b3279fd8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:46.803103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a122fc3-56a6-4069-9308-c34b3279fd8a service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:46.815526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1143/2313] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:47.291892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681bd07-ebaa-41fe-b09f-3e1852cd16cb None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:47.292191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681bd07-ebaa-41fe-b09f-3e1852cd16cb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:47.292476 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681bd07-ebaa-41fe-b09f-3e1852cd16cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:47.319034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7681bd07-ebaa-41fe-b09f-3e1852cd16cb None None] MFA Rules not processed for user `eac479fab6e84174857d9bea3be6f423`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:47.320290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7681bd07-ebaa-41fe-b09f-3e1852cd16cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:47.400539 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1171/2314] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:48.046338 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:48.063655 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d01061-6a6b-476f-b762-506a4356a8d4 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:48.065070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d01061-6a6b-476f-b762-506a4356a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:48.065447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d01061-6a6b-476f-b762-506a4356a8d4 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:48.067141 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1144/2315] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:36:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:36:48.096858 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff4a0-32f5-4c2d-8b70-a44f9ea00a8f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:48.097922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff4a0-32f5-4c2d-8b70-a44f9ea00a8f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:48.098133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff4a0-32f5-4c2d-8b70-a44f9ea00a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:48.122900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e13ff4a0-32f5-4c2d-8b70-a44f9ea00a8f None None] MFA Rules not processed for user `505c7c48b0d14dc9af8006cc7e8eea53`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:48.124133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e13ff4a0-32f5-4c2d-8b70-a44f9ea00a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:48.183052 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:48.227059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1172/2316] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:36:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:48.239825 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d01061-6a6b-476f-b762-506a4356a8d4 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:48.241837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-10d01061-6a6b-476f-b762-506a4356a8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:48.269279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d01061-6a6b-476f-b762-506a4356a8d4 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:48.271668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac5c46-965e-4317-9b96-b28051ff42d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:48.272444 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac5c46-965e-4317-9b96-b28051ff42d6 service placement] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:48.272978 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac5c46-965e-4317-9b96-b28051ff42d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:48.273324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac5c46-965e-4317-9b96-b28051ff42d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:48.283291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac5c46-965e-4317-9b96-b28051ff42d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:48.285016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac5c46-965e-4317-9b96-b28051ff42d6 service placement] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:48.306776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1145/2317] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:48.344198 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ff4a0-32f5-4c2d-8b70-a44f9ea00a8f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:48.347074 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e13ff4a0-32f5-4c2d-8b70-a44f9ea00a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:48.517341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ff4a0-32f5-4c2d-8b70-a44f9ea00a8f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:48.533627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:48.534560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:48.534889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:48.535177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] PATH_INFO: `/v3/users/f5ca1bc84be04e61a641b18b26cb63cf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:48.536672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ca1bc84be04e61a641b18b26cb63cf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:48.538689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:49.163374 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ca1bc84be04e61a641b18b26cb63cf'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:49.170833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ca1bc84be04e61a641b18b26cb63cf'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:49.172097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ca1bc84be04e61a641b18b26cb63cf'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:49.172957 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ca1bc84be04e61a641b18b26cb63cf'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:49.292384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ca1bc84be04e61a641b18b26cb63cf'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:49.358571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1173/2318] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:48 2022] DELETE /identity/v3/users/f5ca1bc84be04e61a641b18b26cb63cf => generated 0 bytes in 1015 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:49.409792 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac5c46-965e-4317-9b96-b28051ff42d6 service placement] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:49.420679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac5c46-965e-4317-9b96-b28051ff42d6 service placement] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:49.511776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17be8f-9869-49b6-a95d-55c4febf5cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:49.512905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17be8f-9869-49b6-a95d-55c4febf5cab service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:49.513395 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17be8f-9869-49b6-a95d-55c4febf5cab service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:49.513988 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17be8f-9869-49b6-a95d-55c4febf5cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:49.517522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dd17be8f-9869-49b6-a95d-55c4febf5cab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:49.632696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17be8f-9869-49b6-a95d-55c4febf5cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:49.635048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17be8f-9869-49b6-a95d-55c4febf5cab service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:49.647196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1146/2319] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:49.904801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:49.906562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:49.996686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afea802-8811-4ebb-9359-c57d734167e7 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:50.006621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d340e10-3491-4053-8cb2-6a2bcc097677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:50.007175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d340e10-3491-4053-8cb2-6a2bcc097677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:50.007458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d340e10-3491-4053-8cb2-6a2bcc097677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:50.007797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d340e10-3491-4053-8cb2-6a2bcc097677 admin admin] PATH_INFO: `/v3/projects/314c89250b644fd695ae3966757dfb20` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:50.008987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d340e10-3491-4053-8cb2-6a2bcc097677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=314c89250b644fd695ae3966757dfb20)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:50.010925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d340e10-3491-4053-8cb2-6a2bcc097677 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:50.011624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38461d8a-c719-4ca4-b95d-02872982c0b1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:50.011912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38461d8a-c719-4ca4-b95d-02872982c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:50.012225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38461d8a-c719-4ca4-b95d-02872982c0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:50.041383 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-38461d8a-c719-4ca4-b95d-02872982c0b1 None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:50.042602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-38461d8a-c719-4ca4-b95d-02872982c0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:50.097446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1147/2320] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:36:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:50.112755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38461d8a-c719-4ca4-b95d-02872982c0b1 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:50.114214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-38461d8a-c719-4ca4-b95d-02872982c0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:50.183865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8d340e10-3491-4053-8cb2-6a2bcc097677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314c89250b644fd695ae3966757dfb20', 'request_id': 'req-8d340e10-3491-4053-8cb2-6a2bcc097677'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:50.198103 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8d340e10-3491-4053-8cb2-6a2bcc097677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314c89250b644fd695ae3966757dfb20', 'request_id': 'req-8d340e10-3491-4053-8cb2-6a2bcc097677'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:50.203294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38461d8a-c719-4ca4-b95d-02872982c0b1 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:50.263442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4df4cd-a895-48d9-8764-fa61211d942b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:50.264113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df4cd-a895-48d9-8764-fa61211d942b service swift] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:50.264389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df4cd-a895-48d9-8764-fa61211d942b service swift] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:50.264657 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df4cd-a895-48d9-8764-fa61211d942b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:50.291480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8d340e10-3491-4053-8cb2-6a2bcc097677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314c89250b644fd695ae3966757dfb20', 'request_id': 'req-8d340e10-3491-4053-8cb2-6a2bcc097677'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:50.305038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8d340e10-3491-4053-8cb2-6a2bcc097677 admin admin] The token cache is being invalidate because project 314c89250b644fd695ae3966757dfb20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:50.305387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8d340e10-3491-4053-8cb2-6a2bcc097677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:50.305984 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8d340e10-3491-4053-8cb2-6a2bcc097677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:50.307699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1174/2321] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:49 2022] DELETE /identity/v3/projects/314c89250b644fd695ae3966757dfb20 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:50.314144 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9590474-af9a-4b3b-b048-e9887c5f80b6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:50.314454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9590474-af9a-4b3b-b048-e9887c5f80b6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:50.314707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9590474-af9a-4b3b-b048-e9887c5f80b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:50.332240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4df4cd-a895-48d9-8764-fa61211d942b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:50.333815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4df4cd-a895-48d9-8764-fa61211d942b service swift] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:50.334953 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c9590474-af9a-4b3b-b048-e9887c5f80b6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:50.336413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c9590474-af9a-4b3b-b048-e9887c5f80b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:50.345372 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1148/2322] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:36:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 10:36:50.412184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1175/2323] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:50.419659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d9c7-d991-4eb3-9f98-bcd3c1ed493f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:50.420194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d9c7-d991-4eb3-9f98-bcd3c1ed493f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:50.420194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d9c7-d991-4eb3-9f98-bcd3c1ed493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:50.440608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d7c4d9c7-d991-4eb3-9f98-bcd3c1ed493f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:50.441811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d7c4d9c7-d991-4eb3-9f98-bcd3c1ed493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:50.449680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1149/2324] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:50.454899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9590474-af9a-4b3b-b048-e9887c5f80b6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:50.465293 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9590474-af9a-4b3b-b048-e9887c5f80b6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:50.471518 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe2b7c-6061-41a0-ba12-8d289c8be55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:50.472407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe2b7c-6061-41a0-ba12-8d289c8be55b admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:50.477458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe2b7c-6061-41a0-ba12-8d289c8be55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:50.477458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe2b7c-6061-41a0-ba12-8d289c8be55b admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:50.477458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe2b7c-6061-41a0-ba12-8d289c8be55b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:36:50.477458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe2b7c-6061-41a0-ba12-8d289c8be55b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:50.477458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe2b7c-6061-41a0-ba12-8d289c8be55b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:50.488988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1176/2325] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:36:50.493414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4d9c7-d991-4eb3-9f98-bcd3c1ed493f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:50.503413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4d9c7-d991-4eb3-9f98-bcd3c1ed493f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:50.508448 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030c236-b955-4a4b-919f-77bc6ce80c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:50.511699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030c236-b955-4a4b-919f-77bc6ce80c38 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:50.511699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030c236-b955-4a4b-919f-77bc6ce80c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:50.511699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030c236-b955-4a4b-919f-77bc6ce80c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:50.511699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030c236-b955-4a4b-919f-77bc6ce80c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:50.512318 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030c236-b955-4a4b-919f-77bc6ce80c38 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:50.611558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1150/2326] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:36:50 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:36:50.615740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe2b7c-6061-41a0-ba12-8d289c8be55b admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:50.629676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe2b7c-6061-41a0-ba12-8d289c8be55b admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:50.699187 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8735ba-0023-42da-8bc5-a9ea25b08808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:50.700215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8735ba-0023-42da-8bc5-a9ea25b08808 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:50.700701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8735ba-0023-42da-8bc5-a9ea25b08808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:50.701174 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8735ba-0023-42da-8bc5-a9ea25b08808 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:50.702158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8735ba-0023-42da-8bc5-a9ea25b08808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:50.705045 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8735ba-0023-42da-8bc5-a9ea25b08808 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:50.818853 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1177/2327] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:36:50 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:36:50.822925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030c236-b955-4a4b-919f-77bc6ce80c38 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:50.837600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030c236-b955-4a4b-919f-77bc6ce80c38 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:50.843600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bb0ee-f4af-4289-962f-f11554aedaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:50.844741 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bb0ee-f4af-4289-962f-f11554aedaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:50.845254 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bb0ee-f4af-4289-962f-f11554aedaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:50.845723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bb0ee-f4af-4289-962f-f11554aedaf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:50.846597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bb0ee-f4af-4289-962f-f11554aedaf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:50.848549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bb0ee-f4af-4289-962f-f11554aedaf0 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:50.865654 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1151/2328] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:50.866394 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8735ba-0023-42da-8bc5-a9ea25b08808 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:50.879020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8735ba-0023-42da-8bc5-a9ea25b08808 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:50.931972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c0761-d0f5-4bec-b016-fb49276f2273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:50.932885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c0761-d0f5-4bec-b016-fb49276f2273 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:50.933311 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c0761-d0f5-4bec-b016-fb49276f2273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:50.933737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c0761-d0f5-4bec-b016-fb49276f2273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:50.939999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c0761-d0f5-4bec-b016-fb49276f2273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:50.941876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c0761-d0f5-4bec-b016-fb49276f2273 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:50.963561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1178/2329] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:36:50.968701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bb0ee-f4af-4289-962f-f11554aedaf0 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:50.984509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bb0ee-f4af-4289-962f-f11554aedaf0 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:50.996364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e20e1-157c-417d-be83-0b5594bbb618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:50.997108 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e20e1-157c-417d-be83-0b5594bbb618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:50.997460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e20e1-157c-417d-be83-0b5594bbb618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:50.997808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e20e1-157c-417d-be83-0b5594bbb618 admin admin] PATH_INFO: `/v3/projects/88d00b6ec9d048c99130a216d535365d/users/98d468db3e794de7b2b7b2ae511608f4/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:51.033707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e20e1-157c-417d-be83-0b5594bbb618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d00b6ec9d048c99130a216d535365d, user_id=98d468db3e794de7b2b7b2ae511608f4, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:51.041401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e20e1-157c-417d-be83-0b5594bbb618 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:51.167619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1152/2330] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:36:50 2022] PUT /identity/v3/projects/88d00b6ec9d048c99130a216d535365d/users/98d468db3e794de7b2b7b2ae511608f4/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:51.183226 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85baca-c4c6-47c1-85ff-d1fe8f47b919 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:51.183859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85baca-c4c6-47c1-85ff-d1fe8f47b919 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:51.184467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85baca-c4c6-47c1-85ff-d1fe8f47b919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:51.218619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-cd85baca-c4c6-47c1-85ff-d1fe8f47b919 None None] MFA Rules not processed for user `98d468db3e794de7b2b7b2ae511608f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:51.220751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cd85baca-c4c6-47c1-85ff-d1fe8f47b919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:51.329455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1179/2331] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:51.341901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e20e1-157c-417d-be83-0b5594bbb618 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:51.346166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-105e20e1-157c-417d-be83-0b5594bbb618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:51.449323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e20e1-157c-417d-be83-0b5594bbb618 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:51.454205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923b505-1ba3-43b1-a4d3-c4df992c4146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:51.454988 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923b505-1ba3-43b1-a4d3-c4df992c4146 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:51.455445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923b505-1ba3-43b1-a4d3-c4df992c4146 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:51.460230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923b505-1ba3-43b1-a4d3-c4df992c4146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:51.467201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923b505-1ba3-43b1-a4d3-c4df992c4146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:51.468782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923b505-1ba3-43b1-a4d3-c4df992c4146 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:51.487365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1153/2332] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:51.736786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85baca-c4c6-47c1-85ff-d1fe8f47b919 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:51.738521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cd85baca-c4c6-47c1-85ff-d1fe8f47b919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:51.754479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85baca-c4c6-47c1-85ff-d1fe8f47b919 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:51.759195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5c434-2421-4886-bc26-4a3c7b38a7a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:51.760183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5c434-2421-4886-bc26-4a3c7b38a7a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:51.760631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5c434-2421-4886-bc26-4a3c7b38a7a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:51.761117 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5c434-2421-4886-bc26-4a3c7b38a7a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:51.764296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-eeb5c434-2421-4886-bc26-4a3c7b38a7a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:51.854339 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5c434-2421-4886-bc26-4a3c7b38a7a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:51.856656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5c434-2421-4886-bc26-4a3c7b38a7a1 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:51.894026 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1180/2333] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:52.649480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:52.732136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:55.250290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923b505-1ba3-43b1-a4d3-c4df992c4146 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:55.388506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923b505-1ba3-43b1-a4d3-c4df992c4146 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:55.393672 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:55.394719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:55.395193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:55.395659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] PATH_INFO: `/v3/users/98d468db3e794de7b2b7b2ae511608f4` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:55.397540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d468db3e794de7b2b7b2ae511608f4)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:55.399868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:55.626912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:55.662263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d468db3e794de7b2b7b2ae511608f4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:55.678338 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d468db3e794de7b2b7b2ae511608f4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:55.681982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d468db3e794de7b2b7b2ae511608f4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:55.712734 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:55.784974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d468db3e794de7b2b7b2ae511608f4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:55.822844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d468db3e794de7b2b7b2ae511608f4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:55.833643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1154/2334] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:55 2022] DELETE /identity/v3/users/98d468db3e794de7b2b7b2ae511608f4 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:55.845154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924abbc3-54f0-4557-bf7f-482471a270b1 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:55.845701 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924abbc3-54f0-4557-bf7f-482471a270b1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:55.846135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924abbc3-54f0-4557-bf7f-482471a270b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:55.880219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-924abbc3-54f0-4557-bf7f-482471a270b1 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:55.884059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-924abbc3-54f0-4557-bf7f-482471a270b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:56.107176 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1181/2335] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:36:56.156609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:56.160757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:56.312075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af4831-16fc-4f71-a4d9-3bbcab5719c4 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:56.358649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d882ef-b57c-4e45-8b1b-768e2c4933aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:56.363587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d882ef-b57c-4e45-8b1b-768e2c4933aa service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:56.363918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d882ef-b57c-4e45-8b1b-768e2c4933aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:56.369898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d882ef-b57c-4e45-8b1b-768e2c4933aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:56.425938 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d882ef-b57c-4e45-8b1b-768e2c4933aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:56.443278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d882ef-b57c-4e45-8b1b-768e2c4933aa service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:56.479525 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1155/2336] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:57.200707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:57.390147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:57.396635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924abbc3-54f0-4557-bf7f-482471a270b1 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:57.398247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-924abbc3-54f0-4557-bf7f-482471a270b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:57.421312 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924abbc3-54f0-4557-bf7f-482471a270b1 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:57.429623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:57.430544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:57.431137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:57.431703 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e admin admin] PATH_INFO: `/v3/projects/88d00b6ec9d048c99130a216d535365d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:57.433414 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d00b6ec9d048c99130a216d535365d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:57.435533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:57.597961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d882ef-b57c-4e45-8b1b-768e2c4933aa service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:57.599773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d00b6ec9d048c99130a216d535365d', 'request_id': 'req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:57.600293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b7d882ef-b57c-4e45-8b1b-768e2c4933aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:57.606740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d00b6ec9d048c99130a216d535365d', 'request_id': 'req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:57.619637 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d882ef-b57c-4e45-8b1b-768e2c4933aa service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:57.707868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d00b6ec9d048c99130a216d535365d', 'request_id': 'req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:57.747016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e admin admin] The token cache is being invalidate because project 88d00b6ec9d048c99130a216d535365d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:36:57.748183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:57.749237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:57.749694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bb5032a9-2f82-49be-a6cb-eb7b08ae815e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:57.750430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:57.750922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:57.768934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] PATH_INFO: `/v3/users/602b605145384996a9e11cf918db9ede` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:57.769206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1182/2337] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:57 2022] DELETE /identity/v3/projects/88d00b6ec9d048c99130a216d535365d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:36:57.769312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=602b605145384996a9e11cf918db9ede)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:57.769312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:58.047911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602b605145384996a9e11cf918db9ede'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:58.066877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602b605145384996a9e11cf918db9ede'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:58.068528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602b605145384996a9e11cf918db9ede'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:58.149577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602b605145384996a9e11cf918db9ede'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:58.197159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602b605145384996a9e11cf918db9ede'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:58.207273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1156/2338] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:36:57 2022] DELETE /identity/v3/users/602b605145384996a9e11cf918db9ede => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:36:58.217782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8e2f-7cd4-415a-88e1-812ec5e3d520 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:58.217782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8e2f-7cd4-415a-88e1-812ec5e3d520 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:58.217782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8e2f-7cd4-415a-88e1-812ec5e3d520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:58.252150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-34cd8e2f-7cd4-415a-88e1-812ec5e3d520 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:36:58.252150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-34cd8e2f-7cd4-415a-88e1-812ec5e3d520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:58.285650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:58.354246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:58.357719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1183/2339] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:36:58.374136 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:58.376532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:58.450716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b3a4c-3410-4403-b0ca-42612be772f1 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:58.455016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cae3d-8592-4f6b-89f2-1536df8ffc20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:58.455743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cae3d-8592-4f6b-89f2-1536df8ffc20 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:58.456155 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cae3d-8592-4f6b-89f2-1536df8ffc20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:58.456589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cae3d-8592-4f6b-89f2-1536df8ffc20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:58.474519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cae3d-8592-4f6b-89f2-1536df8ffc20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:58.476089 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cae3d-8592-4f6b-89f2-1536df8ffc20 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:58.489591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1157/2340] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:36:59.733022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd8e2f-7cd4-415a-88e1-812ec5e3d520 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:36:59.735348 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-34cd8e2f-7cd4-415a-88e1-812ec5e3d520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:36:59.737804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:36:59.751115 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd8e2f-7cd4-415a-88e1-812ec5e3d520 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:36:59.758236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:36:59.758236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:36:59.759255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:36:59.759992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] PATH_INFO: `/v3/projects/8f947e01b5c94e4abf8f96daa46bd61e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:36:59.762167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f947e01b5c94e4abf8f96daa46bd61e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:36:59.764452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:36:59.920245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f947e01b5c94e4abf8f96daa46bd61e', 'request_id': 'req-eee45cc1-d84a-4084-9a54-4d2b075f9870'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:36:59.932303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f947e01b5c94e4abf8f96daa46bd61e', 'request_id': 'req-eee45cc1-d84a-4084-9a54-4d2b075f9870'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:00.040615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:00.058711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f947e01b5c94e4abf8f96daa46bd61e', 'request_id': 'req-eee45cc1-d84a-4084-9a54-4d2b075f9870'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:00.075409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] The token cache is being invalidate because project 8f947e01b5c94e4abf8f96daa46bd61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:37:00.075704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:00.076758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:00.084494 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1184/2341] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:36:59 2022] DELETE /identity/v3/projects/8f947e01b5c94e4abf8f96daa46bd61e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:00.085536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cae3d-8592-4f6b-89f2-1536df8ffc20 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:00.096199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cae3d-8592-4f6b-89f2-1536df8ffc20 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:00.175980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:00.176745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:00.177103 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:00.177488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] PATH_INFO: `/v3/users/6d64f0b9931c46758fd4861d545c49ee` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:00.178736 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d64f0b9931c46758fd4861d545c49ee)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:00.184309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:00.440073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d64f0b9931c46758fd4861d545c49ee'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:00.447748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d64f0b9931c46758fd4861d545c49ee'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:00.448561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d64f0b9931c46758fd4861d545c49ee'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:00.596638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d64f0b9931c46758fd4861d545c49ee'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:00.619619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d64f0b9931c46758fd4861d545c49ee'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:00.651147 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1158/2342] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:37:00 2022] DELETE /identity/v3/users/6d64f0b9931c46758fd4861d545c49ee => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:01.201809 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:01.204165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:01.229261 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee45cc1-d84a-4084-9a54-4d2b075f9870 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:01.290036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:01.307209 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:01.307909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:01.308291 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:01.308636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] PATH_INFO: `/v3/projects/bf87a0037a9e49918be7364a86b3c223` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:01.312116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf87a0037a9e49918be7364a86b3c223)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:01.314586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:01.432570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf87a0037a9e49918be7364a86b3c223', 'request_id': 'req-a2f90a34-beff-4009-a688-63bc56e72b7a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:01.439398 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf87a0037a9e49918be7364a86b3c223', 'request_id': 'req-a2f90a34-beff-4009-a688-63bc56e72b7a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:01.542484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf87a0037a9e49918be7364a86b3c223', 'request_id': 'req-a2f90a34-beff-4009-a688-63bc56e72b7a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:01.557586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] The token cache is being invalidate because project bf87a0037a9e49918be7364a86b3c223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:37:01.558126 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:01.559073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:01.561259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1185/2343] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:37:01 2022] DELETE /identity/v3/projects/bf87a0037a9e49918be7364a86b3c223 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:01.565565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:01.567176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:01.584635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817f94f-d778-49e6-9c48-bedc2cda32e1 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:01.663849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e0d5a-3f0b-45d8-a28a-777614a647c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:01.664586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e0d5a-3f0b-45d8-a28a-777614a647c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:01.664870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e0d5a-3f0b-45d8-a28a-777614a647c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:01.665286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e0d5a-3f0b-45d8-a28a-777614a647c7 admin admin] PATH_INFO: `/v3/users/024f21813e8944b8b0f545268ff7b806` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:01.666452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e0d5a-3f0b-45d8-a28a-777614a647c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=024f21813e8944b8b0f545268ff7b806)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:01.668423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e0d5a-3f0b-45d8-a28a-777614a647c7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:01.720167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:01.919258 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ec3e0d5a-3f0b-45d8-a28a-777614a647c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024f21813e8944b8b0f545268ff7b806'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:01.928659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ec3e0d5a-3f0b-45d8-a28a-777614a647c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024f21813e8944b8b0f545268ff7b806'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:01.929660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ec3e0d5a-3f0b-45d8-a28a-777614a647c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024f21813e8944b8b0f545268ff7b806'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:02.000677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:02.062502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ec3e0d5a-3f0b-45d8-a28a-777614a647c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024f21813e8944b8b0f545268ff7b806'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:02.076131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ec3e0d5a-3f0b-45d8-a28a-777614a647c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024f21813e8944b8b0f545268ff7b806'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:02.107116 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1159/2344] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:37:01 2022] DELETE /identity/v3/users/024f21813e8944b8b0f545268ff7b806 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:02.394235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:02.648444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:02.650185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:02.668816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f90a34-beff-4009-a688-63bc56e72b7a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:02.739475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:02.740270 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:02.740615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:02.741007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5 admin admin] PATH_INFO: `/v3/projects/b86d80e176474f6f86ad01be91c757e7` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:02.742225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86d80e176474f6f86ad01be91c757e7)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:02.744528 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:02.772770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:03.116194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86d80e176474f6f86ad01be91c757e7', 'request_id': 'req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:03.122392 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86d80e176474f6f86ad01be91c757e7', 'request_id': 'req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:03.341112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86d80e176474f6f86ad01be91c757e7', 'request_id': 'req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:03.354089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5 admin admin] The token cache is being invalidate because project b86d80e176474f6f86ad01be91c757e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:37:03.354375 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:03.355283 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8637a62a-0bfb-4ceb-b33b-5823b35af5f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:03.357273 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1186/2345] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:37:02 2022] DELETE /identity/v3/projects/b86d80e176474f6f86ad01be91c757e7 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:03.362244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d3025-87cc-47af-ae82-a2f116066c53 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:03.362532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d3025-87cc-47af-ae82-a2f116066c53 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:03.362812 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d3025-87cc-47af-ae82-a2f116066c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:03.382851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-483d3025-87cc-47af-ae82-a2f116066c53 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:03.384254 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-483d3025-87cc-47af-ae82-a2f116066c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:03.446523 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1160/2346] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:03.479634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:03.514971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9881-a39f-4f38-a0bf-8794b2fa3e0a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:03.515255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9881-a39f-4f38-a0bf-8794b2fa3e0a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:03.515529 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9881-a39f-4f38-a0bf-8794b2fa3e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:03.536225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fb1f9881-a39f-4f38-a0bf-8794b2fa3e0a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:03.537441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fb1f9881-a39f-4f38-a0bf-8794b2fa3e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:03.545430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1187/2347] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:03.550238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d3025-87cc-47af-ae82-a2f116066c53 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:03.560063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d3025-87cc-47af-ae82-a2f116066c53 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:03.565572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79983-970f-4187-9eb1-ddb2a9454a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:03.568203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79983-970f-4187-9eb1-ddb2a9454a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:03.568725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79983-970f-4187-9eb1-ddb2a9454a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:03.569253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79983-970f-4187-9eb1-ddb2a9454a70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:03.570140 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f79983-970f-4187-9eb1-ddb2a9454a70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:37:03.570443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f79983-970f-4187-9eb1-ddb2a9454a70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:03.572141 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f79983-970f-4187-9eb1-ddb2a9454a70 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:03.584939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1161/2348] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:37:03.595308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f9881-a39f-4f38-a0bf-8794b2fa3e0a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:03.604593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f9881-a39f-4f38-a0bf-8794b2fa3e0a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:03.610131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cda54-1d70-42d3-b07c-c6a3d5cb5b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:03.610733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cda54-1d70-42d3-b07c-c6a3d5cb5b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:03.611003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cda54-1d70-42d3-b07c-c6a3d5cb5b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:03.611267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cda54-1d70-42d3-b07c-c6a3d5cb5b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:03.611910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37cda54-1d70-42d3-b07c-c6a3d5cb5b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:03.613815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37cda54-1d70-42d3-b07c-c6a3d5cb5b16 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:03.726157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1188/2349] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:37:03 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:37:03.727214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79983-970f-4187-9eb1-ddb2a9454a70 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:03.740421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79983-970f-4187-9eb1-ddb2a9454a70 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:03.790267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:03.815832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c497c-4e3e-421b-8519-8bae60546db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:03.816483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c497c-4e3e-421b-8519-8bae60546db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:03.816859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c497c-4e3e-421b-8519-8bae60546db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:03.817133 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c497c-4e3e-421b-8519-8bae60546db6 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:03.817769 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c497c-4e3e-421b-8519-8bae60546db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:03.819775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c497c-4e3e-421b-8519-8bae60546db6 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:03.841409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:03.947163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cda54-1d70-42d3-b07c-c6a3d5cb5b16 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:03.947759 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1162/2350] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:37:03 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:37:03.960089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cda54-1d70-42d3-b07c-c6a3d5cb5b16 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:03.966965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7349e-25c7-4e84-841a-d5ba9d33897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:03.967830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7349e-25c7-4e84-841a-d5ba9d33897e admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:03.968166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7349e-25c7-4e84-841a-d5ba9d33897e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:03.968431 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7349e-25c7-4e84-841a-d5ba9d33897e admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:03.969646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7349e-25c7-4e84-841a-d5ba9d33897e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:03.971445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7349e-25c7-4e84-841a-d5ba9d33897e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:03.984062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1189/2351] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:37:03.987706 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c497c-4e3e-421b-8519-8bae60546db6 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:04.001071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c497c-4e3e-421b-8519-8bae60546db6 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:04.006024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5132d22-63f0-4418-8d44-29479c502c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:04.006651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5132d22-63f0-4418-8d44-29479c502c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:04.018157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5132d22-63f0-4418-8d44-29479c502c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:04.018157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5132d22-63f0-4418-8d44-29479c502c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:04.018157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5132d22-63f0-4418-8d44-29479c502c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:04.018157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5132d22-63f0-4418-8d44-29479c502c01 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:04.041557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1163/2352] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:37:04.049976 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7349e-25c7-4e84-841a-d5ba9d33897e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:04.065029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7349e-25c7-4e84-841a-d5ba9d33897e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:04.070889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83220-c68a-434c-9da9-a274fbb50149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:04.071737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83220-c68a-434c-9da9-a274fbb50149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:04.072212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83220-c68a-434c-9da9-a274fbb50149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:04.072837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83220-c68a-434c-9da9-a274fbb50149 admin admin] PATH_INFO: `/v3/projects/d33a4f3669e844e7a07fdcc29e73efca/users/03792da748af4b9a9c99c690df3dbfb8/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:04.097156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca83220-c68a-434c-9da9-a274fbb50149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33a4f3669e844e7a07fdcc29e73efca, user_id=03792da748af4b9a9c99c690df3dbfb8, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:04.100235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca83220-c68a-434c-9da9-a274fbb50149 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:04.222241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1190/2353] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:37:04 2022] PUT /identity/v3/projects/d33a4f3669e844e7a07fdcc29e73efca/users/03792da748af4b9a9c99c690df3dbfb8/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:04.228939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d276d7-e3fd-41ae-b233-442a80f0d963 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:04.229220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d276d7-e3fd-41ae-b233-442a80f0d963 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:04.229493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d276d7-e3fd-41ae-b233-442a80f0d963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:04.256642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f1d276d7-e3fd-41ae-b233-442a80f0d963 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:04.258646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f1d276d7-e3fd-41ae-b233-442a80f0d963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:04.341523 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1164/2354] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:04.352104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83220-c68a-434c-9da9-a274fbb50149 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:04.353823 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9ca83220-c68a-434c-9da9-a274fbb50149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:04.416164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83220-c68a-434c-9da9-a274fbb50149 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:04.421559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b8ac9-b5c0-4a48-8fdd-87bd666761dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:04.422304 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b8ac9-b5c0-4a48-8fdd-87bd666761dd service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:04.422655 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b8ac9-b5c0-4a48-8fdd-87bd666761dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:04.423000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b8ac9-b5c0-4a48-8fdd-87bd666761dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:04.432837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b8ac9-b5c0-4a48-8fdd-87bd666761dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:04.434270 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b8ac9-b5c0-4a48-8fdd-87bd666761dd service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:04.444124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1191/2355] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:37:04.565119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:04.640684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:05.249805 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:05.308835 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747d158-f3a5-4542-9e72-27b5e04503cb None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:05.309129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747d158-f3a5-4542-9e72-27b5e04503cb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:05.309411 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747d158-f3a5-4542-9e72-27b5e04503cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:05.333071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f747d158-f3a5-4542-9e72-27b5e04503cb None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:05.334319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f747d158-f3a5-4542-9e72-27b5e04503cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:05.393999 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1165/2356] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:37:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:05.404211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:05.409747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b8ac9-b5c0-4a48-8fdd-87bd666761dd service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:05.411179 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-302b8ac9-b5c0-4a48-8fdd-87bd666761dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:05.487501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b8ac9-b5c0-4a48-8fdd-87bd666761dd service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:05.491798 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:05.495428 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3568-e57f-484a-8509-e97ba1a2040c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:05.496315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3568-e57f-484a-8509-e97ba1a2040c service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:05.505156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3568-e57f-484a-8509-e97ba1a2040c service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:05.505156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3568-e57f-484a-8509-e97ba1a2040c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:05.518621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e3568-e57f-484a-8509-e97ba1a2040c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:05.520494 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e3568-e57f-484a-8509-e97ba1a2040c service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:05.530246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1192/2357] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:37:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:37:05.684625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:05.999758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:06.137795 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40423ce-f3f5-46da-a628-426bd76b98a3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:06.138081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40423ce-f3f5-46da-a628-426bd76b98a3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:06.138344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40423ce-f3f5-46da-a628-426bd76b98a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:06.167265 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b40423ce-f3f5-46da-a628-426bd76b98a3 None None] MFA Rules not processed for user `03792da748af4b9a9c99c690df3dbfb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:06.168550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b40423ce-f3f5-46da-a628-426bd76b98a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:06.248303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1166/2358] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:06.261974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3568-e57f-484a-8509-e97ba1a2040c service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:06.263694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-101e3568-e57f-484a-8509-e97ba1a2040c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:06.330314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3568-e57f-484a-8509-e97ba1a2040c service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:06.334034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc4113-ffe1-4ef0-b17c-d62e41e446f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:06.334729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc4113-ffe1-4ef0-b17c-d62e41e446f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:06.334940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc4113-ffe1-4ef0-b17c-d62e41e446f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:06.335221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc4113-ffe1-4ef0-b17c-d62e41e446f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:06.336749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:06.344573 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc4113-ffe1-4ef0-b17c-d62e41e446f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:06.348225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc4113-ffe1-4ef0-b17c-d62e41e446f4 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:06.355941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1193/2359] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:37:06.399876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:06.697225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71209e34-505c-41d5-9859-ff47f7a69ffe None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:06.697505 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71209e34-505c-41d5-9859-ff47f7a69ffe None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:06.697776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71209e34-505c-41d5-9859-ff47f7a69ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:06.722410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-71209e34-505c-41d5-9859-ff47f7a69ffe None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:06.723696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-71209e34-505c-41d5-9859-ff47f7a69ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:06.731341 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1167/2360] 10.222.0.33 () {58 vars in 967 bytes} [Tue Oct 4 10:37:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:06.746698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc4113-ffe1-4ef0-b17c-d62e41e446f4 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:06.758308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc4113-ffe1-4ef0-b17c-d62e41e446f4 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:06.763483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71962bc9-becf-4b53-a397-89462363c783 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:06.764303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71962bc9-becf-4b53-a397-89462363c783 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:06.764580 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71962bc9-becf-4b53-a397-89462363c783 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:06.764850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71962bc9-becf-4b53-a397-89462363c783 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:06.774578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71962bc9-becf-4b53-a397-89462363c783 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:06.776523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71962bc9-becf-4b53-a397-89462363c783 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:06.788945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1194/2361] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:37:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:37:07.361023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:07.616510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35816eab-22d5-445d-b401-cb2f1974d9ba None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:07.616969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35816eab-22d5-445d-b401-cb2f1974d9ba None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:07.617062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35816eab-22d5-445d-b401-cb2f1974d9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:07.636239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-35816eab-22d5-445d-b401-cb2f1974d9ba None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:07.637515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-35816eab-22d5-445d-b401-cb2f1974d9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:07.644603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1168/2362] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:37:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:07.657036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71962bc9-becf-4b53-a397-89462363c783 service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:07.667486 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71962bc9-becf-4b53-a397-89462363c783 service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:07.673351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfce53-ca30-47ab-939e-fbd98cffd386 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:07.673945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfce53-ca30-47ab-939e-fbd98cffd386 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:07.674221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfce53-ca30-47ab-939e-fbd98cffd386 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:07.674489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfce53-ca30-47ab-939e-fbd98cffd386 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:07.682697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfce53-ca30-47ab-939e-fbd98cffd386 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:07.684285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfce53-ca30-47ab-939e-fbd98cffd386 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:07.692433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1195/2363] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:37:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:37:07.833738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:08.328781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82eb0-f1e8-4556-b682-1b2c2d002997 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:08.328913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82eb0-f1e8-4556-b682-1b2c2d002997 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:08.329134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82eb0-f1e8-4556-b682-1b2c2d002997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:08.350242 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c7a82eb0-f1e8-4556-b682-1b2c2d002997 None None] MFA Rules not processed for user `03792da748af4b9a9c99c690df3dbfb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:08.351479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c7a82eb0-f1e8-4556-b682-1b2c2d002997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:08.360521 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1169/2364] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:08.423375 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:08.496632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce52a5-b8ad-46b3-81a5-3e1d8040290d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:08.496944 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce52a5-b8ad-46b3-81a5-3e1d8040290d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:08.497280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce52a5-b8ad-46b3-81a5-3e1d8040290d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:08.519164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9bce52a5-b8ad-46b3-81a5-3e1d8040290d None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:08.520648 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9bce52a5-b8ad-46b3-81a5-3e1d8040290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:08.529064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1196/2365] 10.222.0.33 () {58 vars in 967 bytes} [Tue Oct 4 10:37:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:08.543287 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82eb0-f1e8-4556-b682-1b2c2d002997 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:08.557341 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82eb0-f1e8-4556-b682-1b2c2d002997 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:08.563703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c5998-0336-4b63-9eca-897e5c03ea07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:08.564362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5998-0336-4b63-9eca-897e5c03ea07 service swift] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:08.564642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5998-0336-4b63-9eca-897e5c03ea07 service swift] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:08.564914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5998-0336-4b63-9eca-897e5c03ea07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:08.574239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c5998-0336-4b63-9eca-897e5c03ea07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:08.575894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c5998-0336-4b63-9eca-897e5c03ea07 service swift] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:08.585138 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1170/2366] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:37:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:37:08.873473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:10.477886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:11.034093 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:11.616133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce52a5-b8ad-46b3-81a5-3e1d8040290d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:11.617617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9bce52a5-b8ad-46b3-81a5-3e1d8040290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:11.632549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce52a5-b8ad-46b3-81a5-3e1d8040290d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:11.637693 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:11.638321 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:11.638599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:11.638872 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] PATH_INFO: `/v3/users/bc360d9cc7384c4d9e1d1a0eeeaedf83` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:11.640143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc360d9cc7384c4d9e1d1a0eeeaedf83)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:11.642199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:11.929937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc360d9cc7384c4d9e1d1a0eeeaedf83'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:11.939143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc360d9cc7384c4d9e1d1a0eeeaedf83'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:11.940115 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc360d9cc7384c4d9e1d1a0eeeaedf83'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:11.940992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc360d9cc7384c4d9e1d1a0eeeaedf83'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:12.044841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc360d9cc7384c4d9e1d1a0eeeaedf83'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:12.063645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1197/2367] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:37:11 2022] DELETE /identity/v3/users/bc360d9cc7384c4d9e1d1a0eeeaedf83 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:12.068099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292987-1cd1-481c-919b-d7292314561b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:12.068581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292987-1cd1-481c-919b-d7292314561b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:12.068677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292987-1cd1-481c-919b-d7292314561b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:12.087615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-19292987-1cd1-481c-919b-d7292314561b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:12.088838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-19292987-1cd1-481c-919b-d7292314561b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:12.145776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1171/2368] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:12.157501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:12.158918 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:12.240753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40ac60-7426-467a-928a-1bc034f442f9 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:12.240959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beff682-38e7-4ff4-8c8d-4ce424928f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:12.241445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beff682-38e7-4ff4-8c8d-4ce424928f57 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:12.241728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beff682-38e7-4ff4-8c8d-4ce424928f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:12.242003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beff682-38e7-4ff4-8c8d-4ce424928f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:12.253588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beff682-38e7-4ff4-8c8d-4ce424928f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:12.255100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beff682-38e7-4ff4-8c8d-4ce424928f57 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:12.264762 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1198/2369] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:37:12.427875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:12.548511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:12.585503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19292987-1cd1-481c-919b-d7292314561b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:12.586958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-19292987-1cd1-481c-919b-d7292314561b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:12.599932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19292987-1cd1-481c-919b-d7292314561b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:12.605504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752acb8-eabf-443e-9bd5-d2990df95709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:12.606726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752acb8-eabf-443e-9bd5-d2990df95709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:12.607402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752acb8-eabf-443e-9bd5-d2990df95709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:12.607743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752acb8-eabf-443e-9bd5-d2990df95709 admin admin] PATH_INFO: `/v3/projects/4f563ab6038b44498848da63418a438f` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:12.609339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752acb8-eabf-443e-9bd5-d2990df95709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f563ab6038b44498848da63418a438f)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:12.611059 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752acb8-eabf-443e-9bd5-d2990df95709 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:12.757529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-3752acb8-eabf-443e-9bd5-d2990df95709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f563ab6038b44498848da63418a438f', 'request_id': 'req-3752acb8-eabf-443e-9bd5-d2990df95709'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:12.763371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-3752acb8-eabf-443e-9bd5-d2990df95709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f563ab6038b44498848da63418a438f', 'request_id': 'req-3752acb8-eabf-443e-9bd5-d2990df95709'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:12.771733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-3752acb8-eabf-443e-9bd5-d2990df95709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f563ab6038b44498848da63418a438f', 'request_id': 'req-3752acb8-eabf-443e-9bd5-d2990df95709'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:12.882792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883929fb-ca23-49d8-b897-348bfcb4b0d7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:12.883330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883929fb-ca23-49d8-b897-348bfcb4b0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:12.883330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883929fb-ca23-49d8-b897-348bfcb4b0d7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:12.885233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1199/2370] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:37:12.892282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6506c2-7da2-4533-814f-388d9bd32257 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:12.892567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6506c2-7da2-4533-814f-388d9bd32257 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:12.892838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6506c2-7da2-4533-814f-388d9bd32257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:12.911772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-3752acb8-eabf-443e-9bd5-d2990df95709 admin admin] The token cache is being invalidate because project 4f563ab6038b44498848da63418a438f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:37:12.912206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-3752acb8-eabf-443e-9bd5-d2990df95709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:12.913292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-3752acb8-eabf-443e-9bd5-d2990df95709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:12.915285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1172/2371] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:37:12 2022] DELETE /identity/v3/projects/4f563ab6038b44498848da63418a438f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:12.919826 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44843999-087e-4444-92be-a1eff3ee76b9 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:12.920220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44843999-087e-4444-92be-a1eff3ee76b9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:12.920744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44843999-087e-4444-92be-a1eff3ee76b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:12.926504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4c6506c2-7da2-4533-814f-388d9bd32257 None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:12.927718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4c6506c2-7da2-4533-814f-388d9bd32257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:12.945238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-44843999-087e-4444-92be-a1eff3ee76b9 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:12.945238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-44843999-087e-4444-92be-a1eff3ee76b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:13.011891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1200/2372] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:37:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:37:13.020918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1173/2373] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:37:13.027332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6506c2-7da2-4533-814f-388d9bd32257 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:13.029016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d4383-9919-4ed3-a286-4dac81284d5a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.029149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4c6506c2-7da2-4533-814f-388d9bd32257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:13.029320 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d4383-9919-4ed3-a286-4dac81284d5a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.029591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d4383-9919-4ed3-a286-4dac81284d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.049202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-316d4383-9919-4ed3-a286-4dac81284d5a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:13.050423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-316d4383-9919-4ed3-a286-4dac81284d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:13.063249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1174/2374] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:37:13.067315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d4383-9919-4ed3-a286-4dac81284d5a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:13.084324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d4383-9919-4ed3-a286-4dac81284d5a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:13.094051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30641b56-6465-4876-9115-b4ae9255ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:13.094694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30641b56-6465-4876-9115-b4ae9255ca4d admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.094964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30641b56-6465-4876-9115-b4ae9255ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.095243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30641b56-6465-4876-9115-b4ae9255ca4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.095903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30641b56-6465-4876-9115-b4ae9255ca4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:37:13.096321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30641b56-6465-4876-9115-b4ae9255ca4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:13.098365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30641b56-6465-4876-9115-b4ae9255ca4d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:13.104267 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6506c2-7da2-4533-814f-388d9bd32257 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:13.108358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245878f-ff1b-4206-94b8-afb046b1a613 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6462736c485545d8a26766360ebe0c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:13.108961 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245878f-ff1b-4206-94b8-afb046b1a613 service glance] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.110259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245878f-ff1b-4206-94b8-afb046b1a613 service glance] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.110259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245878f-ff1b-4206-94b8-afb046b1a613 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.111935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1175/2375] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:37:13.116652 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30641b56-6465-4876-9115-b4ae9255ca4d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:13.122137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245878f-ff1b-4206-94b8-afb046b1a613 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:13.123650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245878f-ff1b-4206-94b8-afb046b1a613 service glance] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:13.127047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30641b56-6465-4876-9115-b4ae9255ca4d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:13.132577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6dfcd-bd43-4a6e-abb0-5c7385b1e75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:13.133233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6dfcd-bd43-4a6e-abb0-5c7385b1e75f admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.133514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6dfcd-bd43-4a6e-abb0-5c7385b1e75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.134208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6dfcd-bd43-4a6e-abb0-5c7385b1e75f admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.135113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6dfcd-bd43-4a6e-abb0-5c7385b1e75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:13.136064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1201/2376] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:37:13.137784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6dfcd-bd43-4a6e-abb0-5c7385b1e75f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:13.222412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:13.263689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1176/2377] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:37:13 2022] POST /identity/v3/projects => generated 397 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:37:13.264841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245878f-ff1b-4206-94b8-afb046b1a613 service glance] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:13.275826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245878f-ff1b-4206-94b8-afb046b1a613 service glance] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:13.339527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afe206-806e-482b-a738-6dbe972bbfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:13.340153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afe206-806e-482b-a738-6dbe972bbfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.340431 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afe206-806e-482b-a738-6dbe972bbfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.340698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afe206-806e-482b-a738-6dbe972bbfb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.341367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afe206-806e-482b-a738-6dbe972bbfb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:13.343280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afe206-806e-482b-a738-6dbe972bbfb2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:13.364287 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432311-c060-41ad-b217-a6d4c6ea9750 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.364660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432311-c060-41ad-b217-a6d4c6ea9750 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.365002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432311-c060-41ad-b217-a6d4c6ea9750 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.366417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1177/2378] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 10:37:13.370960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc465b1-98db-4ba6-9e68-e580e1bb9f2f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.371306 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc465b1-98db-4ba6-9e68-e580e1bb9f2f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.371749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc465b1-98db-4ba6-9e68-e580e1bb9f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.383679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:13.396416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-2bc465b1-98db-4ba6-9e68-e580e1bb9f2f None None] MFA Rules not processed for user `b040de20aa6f4e7b8366c7daa54c093c`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:13.397776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2bc465b1-98db-4ba6-9e68-e580e1bb9f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:13.456993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1202/2379] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:37:13 2022] POST /identity/v3/users => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:37:13.461347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afe206-806e-482b-a738-6dbe972bbfb2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:13.466449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1178/2380] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:37:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:37:13.480685 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afe206-806e-482b-a738-6dbe972bbfb2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:13.485522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc465b1-98db-4ba6-9e68-e580e1bb9f2f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:13.487753 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2bc465b1-98db-4ba6-9e68-e580e1bb9f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:13.489739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c6b4-c816-4b9f-97a0-0ea75bfe982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:13.490806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c6b4-c816-4b9f-97a0-0ea75bfe982d admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.491381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c6b4-c816-4b9f-97a0-0ea75bfe982d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.492021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c6b4-c816-4b9f-97a0-0ea75bfe982d admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.493210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2c6b4-c816-4b9f-97a0-0ea75bfe982d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:13.496283 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2c6b4-c816-4b9f-97a0-0ea75bfe982d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:13.502476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc465b1-98db-4ba6-9e68-e580e1bb9f2f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:13.507321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf053b-8782-4e94-8258-f03e3518d6be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:13.523323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf053b-8782-4e94-8258-f03e3518d6be service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.523323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf053b-8782-4e94-8258-f03e3518d6be service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.523323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf053b-8782-4e94-8258-f03e3518d6be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.523812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1203/2381] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:37:13.523812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c6b4-c816-4b9f-97a0-0ea75bfe982d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:13.524071 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf053b-8782-4e94-8258-f03e3518d6be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:13.526139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf053b-8782-4e94-8258-f03e3518d6be service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:13.538429 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c6b4-c816-4b9f-97a0-0ea75bfe982d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:13.541080 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1179/2382] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:37:13.557295 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636f184-53f5-47f8-bed2-15a3cf839a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:13.568611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636f184-53f5-47f8-bed2-15a3cf839a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.568611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636f184-53f5-47f8-bed2-15a3cf839a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.568611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636f184-53f5-47f8-bed2-15a3cf839a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.568611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636f184-53f5-47f8-bed2-15a3cf839a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:13.568611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636f184-53f5-47f8-bed2-15a3cf839a28 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:13.589048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1204/2383] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:37:13.595674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf053b-8782-4e94-8258-f03e3518d6be service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:13.610681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf053b-8782-4e94-8258-f03e3518d6be service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:13.618376 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355dda3-f017-472a-8db7-840d51ecd417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:13.619072 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355dda3-f017-472a-8db7-840d51ecd417 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.619522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355dda3-f017-472a-8db7-840d51ecd417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.620020 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355dda3-f017-472a-8db7-840d51ecd417 admin admin] PATH_INFO: `/v3/projects/3f33e24ea3cc44e7b24c043aeb28d419/users/cd98bcc0c3c24292958617f2c31cb304/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.637777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355dda3-f017-472a-8db7-840d51ecd417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f33e24ea3cc44e7b24c043aeb28d419, user_id=cd98bcc0c3c24292958617f2c31cb304, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:13.641201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355dda3-f017-472a-8db7-840d51ecd417 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:13.673550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75393c64-f2f0-490a-a5ef-0b92fb4edc23 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.673917 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75393c64-f2f0-490a-a5ef-0b92fb4edc23 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.674258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75393c64-f2f0-490a-a5ef-0b92fb4edc23 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.675679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1205/2384] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:37:13.680974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eb73c-91ad-4dca-88d8-662658de9b7f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.681253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eb73c-91ad-4dca-88d8-662658de9b7f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.681555 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eb73c-91ad-4dca-88d8-662658de9b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.702424 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-563eb73c-91ad-4dca-88d8-662658de9b7f None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:13.703793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-563eb73c-91ad-4dca-88d8-662658de9b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:13.772539 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1206/2385] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:37:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:37:13.783680 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563eb73c-91ad-4dca-88d8-662658de9b7f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:13.785161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-563eb73c-91ad-4dca-88d8-662658de9b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:13.788659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1180/2386] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:37:13 2022] PUT /identity/v3/projects/3f33e24ea3cc44e7b24c043aeb28d419/users/cd98bcc0c3c24292958617f2c31cb304/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:37:13.797613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563eb73c-91ad-4dca-88d8-662658de9b7f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:13.799468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6ef4-badc-4031-8d15-06c6bd858195 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.799764 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6ef4-badc-4031-8d15-06c6bd858195 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.800078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6ef4-badc-4031-8d15-06c6bd858195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.831200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d87b6ef4-badc-4031-8d15-06c6bd858195 None None] MFA Rules not processed for user `cd98bcc0c3c24292958617f2c31cb304`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:13.832536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d87b6ef4-badc-4031-8d15-06c6bd858195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:13.854320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1b00c-7645-4a91-ba39-c92ca3ae1393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:13.855324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1b00c-7645-4a91-ba39-c92ca3ae1393 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:13.855603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1b00c-7645-4a91-ba39-c92ca3ae1393 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:13.855865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1b00c-7645-4a91-ba39-c92ca3ae1393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:13.953881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1181/2387] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:13.965686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b6ef4-badc-4031-8d15-06c6bd858195 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:13.972788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d87b6ef4-badc-4031-8d15-06c6bd858195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:14.005599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1b00c-7645-4a91-ba39-c92ca3ae1393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:14.007079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1b00c-7645-4a91-ba39-c92ca3ae1393 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:14.032225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1207/2388] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:37:14.047026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b6ef4-badc-4031-8d15-06c6bd858195 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:14.050990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4157b-4342-4c05-85af-1ae19da3149a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:14.051614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4157b-4342-4c05-85af-1ae19da3149a service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:14.051894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4157b-4342-4c05-85af-1ae19da3149a service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:14.052208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4157b-4342-4c05-85af-1ae19da3149a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:14.062209 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4157b-4342-4c05-85af-1ae19da3149a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:14.065805 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4157b-4342-4c05-85af-1ae19da3149a service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:14.073976 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1182/2389] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:13 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:37:14.257791 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:14.691394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:15.480420 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:17.559388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:17.639397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:18.726679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1b00c-7645-4a91-ba39-c92ca3ae1393 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:18.728739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bee1b00c-7645-4a91-ba39-c92ca3ae1393 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:18.797557 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1b00c-7645-4a91-ba39-c92ca3ae1393 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:18.805308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:18.805951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:18.806231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:18.806500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] PATH_INFO: `/v3/users/1360961f519740be938c8a6c1cc3b785` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:18.807625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1360961f519740be938c8a6c1cc3b785)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:18.809696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:18.976482 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:19.037685 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1360961f519740be938c8a6c1cc3b785'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:19.047025 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1360961f519740be938c8a6c1cc3b785'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:19.047711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1360961f519740be938c8a6c1cc3b785'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:19.048508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1360961f519740be938c8a6c1cc3b785'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:19.172550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1360961f519740be938c8a6c1cc3b785'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:19.177645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1208/2390] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:37:18 2022] DELETE /identity/v3/users/1360961f519740be938c8a6c1cc3b785 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:19.182189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6f0a4-2617-4649-8e9d-621502929686 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:19.182472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6f0a4-2617-4649-8e9d-621502929686 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:19.182791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6f0a4-2617-4649-8e9d-621502929686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:19.213463 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-dda6f0a4-2617-4649-8e9d-621502929686 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:19.214785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dda6f0a4-2617-4649-8e9d-621502929686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:19.277084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1183/2391] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:19.292092 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:19.293719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:19.355448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d435ab-235f-47bc-81df-d478c9809b0c admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:19.359235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb0043-c5a2-4e1e-9e88-ca29467e5939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:19.360736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb0043-c5a2-4e1e-9e88-ca29467e5939 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:19.361279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb0043-c5a2-4e1e-9e88-ca29467e5939 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:19.361398 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb0043-c5a2-4e1e-9e88-ca29467e5939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:19.371003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb0043-c5a2-4e1e-9e88-ca29467e5939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:19.372473 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb0043-c5a2-4e1e-9e88-ca29467e5939 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:19.386170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1209/2392] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:37:19.662128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b0b81-2934-4d34-86bb-1aecc54ca9b4 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:19.662411 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b0b81-2934-4d34-86bb-1aecc54ca9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:19.662682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b0b81-2934-4d34-86bb-1aecc54ca9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:19.691489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e40b0b81-2934-4d34-86bb-1aecc54ca9b4 None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:19.691489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e40b0b81-2934-4d34-86bb-1aecc54ca9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:19.762449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1184/2393] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:37:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:19.785245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb0043-c5a2-4e1e-9e88-ca29467e5939 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:19.786761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fcfb0043-c5a2-4e1e-9e88-ca29467e5939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:19.858070 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb0043-c5a2-4e1e-9e88-ca29467e5939 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:19.863940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d701b-cc87-4e01-8aa4-9bdeb18bedca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:19.864568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d701b-cc87-4e01-8aa4-9bdeb18bedca service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:19.864846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d701b-cc87-4e01-8aa4-9bdeb18bedca service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:19.865114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d701b-cc87-4e01-8aa4-9bdeb18bedca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:19.873123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d701b-cc87-4e01-8aa4-9bdeb18bedca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:19.874698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d701b-cc87-4e01-8aa4-9bdeb18bedca service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:19.882716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1210/2394] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:37:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:37:19.961808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b0b81-2934-4d34-86bb-1aecc54ca9b4 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:19.961808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e40b0b81-2934-4d34-86bb-1aecc54ca9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:19.974975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b0b81-2934-4d34-86bb-1aecc54ca9b4 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:19.981836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04daba08-1766-4050-acf9-335f2a13821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:19.982836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daba08-1766-4050-acf9-335f2a13821c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:19.983136 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daba08-1766-4050-acf9-335f2a13821c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:19.983337 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daba08-1766-4050-acf9-335f2a13821c admin admin] PATH_INFO: `/v3/projects/d7a7308a63bb4471a3450efc55330aa1` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:19.984528 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04daba08-1766-4050-acf9-335f2a13821c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a7308a63bb4471a3450efc55330aa1)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:19.986451 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04daba08-1766-4050-acf9-335f2a13821c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:20.097207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:20.236890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04daba08-1766-4050-acf9-335f2a13821c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a7308a63bb4471a3450efc55330aa1', 'request_id': 'req-04daba08-1766-4050-acf9-335f2a13821c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:20.255712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04daba08-1766-4050-acf9-335f2a13821c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a7308a63bb4471a3450efc55330aa1', 'request_id': 'req-04daba08-1766-4050-acf9-335f2a13821c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:20.266419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04daba08-1766-4050-acf9-335f2a13821c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a7308a63bb4471a3450efc55330aa1', 'request_id': 'req-04daba08-1766-4050-acf9-335f2a13821c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:20.342277 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04daba08-1766-4050-acf9-335f2a13821c admin admin] The token cache is being invalidate because project d7a7308a63bb4471a3450efc55330aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:37:20.345974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04daba08-1766-4050-acf9-335f2a13821c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:20.348447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-04daba08-1766-4050-acf9-335f2a13821c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:20.355462 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1185/2395] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:37:19 2022] DELETE /identity/v3/projects/d7a7308a63bb4471a3450efc55330aa1 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:20.782516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d701b-cc87-4e01-8aa4-9bdeb18bedca service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:20.785395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ae9d701b-cc87-4e01-8aa4-9bdeb18bedca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:20.801793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d701b-cc87-4e01-8aa4-9bdeb18bedca service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:20.895444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:20.896756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:20.897033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:20.903225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] PATH_INFO: `/v3/users/cd98bcc0c3c24292958617f2c31cb304` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:20.903225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd98bcc0c3c24292958617f2c31cb304)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:20.903225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:21.172572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd98bcc0c3c24292958617f2c31cb304'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:21.180203 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd98bcc0c3c24292958617f2c31cb304'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:21.180916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd98bcc0c3c24292958617f2c31cb304'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:21.181527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd98bcc0c3c24292958617f2c31cb304'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:21.290505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd98bcc0c3c24292958617f2c31cb304'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:21.312572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1211/2396] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:37:20 2022] DELETE /identity/v3/users/cd98bcc0c3c24292958617f2c31cb304 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:21.317678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643001-4ebc-400b-9acc-811c2d2d6bc5 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:21.318494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643001-4ebc-400b-9acc-811c2d2d6bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:21.318961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643001-4ebc-400b-9acc-811c2d2d6bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:21.338972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0d643001-4ebc-400b-9acc-811c2d2d6bc5 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:21.340235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0d643001-4ebc-400b-9acc-811c2d2d6bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:21.405653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1186/2397] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:21.415839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:21.417247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:21.482349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd011def-3d80-4632-8715-336ed54fcfca admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:21.486464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70560e-86f6-4127-8d72-daca52fc49ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:21.487129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70560e-86f6-4127-8d72-daca52fc49ff service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:21.487475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70560e-86f6-4127-8d72-daca52fc49ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:21.487770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70560e-86f6-4127-8d72-daca52fc49ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:21.497908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70560e-86f6-4127-8d72-daca52fc49ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:21.499626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70560e-86f6-4127-8d72-daca52fc49ff service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:21.510108 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1212/2398] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:37:21.913752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:22.083033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643001-4ebc-400b-9acc-811c2d2d6bc5 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:22.084962 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0d643001-4ebc-400b-9acc-811c2d2d6bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:22.119159 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643001-4ebc-400b-9acc-811c2d2d6bc5 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:22.132029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a9e6c-9426-44f2-9390-1a810628fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:22.132690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a9e6c-9426-44f2-9390-1a810628fe34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:22.132969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a9e6c-9426-44f2-9390-1a810628fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:22.133236 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a9e6c-9426-44f2-9390-1a810628fe34 admin admin] PATH_INFO: `/v3/projects/3f33e24ea3cc44e7b24c043aeb28d419` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:22.134570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a9e6c-9426-44f2-9390-1a810628fe34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f33e24ea3cc44e7b24c043aeb28d419)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:22.136880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a9e6c-9426-44f2-9390-1a810628fe34 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:22.255072 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-0d3a9e6c-9426-44f2-9390-1a810628fe34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f33e24ea3cc44e7b24c043aeb28d419', 'request_id': 'req-0d3a9e6c-9426-44f2-9390-1a810628fe34'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:22.262077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-0d3a9e6c-9426-44f2-9390-1a810628fe34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f33e24ea3cc44e7b24c043aeb28d419', 'request_id': 'req-0d3a9e6c-9426-44f2-9390-1a810628fe34'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:22.269398 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-0d3a9e6c-9426-44f2-9390-1a810628fe34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f33e24ea3cc44e7b24c043aeb28d419', 'request_id': 'req-0d3a9e6c-9426-44f2-9390-1a810628fe34'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:22.392883 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-0d3a9e6c-9426-44f2-9390-1a810628fe34 admin admin] The token cache is being invalidate because project 3f33e24ea3cc44e7b24c043aeb28d419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:37:22.393691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-0d3a9e6c-9426-44f2-9390-1a810628fe34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:22.394455 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-0d3a9e6c-9426-44f2-9390-1a810628fe34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:22.396526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1187/2399] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:37:22 2022] DELETE /identity/v3/projects/3f33e24ea3cc44e7b24c043aeb28d419 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:22.691408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:23.158772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:23.386520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:23.552973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:23.718723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:23.855919 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:24.565392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:24.740807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:25.430722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70560e-86f6-4127-8d72-daca52fc49ff service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:25.432400 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2a70560e-86f6-4127-8d72-daca52fc49ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:25.445801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70560e-86f6-4127-8d72-daca52fc49ff service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:25.509019 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:25.509674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:25.509960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:25.510237 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] PATH_INFO: `/v3/users/db066a72956f473b900a4cc4f10adfe2` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:25.512229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db066a72956f473b900a4cc4f10adfe2)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:25.515586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:25.790098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db066a72956f473b900a4cc4f10adfe2'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:25.792953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:25.797508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db066a72956f473b900a4cc4f10adfe2'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:25.798887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db066a72956f473b900a4cc4f10adfe2'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:25.799551 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db066a72956f473b900a4cc4f10adfe2'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:25.884519 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:25.912417 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db066a72956f473b900a4cc4f10adfe2'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:25.931795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1213/2400] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:37:25 2022] DELETE /identity/v3/users/db066a72956f473b900a4cc4f10adfe2 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:25.936727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9345ceb-061f-4ab1-a166-323812636a9b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:25.937013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9345ceb-061f-4ab1-a166-323812636a9b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:25.937286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9345ceb-061f-4ab1-a166-323812636a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:25.958082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c9345ceb-061f-4ab1-a166-323812636a9b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:25.959305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c9345ceb-061f-4ab1-a166-323812636a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:26.021197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1188/2401] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:26.031190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:26.033480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:26.056130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:26.097016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442d1a5-2c1e-4601-9aa8-ecb05f96cde7 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:26.100690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b11e60-06b2-49e6-a0b1-55da3770340d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:26.101503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b11e60-06b2-49e6-a0b1-55da3770340d service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:26.101781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b11e60-06b2-49e6-a0b1-55da3770340d service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:26.102054 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b11e60-06b2-49e6-a0b1-55da3770340d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:26.115088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b11e60-06b2-49e6-a0b1-55da3770340d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:26.116556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b11e60-06b2-49e6-a0b1-55da3770340d service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:26.127130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1214/2402] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:37:26.233059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:26.273409 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:26.467604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:26.707366 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:26.712367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9345ceb-061f-4ab1-a166-323812636a9b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:26.714030 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c9345ceb-061f-4ab1-a166-323812636a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:26.726905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9345ceb-061f-4ab1-a166-323812636a9b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:26.733506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:26.734380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:26.734665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:26.734943 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7 admin admin] PATH_INFO: `/v3/projects/4612db572cf64a719597104b74db3a51` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:26.738303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4612db572cf64a719597104b74db3a51)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:26.740281 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:26.776111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:26.876147 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4612db572cf64a719597104b74db3a51', 'request_id': 'req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:26.882257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4612db572cf64a719597104b74db3a51', 'request_id': 'req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:26.889477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4612db572cf64a719597104b74db3a51', 'request_id': 'req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:26.958022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7 admin admin] The token cache is being invalidate because project 4612db572cf64a719597104b74db3a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:37:26.958314 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:26.958960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-03167cb6-8503-4cd2-ac49-bdba9e5aaab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:26.960734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1189/2403] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:37:26 2022] DELETE /identity/v3/projects/4612db572cf64a719597104b74db3a51 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:26.965600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211149d-4e3c-42b7-83ec-228d9dc8c1df None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:26.966131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211149d-4e3c-42b7-83ec-228d9dc8c1df None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:26.966131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211149d-4e3c-42b7-83ec-228d9dc8c1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:26.994598 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d211149d-4e3c-42b7-83ec-228d9dc8c1df None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:26.995832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d211149d-4e3c-42b7-83ec-228d9dc8c1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:27.058531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1215/2404] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:37:27.066965 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76e5fb-e2ef-4b43-8bd5-fd1988913885 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:27.067276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76e5fb-e2ef-4b43-8bd5-fd1988913885 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:27.067522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76e5fb-e2ef-4b43-8bd5-fd1988913885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:27.088806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ad76e5fb-e2ef-4b43-8bd5-fd1988913885 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:27.091207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:27.092183 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ad76e5fb-e2ef-4b43-8bd5-fd1988913885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:27.100439 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1190/2405] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:27.104921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211149d-4e3c-42b7-83ec-228d9dc8c1df None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:27.114958 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211149d-4e3c-42b7-83ec-228d9dc8c1df None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:27.120217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4085d0-2de4-4cee-b33f-145c041125f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:27.120859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4085d0-2de4-4cee-b33f-145c041125f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:27.121142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4085d0-2de4-4cee-b33f-145c041125f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:27.121416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4085d0-2de4-4cee-b33f-145c041125f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:27.122164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4085d0-2de4-4cee-b33f-145c041125f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:37:27.122470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4085d0-2de4-4cee-b33f-145c041125f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:27.124219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4085d0-2de4-4cee-b33f-145c041125f4 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:27.140399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1216/2406] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:37:27.142234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76e5fb-e2ef-4b43-8bd5-fd1988913885 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:27.151930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76e5fb-e2ef-4b43-8bd5-fd1988913885 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:27.157174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80c51-5157-443b-9a6b-a95daa58fd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:27.157787 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80c51-5157-443b-9a6b-a95daa58fd78 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:27.158069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80c51-5157-443b-9a6b-a95daa58fd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:27.158341 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80c51-5157-443b-9a6b-a95daa58fd78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:27.158933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:27.159062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd80c51-5157-443b-9a6b-a95daa58fd78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:27.160939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd80c51-5157-443b-9a6b-a95daa58fd78 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:27.245558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1191/2407] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:37:27 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:37:27.250046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4085d0-2de4-4cee-b33f-145c041125f4 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:27.262966 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4085d0-2de4-4cee-b33f-145c041125f4 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:27.344930 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b4f8c-878b-4559-b3d1-a47ac25a2a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:27.345580 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b4f8c-878b-4559-b3d1-a47ac25a2a9d admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:27.345868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b4f8c-878b-4559-b3d1-a47ac25a2a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:27.346140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b4f8c-878b-4559-b3d1-a47ac25a2a9d admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:27.346880 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b4f8c-878b-4559-b3d1-a47ac25a2a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:27.349109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b4f8c-878b-4559-b3d1-a47ac25a2a9d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:27.370165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:27.461614 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1217/2408] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:37:27 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:37:27.465725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80c51-5157-443b-9a6b-a95daa58fd78 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:27.468192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:27.478377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80c51-5157-443b-9a6b-a95daa58fd78 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:27.483347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619f5d4-af60-4267-b76c-11c09601563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:27.483972 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619f5d4-af60-4267-b76c-11c09601563c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:27.484249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619f5d4-af60-4267-b76c-11c09601563c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:27.484515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619f5d4-af60-4267-b76c-11c09601563c admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:27.485701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619f5d4-af60-4267-b76c-11c09601563c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:27.487274 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619f5d4-af60-4267-b76c-11c09601563c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:27.497602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1192/2409] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:37:27.505177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b4f8c-878b-4559-b3d1-a47ac25a2a9d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:27.512650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b4f8c-878b-4559-b3d1-a47ac25a2a9d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:27.517386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976df61-677b-4fbc-a5b3-2d7813c10f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:27.517982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976df61-677b-4fbc-a5b3-2d7813c10f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:27.518255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976df61-677b-4fbc-a5b3-2d7813c10f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:27.518521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976df61-677b-4fbc-a5b3-2d7813c10f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:27.519159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976df61-677b-4fbc-a5b3-2d7813c10f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:27.520784 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976df61-677b-4fbc-a5b3-2d7813c10f69 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:27.532283 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1218/2410] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:37:27.542537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619f5d4-af60-4267-b76c-11c09601563c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:27.553004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619f5d4-af60-4267-b76c-11c09601563c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:27.557618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bedeb5-6ee5-4ad5-914f-8a9b89e75046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:27.558275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bedeb5-6ee5-4ad5-914f-8a9b89e75046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:27.558551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bedeb5-6ee5-4ad5-914f-8a9b89e75046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:27.558823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bedeb5-6ee5-4ad5-914f-8a9b89e75046 admin admin] PATH_INFO: `/v3/projects/f441a902271047a292f43699925d4af4/users/f575edfbc5ef4c9185f44af58759b8d1/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:27.575540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bedeb5-6ee5-4ad5-914f-8a9b89e75046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f441a902271047a292f43699925d4af4, user_id=f575edfbc5ef4c9185f44af58759b8d1, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:27.578713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bedeb5-6ee5-4ad5-914f-8a9b89e75046 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:27.707977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1193/2411] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:37:27 2022] PUT /identity/v3/projects/f441a902271047a292f43699925d4af4/users/f575edfbc5ef4c9185f44af58759b8d1/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:27.712543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:27.718323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a412-7b44-45ff-b5a4-531911fdc213 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:27.718753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a412-7b44-45ff-b5a4-531911fdc213 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:27.719129 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a412-7b44-45ff-b5a4-531911fdc213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:27.763702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a618a412-7b44-45ff-b5a4-531911fdc213 None None] MFA Rules not processed for user `f575edfbc5ef4c9185f44af58759b8d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:27.765240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a618a412-7b44-45ff-b5a4-531911fdc213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:27.828926 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:27.863507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1219/2412] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:27.874222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bedeb5-6ee5-4ad5-914f-8a9b89e75046 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:27.879699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-66bedeb5-6ee5-4ad5-914f-8a9b89e75046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:27.948460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bedeb5-6ee5-4ad5-914f-8a9b89e75046 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:27.960447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81975c8-fb1e-4661-91be-9d85c9b5cf88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:27.960447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81975c8-fb1e-4661-91be-9d85c9b5cf88 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:27.960447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81975c8-fb1e-4661-91be-9d85c9b5cf88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:27.960447 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81975c8-fb1e-4661-91be-9d85c9b5cf88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:27.967219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81975c8-fb1e-4661-91be-9d85c9b5cf88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:27.968767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81975c8-fb1e-4661-91be-9d85c9b5cf88 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:27.980022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1194/2413] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:37:28.039146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:28.159356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:28.570226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:28.718051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:28.792903 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:29.227194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:29.301189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:29.809927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:30.318498 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:30.672716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:30.901711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:31.632390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:36.708971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd1aba-18da-4cfa-af47-8bb555e943ed None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:36.710142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd1aba-18da-4cfa-af47-8bb555e943ed None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:36.710582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd1aba-18da-4cfa-af47-8bb555e943ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:36.734232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-54dd1aba-18da-4cfa-af47-8bb555e943ed None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:36.736242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-54dd1aba-18da-4cfa-af47-8bb555e943ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:36.798586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1220/2414] 10.222.0.33 () {58 vars in 967 bytes} [Tue Oct 4 10:37:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:36.811599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81975c8-fb1e-4661-91be-9d85c9b5cf88 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:36.813107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b81975c8-fb1e-4661-91be-9d85c9b5cf88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:36.897939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81975c8-fb1e-4661-91be-9d85c9b5cf88 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:36.902953 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2849b8-86ad-41df-a5b4-4e34c0d37aa2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:36.903563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2849b8-86ad-41df-a5b4-4e34c0d37aa2 service swift] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:36.903840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2849b8-86ad-41df-a5b4-4e34c0d37aa2 service swift] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:36.904144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2849b8-86ad-41df-a5b4-4e34c0d37aa2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:36.913295 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2849b8-86ad-41df-a5b4-4e34c0d37aa2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:36.914891 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2849b8-86ad-41df-a5b4-4e34c0d37aa2 service swift] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:36.924413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1195/2415] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:37:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:37:37.654872 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd1aba-18da-4cfa-af47-8bb555e943ed None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:37.657870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-54dd1aba-18da-4cfa-af47-8bb555e943ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:37.732351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd1aba-18da-4cfa-af47-8bb555e943ed None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:37.738554 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1a9ba-98a6-4a9a-b0d9-2f401ab6f24c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:37.739211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1a9ba-98a6-4a9a-b0d9-2f401ab6f24c service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:37.739544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1a9ba-98a6-4a9a-b0d9-2f401ab6f24c service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:37.739820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1a9ba-98a6-4a9a-b0d9-2f401ab6f24c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:37.741825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-afa1a9ba-98a6-4a9a-b0d9-2f401ab6f24c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:37.758536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1a9ba-98a6-4a9a-b0d9-2f401ab6f24c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:37.758536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1a9ba-98a6-4a9a-b0d9-2f401ab6f24c service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:37.770122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1221/2416] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:37:40.099607 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2849b8-86ad-41df-a5b4-4e34c0d37aa2 service swift] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:40.163068 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2849b8-86ad-41df-a5b4-4e34c0d37aa2 service swift] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:40.167810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:40.168413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:40.168697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:40.168961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] PATH_INFO: `/v3/users/f575edfbc5ef4c9185f44af58759b8d1` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:40.170111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f575edfbc5ef4c9185f44af58759b8d1)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:40.172095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:40.399130 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:40.400923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f575edfbc5ef4c9185f44af58759b8d1'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:40.408745 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f575edfbc5ef4c9185f44af58759b8d1'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:40.409472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f575edfbc5ef4c9185f44af58759b8d1'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:40.460268 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f575edfbc5ef4c9185f44af58759b8d1'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:40.473825 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f575edfbc5ef4c9185f44af58759b8d1'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:40.480040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1196/2417] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:37:40 2022] DELETE /identity/v3/users/f575edfbc5ef4c9185f44af58759b8d1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:40.484917 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff639c-f4d9-4587-bd76-bd53f889d07d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:40.485401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff639c-f4d9-4587-bd76-bd53f889d07d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:40.485625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff639c-f4d9-4587-bd76-bd53f889d07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:40.505521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e3ff639c-f4d9-4587-bd76-bd53f889d07d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:40.506765 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e3ff639c-f4d9-4587-bd76-bd53f889d07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:40.520556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:40.567463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1222/2418] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:40.577216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:40.578606 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:40.637251 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be6c95-9d4d-4bca-8fcf-c0e778072588 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:40.640880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018b61f-f64c-4f72-ab24-c4aedb9b3fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:40.642106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018b61f-f64c-4f72-ab24-c4aedb9b3fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:40.642388 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018b61f-f64c-4f72-ab24-c4aedb9b3fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:40.642661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018b61f-f64c-4f72-ab24-c4aedb9b3fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:40.651650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018b61f-f64c-4f72-ab24-c4aedb9b3fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:40.653185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018b61f-f64c-4f72-ab24-c4aedb9b3fd8 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:40.662699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1197/2419] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:37:41.148551 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff639c-f4d9-4587-bd76-bd53f889d07d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:41.150188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e3ff639c-f4d9-4587-bd76-bd53f889d07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:41.162882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff639c-f4d9-4587-bd76-bd53f889d07d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:41.167681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:41.168338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:41.168613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:41.168882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] PATH_INFO: `/v3/projects/f441a902271047a292f43699925d4af4` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:41.170013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f441a902271047a292f43699925d4af4)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:41.171920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:41.267771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f441a902271047a292f43699925d4af4', 'request_id': 'req-33941f1a-0eea-45ef-88ec-8719a74d88b7'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:41.273208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f441a902271047a292f43699925d4af4', 'request_id': 'req-33941f1a-0eea-45ef-88ec-8719a74d88b7'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:41.322250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f441a902271047a292f43699925d4af4', 'request_id': 'req-33941f1a-0eea-45ef-88ec-8719a74d88b7'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:41.338783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] The token cache is being invalidate because project f441a902271047a292f43699925d4af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:37:41.338783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:41.338783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:37:41.342457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1223/2420] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:37:41 2022] DELETE /identity/v3/projects/f441a902271047a292f43699925d4af4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:37:50.658490 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=39,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:51.332560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:37:53.750248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf9406-f554-4c43-b28e-3b1c754be311 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:53.750820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf9406-f554-4c43-b28e-3b1c754be311 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:53.751394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf9406-f554-4c43-b28e-3b1c754be311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:53.774296 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4caf9406-f554-4c43-b28e-3b1c754be311 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:53.775657 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4caf9406-f554-4c43-b28e-3b1c754be311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:53.847469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1198/2421] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Oct 4 10:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:53.860981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:53.863062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:53.957195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33941f1a-0eea-45ef-88ec-8719a74d88b7 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:53.963248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1c5a4-d0cd-4b1c-ae7a-8e1395500af7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:53.964121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1c5a4-d0cd-4b1c-ae7a-8e1395500af7 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:53.964583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1c5a4-d0cd-4b1c-ae7a-8e1395500af7 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:53.965033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1c5a4-d0cd-4b1c-ae7a-8e1395500af7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:53.974231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1c5a4-d0cd-4b1c-ae7a-8e1395500af7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:53.976071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1c5a4-d0cd-4b1c-ae7a-8e1395500af7 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:53.986566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1224/2422] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:37:59.518849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4e4e4-bb37-47de-8833-207f76e52aaf None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:59.519441 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4e4e4-bb37-47de-8833-207f76e52aaf None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:59.519441 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4e4e4-bb37-47de-8833-207f76e52aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:59.538973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-96d4e4e4-bb37-47de-8833-207f76e52aaf None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:37:59.540227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-96d4e4e4-bb37-47de-8833-207f76e52aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:59.549205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1199/2423] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Oct 4 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:37:59.563386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1c5a4-d0cd-4b1c-ae7a-8e1395500af7 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:37:59.565449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-63a1c5a4-d0cd-4b1c-ae7a-8e1395500af7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:37:59.580435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1c5a4-d0cd-4b1c-ae7a-8e1395500af7 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:37:59.585509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49cec5-3d54-4c1c-b413-e62a2e0a2a33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:37:59.586127 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49cec5-3d54-4c1c-b413-e62a2e0a2a33 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:37:59.586430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49cec5-3d54-4c1c-b413-e62a2e0a2a33 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:37:59.586702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49cec5-3d54-4c1c-b413-e62a2e0a2a33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:37:59.594792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49cec5-3d54-4c1c-b413-e62a2e0a2a33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:37:59.596370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49cec5-3d54-4c1c-b413-e62a2e0a2a33 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:37:59.605835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1225/2424] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:38:03.700615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90557b-5957-4cd5-ab88-5bcdcbc390c4 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:03.703460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90557b-5957-4cd5-ab88-5bcdcbc390c4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:03.703460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90557b-5957-4cd5-ab88-5bcdcbc390c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:03.722412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6b90557b-5957-4cd5-ab88-5bcdcbc390c4 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:38:03.723621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6b90557b-5957-4cd5-ab88-5bcdcbc390c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:38:03.732057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1200/2425] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Oct 4 10:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:38:03.747116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49cec5-3d54-4c1c-b413-e62a2e0a2a33 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:38:03.759084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49cec5-3d54-4c1c-b413-e62a2e0a2a33 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:38:03.764833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733081a-9fa8-4e49-b90c-33ed5f75c278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:38:03.765428 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733081a-9fa8-4e49-b90c-33ed5f75c278 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:03.765709 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733081a-9fa8-4e49-b90c-33ed5f75c278 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:03.766038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733081a-9fa8-4e49-b90c-33ed5f75c278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:03.774922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733081a-9fa8-4e49-b90c-33ed5f75c278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:38:03.776910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733081a-9fa8-4e49-b90c-33ed5f75c278 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:38:03.787508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1226/2426] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:38:06.558900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c63a4-1f6e-4644-b1fe-017d373a5608 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:06.562074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c63a4-1f6e-4644-b1fe-017d373a5608 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:06.562074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c63a4-1f6e-4644-b1fe-017d373a5608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:06.579810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d77c63a4-1f6e-4644-b1fe-017d373a5608 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:38:06.581044 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d77c63a4-1f6e-4644-b1fe-017d373a5608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:38:06.589283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1201/2427] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Oct 4 10:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:38:06.604547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733081a-9fa8-4e49-b90c-33ed5f75c278 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:38:06.615868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733081a-9fa8-4e49-b90c-33ed5f75c278 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:38:06.621337 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcef70d-4742-4bf4-b036-f2b1b19a7c8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:38:06.621912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcef70d-4742-4bf4-b036-f2b1b19a7c8e service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:06.622190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcef70d-4742-4bf4-b036-f2b1b19a7c8e service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:06.622454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcef70d-4742-4bf4-b036-f2b1b19a7c8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:06.630972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcef70d-4742-4bf4-b036-f2b1b19a7c8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:38:06.632537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcef70d-4742-4bf4-b036-f2b1b19a7c8e service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:38:06.641894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1227/2428] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:38:09.793881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f881fe-c171-4c59-a7dc-8c6d9f8798ff None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:09.794379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f881fe-c171-4c59-a7dc-8c6d9f8798ff None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:09.794477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f881fe-c171-4c59-a7dc-8c6d9f8798ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:09.817083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d0f881fe-c171-4c59-a7dc-8c6d9f8798ff None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:38:09.818317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d0f881fe-c171-4c59-a7dc-8c6d9f8798ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:38:09.826380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1202/2429] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Oct 4 10:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:38:09.841818 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcef70d-4742-4bf4-b036-f2b1b19a7c8e service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:38:09.854052 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcef70d-4742-4bf4-b036-f2b1b19a7c8e service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:38:09.859643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0d1c3-b146-48f4-a01c-847de80a4a11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:38:09.860270 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0d1c3-b146-48f4-a01c-847de80a4a11 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:09.861193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0d1c3-b146-48f4-a01c-847de80a4a11 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:09.861466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0d1c3-b146-48f4-a01c-847de80a4a11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:09.869568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0d1c3-b146-48f4-a01c-847de80a4a11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:38:09.871119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0d1c3-b146-48f4-a01c-847de80a4a11 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:38:09.880612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1228/2430] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:38:13.017832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a14c2-07f8-4668-8074-35690a1d9c42 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:13.018334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a14c2-07f8-4668-8074-35690a1d9c42 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:13.018445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a14c2-07f8-4668-8074-35690a1d9c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:13.037690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5b8a14c2-07f8-4668-8074-35690a1d9c42 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:38:13.038881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5b8a14c2-07f8-4668-8074-35690a1d9c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:38:13.046636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1203/2431] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Oct 4 10:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:38:13.066901 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0d1c3-b146-48f4-a01c-847de80a4a11 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:38:13.077819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0d1c3-b146-48f4-a01c-847de80a4a11 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:38:13.083384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18c3eb-b428-4b5e-8ba8-22d13729eec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:38:13.083887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18c3eb-b428-4b5e-8ba8-22d13729eec3 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:13.084197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18c3eb-b428-4b5e-8ba8-22d13729eec3 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:13.084470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18c3eb-b428-4b5e-8ba8-22d13729eec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:13.092440 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18c3eb-b428-4b5e-8ba8-22d13729eec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:38:13.093989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18c3eb-b428-4b5e-8ba8-22d13729eec3 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:38:13.103146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1229/2432] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:38:23.032395 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=42 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:23.099086 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=64 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:27.858183 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69916bb9-3a0a-4604-b6c3-293995045fd1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:27.858649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69916bb9-3a0a-4604-b6c3-293995045fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:27.858649 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69916bb9-3a0a-4604-b6c3-293995045fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:27.877575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-69916bb9-3a0a-4604-b6c3-293995045fd1 None None] MFA Rules not processed for user `eac479fab6e84174857d9bea3be6f423`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:38:27.881135 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-69916bb9-3a0a-4604-b6c3-293995045fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:38:27.943243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1204/2433] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:38:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:38:34.334829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442324f-cdde-409e-88eb-13c7d4a30a46 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:34.335340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442324f-cdde-409e-88eb-13c7d4a30a46 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:34.335434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442324f-cdde-409e-88eb-13c7d4a30a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:34.354844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7442324f-cdde-409e-88eb-13c7d4a30a46 None None] MFA Rules not processed for user `03792da748af4b9a9c99c690df3dbfb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:38:34.356199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7442324f-cdde-409e-88eb-13c7d4a30a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:38:34.412064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1230/2434] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:38:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:38:36.494861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0b7c2-67b0-4c9a-b1df-24e5ea535911 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:36.495358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0b7c2-67b0-4c9a-b1df-24e5ea535911 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:36.495462 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0b7c2-67b0-4c9a-b1df-24e5ea535911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:36.520677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-07c0b7c2-67b0-4c9a-b1df-24e5ea535911 None None] MFA Rules not processed for user `58a89d6843d34c37814ec5508a7f1da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:38:36.521803 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-07c0b7c2-67b0-4c9a-b1df-24e5ea535911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:38:36.582087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1205/2435] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:38:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:38:44.404894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=25 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:46.398446 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebda94-63b7-4a6a-90b0-66129061d540 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:46.399091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebda94-63b7-4a6a-90b0-66129061d540 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:46.399091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebda94-63b7-4a6a-90b0-66129061d540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:46.418807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-16ebda94-63b7-4a6a-90b0-66129061d540 None None] MFA Rules not processed for user `f040e47e66d145589b4233fe98c93507`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:38:46.420094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-16ebda94-63b7-4a6a-90b0-66129061d540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:38:46.479188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1231/2436] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:38:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:38:46.574559 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=50 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:56.472462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=25 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:38:57.246283 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d5ef1-97c9-440c-82b2-36769a911f51 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:57.246925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d5ef1-97c9-440c-82b2-36769a911f51 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:57.246925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d5ef1-97c9-440c-82b2-36769a911f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:57.267245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d82d5ef1-97c9-440c-82b2-36769a911f51 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:38:57.268536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d82d5ef1-97c9-440c-82b2-36769a911f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:38:57.276218 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1206/2437] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Oct 4 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:38:57.293254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebda94-63b7-4a6a-90b0-66129061d540 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:38:57.306466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebda94-63b7-4a6a-90b0-66129061d540 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:38:57.311978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf2b43-3997-4150-8bfc-01ade6268834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:38:57.313135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf2b43-3997-4150-8bfc-01ade6268834 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:38:57.313445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf2b43-3997-4150-8bfc-01ade6268834 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:38:57.313715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf2b43-3997-4150-8bfc-01ade6268834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:38:57.321807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf2b43-3997-4150-8bfc-01ade6268834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:38:57.323370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf2b43-3997-4150-8bfc-01ade6268834 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:38:57.332723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1232/2438] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:39:01.924845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa51bf-60e6-4e14-9a11-51a26188f83d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:01.925364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa51bf-60e6-4e14-9a11-51a26188f83d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:01.925364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa51bf-60e6-4e14-9a11-51a26188f83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:01.946143 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a9fa51bf-60e6-4e14-9a11-51a26188f83d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:39:01.947434 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a9fa51bf-60e6-4e14-9a11-51a26188f83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:01.955701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1207/2439] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Oct 4 10:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:39:01.969387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf2b43-3997-4150-8bfc-01ade6268834 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:01.980751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf2b43-3997-4150-8bfc-01ade6268834 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:01.986199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b3410-8c73-43c4-85ea-8b2dfa78aaf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:01.986814 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b3410-8c73-43c4-85ea-8b2dfa78aaf4 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:01.987090 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b3410-8c73-43c4-85ea-8b2dfa78aaf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:01.987421 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b3410-8c73-43c4-85ea-8b2dfa78aaf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:01.996232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b3410-8c73-43c4-85ea-8b2dfa78aaf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:01.997789 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b3410-8c73-43c4-85ea-8b2dfa78aaf4 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:02.007902 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1233/2440] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:39:04.748309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9835f67-132a-42fa-b50b-c27f1758af33 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:04.748840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9835f67-132a-42fa-b50b-c27f1758af33 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:04.748954 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9835f67-132a-42fa-b50b-c27f1758af33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:04.777342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a9835f67-132a-42fa-b50b-c27f1758af33 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:39:04.781916 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a9835f67-132a-42fa-b50b-c27f1758af33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:04.787075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1208/2441] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Oct 4 10:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:39:04.812284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b3410-8c73-43c4-85ea-8b2dfa78aaf4 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:04.823695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b3410-8c73-43c4-85ea-8b2dfa78aaf4 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:04.829896 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1e3cc-c4a7-450d-8d5d-261f812fd3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:04.830513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1e3cc-c4a7-450d-8d5d-261f812fd3e6 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:04.830764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1e3cc-c4a7-450d-8d5d-261f812fd3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:04.831035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1e3cc-c4a7-450d-8d5d-261f812fd3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:04.839105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1e3cc-c4a7-450d-8d5d-261f812fd3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:04.840834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1e3cc-c4a7-450d-8d5d-261f812fd3e6 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:04.850965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1234/2442] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:39:07.969116 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851df3c1-4e02-4703-b98c-29b25c020ccf None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:07.969752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851df3c1-4e02-4703-b98c-29b25c020ccf None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:07.969903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851df3c1-4e02-4703-b98c-29b25c020ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:07.989756 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-851df3c1-4e02-4703-b98c-29b25c020ccf None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:39:07.990934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-851df3c1-4e02-4703-b98c-29b25c020ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:07.998633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1209/2443] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Oct 4 10:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:39:08.014649 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1e3cc-c4a7-450d-8d5d-261f812fd3e6 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:08.025771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1e3cc-c4a7-450d-8d5d-261f812fd3e6 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:08.031554 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719e210-a518-49de-9a27-66aec6ae8490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:08.032112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719e210-a518-49de-9a27-66aec6ae8490 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:08.032392 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719e210-a518-49de-9a27-66aec6ae8490 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:08.032747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719e210-a518-49de-9a27-66aec6ae8490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:08.040795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719e210-a518-49de-9a27-66aec6ae8490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:08.042366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719e210-a518-49de-9a27-66aec6ae8490 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:08.052363 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1235/2444] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:39:11.202077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55abd3f-a8e9-4c57-8e8c-4411c8e8cf14 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:11.202508 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55abd3f-a8e9-4c57-8e8c-4411c8e8cf14 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:11.202648 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55abd3f-a8e9-4c57-8e8c-4411c8e8cf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:11.224470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e55abd3f-a8e9-4c57-8e8c-4411c8e8cf14 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:39:11.225684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e55abd3f-a8e9-4c57-8e8c-4411c8e8cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:11.234010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1210/2445] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Oct 4 10:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:39:11.256827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719e210-a518-49de-9a27-66aec6ae8490 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:11.268631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719e210-a518-49de-9a27-66aec6ae8490 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:11.274074 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997e0dd-3901-40cc-bca8-3b924dd25818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:11.274680 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e0dd-3901-40cc-bca8-3b924dd25818 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:11.274951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e0dd-3901-40cc-bca8-3b924dd25818 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:11.275218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e0dd-3901-40cc-bca8-3b924dd25818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:11.283123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997e0dd-3901-40cc-bca8-3b924dd25818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:11.284699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997e0dd-3901-40cc-bca8-3b924dd25818 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:11.293811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1236/2446] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:39:21.218375 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=15 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:21.289679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=30 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:31.649578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55abd3f-a8e9-4c57-8e8c-4411c8e8cf14 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:31.651033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e55abd3f-a8e9-4c57-8e8c-4411c8e8cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:31.707610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55abd3f-a8e9-4c57-8e8c-4411c8e8cf14 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:31.711316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038011db-c554-4e0d-ad0a-21472e7e6884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:31.711925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038011db-c554-4e0d-ad0a-21472e7e6884 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:31.712237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038011db-c554-4e0d-ad0a-21472e7e6884 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:31.712504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038011db-c554-4e0d-ad0a-21472e7e6884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:31.714245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-038011db-c554-4e0d-ad0a-21472e7e6884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:31.732057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038011db-c554-4e0d-ad0a-21472e7e6884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:31.734191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038011db-c554-4e0d-ad0a-21472e7e6884 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:31.747167 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1211/2447] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:39:34.480053 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997e0dd-3901-40cc-bca8-3b924dd25818 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:34.481690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9997e0dd-3901-40cc-bca8-3b924dd25818 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:34.494527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997e0dd-3901-40cc-bca8-3b924dd25818 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:34.498149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ff745-50f4-4aea-9352-fbcf96822ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:34.498736 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff745-50f4-4aea-9352-fbcf96822ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:34.499016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff745-50f4-4aea-9352-fbcf96822ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:34.499285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff745-50f4-4aea-9352-fbcf96822ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:34.500994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b21ff745-50f4-4aea-9352-fbcf96822ed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:34.514887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ff745-50f4-4aea-9352-fbcf96822ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:34.516377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ff745-50f4-4aea-9352-fbcf96822ed5 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:34.527228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1237/2448] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:39:40.537124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038011db-c554-4e0d-ad0a-21472e7e6884 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:40.545949 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038011db-c554-4e0d-ad0a-21472e7e6884 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:40.555223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac3de8-b019-41a2-ab14-712718d7a56f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:40.555223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac3de8-b019-41a2-ab14-712718d7a56f service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:40.555223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac3de8-b019-41a2-ab14-712718d7a56f service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:40.555223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac3de8-b019-41a2-ab14-712718d7a56f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:40.555617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dbac3de8-b019-41a2-ab14-712718d7a56f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:40.564133 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac3de8-b019-41a2-ab14-712718d7a56f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:40.565526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac3de8-b019-41a2-ab14-712718d7a56f service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:40.575545 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1212/2449] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:39:44.517603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ff745-50f4-4aea-9352-fbcf96822ed5 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:44.519147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b21ff745-50f4-4aea-9352-fbcf96822ed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:44.523510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:44.541418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ff745-50f4-4aea-9352-fbcf96822ed5 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:44.541418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc6e5e-cb3a-4808-90d7-f1318d2a68f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:44.541418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc6e5e-cb3a-4808-90d7-f1318d2a68f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:44.541418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc6e5e-cb3a-4808-90d7-f1318d2a68f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:44.541732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc6e5e-cb3a-4808-90d7-f1318d2a68f0 admin admin] PATH_INFO: `/v3/users/eac479fab6e84174857d9bea3be6f423` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:44.542168 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc6e5e-cb3a-4808-90d7-f1318d2a68f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac479fab6e84174857d9bea3be6f423)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:44.544094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc6e5e-cb3a-4808-90d7-f1318d2a68f0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:44.732114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b0dc6e5e-cb3a-4808-90d7-f1318d2a68f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac479fab6e84174857d9bea3be6f423'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:44.738887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b0dc6e5e-cb3a-4808-90d7-f1318d2a68f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac479fab6e84174857d9bea3be6f423'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:44.739539 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b0dc6e5e-cb3a-4808-90d7-f1318d2a68f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac479fab6e84174857d9bea3be6f423'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:44.740259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b0dc6e5e-cb3a-4808-90d7-f1318d2a68f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac479fab6e84174857d9bea3be6f423'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:44.815553 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-b0dc6e5e-cb3a-4808-90d7-f1318d2a68f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac479fab6e84174857d9bea3be6f423'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:44.834100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1238/2450] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:39:44 2022] DELETE /identity/v3/users/eac479fab6e84174857d9bea3be6f423 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:39:45.068310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac3de8-b019-41a2-ab14-712718d7a56f service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:45.081005 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac3de8-b019-41a2-ab14-712718d7a56f service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:45.144965 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a91ccc-c514-4fa8-b11e-77eb54768822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:45.145597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91ccc-c514-4fa8-b11e-77eb54768822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:45.145878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91ccc-c514-4fa8-b11e-77eb54768822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:45.146171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91ccc-c514-4fa8-b11e-77eb54768822 admin admin] PATH_INFO: `/v3/projects/2eb6a7e2d5d4417c8485e2675eab521f` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:45.147298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a91ccc-c514-4fa8-b11e-77eb54768822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eb6a7e2d5d4417c8485e2675eab521f)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:45.149843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a91ccc-c514-4fa8-b11e-77eb54768822 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:45.306469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-74a91ccc-c514-4fa8-b11e-77eb54768822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eb6a7e2d5d4417c8485e2675eab521f', 'request_id': 'req-74a91ccc-c514-4fa8-b11e-77eb54768822'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:45.312066 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-74a91ccc-c514-4fa8-b11e-77eb54768822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eb6a7e2d5d4417c8485e2675eab521f', 'request_id': 'req-74a91ccc-c514-4fa8-b11e-77eb54768822'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:45.318375 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-74a91ccc-c514-4fa8-b11e-77eb54768822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eb6a7e2d5d4417c8485e2675eab521f', 'request_id': 'req-74a91ccc-c514-4fa8-b11e-77eb54768822'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:45.391639 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-74a91ccc-c514-4fa8-b11e-77eb54768822 admin admin] The token cache is being invalidate because project 2eb6a7e2d5d4417c8485e2675eab521f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:39:45.392040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-74a91ccc-c514-4fa8-b11e-77eb54768822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:45.392598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-74a91ccc-c514-4fa8-b11e-77eb54768822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:45.394065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1213/2451] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:39:45 2022] DELETE /identity/v3/projects/2eb6a7e2d5d4417c8485e2675eab521f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:39:45.399715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2a75e-feb0-4c5b-9998-e1d7dea1dcb9 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:45.400073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2a75e-feb0-4c5b-9998-e1d7dea1dcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:45.400352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2a75e-feb0-4c5b-9998-e1d7dea1dcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:45.420576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ffe2a75e-feb0-4c5b-9998-e1d7dea1dcb9 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:39:45.421788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ffe2a75e-feb0-4c5b-9998-e1d7dea1dcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:45.481003 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1239/2452] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:39:45.488881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd7d83-3d91-4a1d-ae5c-76eb3f5cf763 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:45.489164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd7d83-3d91-4a1d-ae5c-76eb3f5cf763 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:45.489436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd7d83-3d91-4a1d-ae5c-76eb3f5cf763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:45.510961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-16bd7d83-3d91-4a1d-ae5c-76eb3f5cf763 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:39:45.512172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-16bd7d83-3d91-4a1d-ae5c-76eb3f5cf763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:45.519861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1214/2453] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:39:45.524040 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2a75e-feb0-4c5b-9998-e1d7dea1dcb9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:45.533621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2a75e-feb0-4c5b-9998-e1d7dea1dcb9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:45.538172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f20bf-87ab-4e56-9e9f-69cf958bdcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:45.538759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f20bf-87ab-4e56-9e9f-69cf958bdcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:45.539038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f20bf-87ab-4e56-9e9f-69cf958bdcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:45.539307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f20bf-87ab-4e56-9e9f-69cf958bdcb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:45.539967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f20bf-87ab-4e56-9e9f-69cf958bdcb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:39:45.540273 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f20bf-87ab-4e56-9e9f-69cf958bdcb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:45.541841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f20bf-87ab-4e56-9e9f-69cf958bdcb2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:45.553621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1240/2454] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:39:45.563568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd7d83-3d91-4a1d-ae5c-76eb3f5cf763 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:45.573458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd7d83-3d91-4a1d-ae5c-76eb3f5cf763 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:45.578245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d1591-e37b-4f7a-ad26-421edb61ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:45.578833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d1591-e37b-4f7a-ad26-421edb61ab4b admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:45.579110 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d1591-e37b-4f7a-ad26-421edb61ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:45.579379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d1591-e37b-4f7a-ad26-421edb61ab4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:45.580028 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d1591-e37b-4f7a-ad26-421edb61ab4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:45.581898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d1591-e37b-4f7a-ad26-421edb61ab4b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:45.592801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:45.700842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1215/2455] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:39:45 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:39:45.702138 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f20bf-87ab-4e56-9e9f-69cf958bdcb2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:45.712123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f20bf-87ab-4e56-9e9f-69cf958bdcb2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:45.770309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bf029-b209-4e45-8905-bcd6b7bb6478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:45.771531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bf029-b209-4e45-8905-bcd6b7bb6478 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:45.771531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bf029-b209-4e45-8905-bcd6b7bb6478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:45.771531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bf029-b209-4e45-8905-bcd6b7bb6478 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:45.772247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bf029-b209-4e45-8905-bcd6b7bb6478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:45.774244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bf029-b209-4e45-8905-bcd6b7bb6478 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:45.789269 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:45.856658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1241/2456] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:39:45 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:39:45.860692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d1591-e37b-4f7a-ad26-421edb61ab4b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:45.871891 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d1591-e37b-4f7a-ad26-421edb61ab4b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:45.876648 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994acd5f-afce-4a48-8cbd-59670ad0a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:45.877381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994acd5f-afce-4a48-8cbd-59670ad0a105 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:45.877911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994acd5f-afce-4a48-8cbd-59670ad0a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:45.878413 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994acd5f-afce-4a48-8cbd-59670ad0a105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:45.879338 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994acd5f-afce-4a48-8cbd-59670ad0a105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:45.881073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994acd5f-afce-4a48-8cbd-59670ad0a105 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:45.892773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1216/2457] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:39:45.895642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bf029-b209-4e45-8905-bcd6b7bb6478 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:45.905788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bf029-b209-4e45-8905-bcd6b7bb6478 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:45.910900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209379de-4f00-4ccd-98f1-87b587a033cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:45.911508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209379de-4f00-4ccd-98f1-87b587a033cb admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:45.911793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209379de-4f00-4ccd-98f1-87b587a033cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:45.912613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209379de-4f00-4ccd-98f1-87b587a033cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:45.912761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209379de-4f00-4ccd-98f1-87b587a033cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:45.914964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209379de-4f00-4ccd-98f1-87b587a033cb admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:45.927057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1242/2458] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:39:45.931726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994acd5f-afce-4a48-8cbd-59670ad0a105 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:45.942817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994acd5f-afce-4a48-8cbd-59670ad0a105 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:45.947557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0212c7c-05a2-4c00-b872-f5a613209cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:45.948243 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0212c7c-05a2-4c00-b872-f5a613209cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:45.949616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0212c7c-05a2-4c00-b872-f5a613209cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:45.949616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0212c7c-05a2-4c00-b872-f5a613209cb6 admin admin] PATH_INFO: `/v3/projects/fa548fc241a640efb2e63ebc7e27efdb/users/7d0fa8beb6954a5d8662e581345e2a12/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:45.964309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0212c7c-05a2-4c00-b872-f5a613209cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa548fc241a640efb2e63ebc7e27efdb, user_id=7d0fa8beb6954a5d8662e581345e2a12, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:45.967085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0212c7c-05a2-4c00-b872-f5a613209cb6 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:46.045291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1217/2459] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:39:45 2022] PUT /identity/v3/projects/fa548fc241a640efb2e63ebc7e27efdb/users/7d0fa8beb6954a5d8662e581345e2a12/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:39:46.050529 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3b18-b114-4263-aa7f-5804d061af63 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:46.050812 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3b18-b114-4263-aa7f-5804d061af63 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:46.051083 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3b18-b114-4263-aa7f-5804d061af63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:46.070058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8e5a3b18-b114-4263-aa7f-5804d061af63 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:39:46.071259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8e5a3b18-b114-4263-aa7f-5804d061af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:46.133240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1243/2460] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:39:46.151786 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0212c7c-05a2-4c00-b872-f5a613209cb6 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:46.153876 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e0212c7c-05a2-4c00-b872-f5a613209cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:46.217362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0212c7c-05a2-4c00-b872-f5a613209cb6 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:46.221058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f715-4f87-4c6f-8628-9700146c6213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:46.221672 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f715-4f87-4c6f-8628-9700146c6213 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:46.221926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f715-4f87-4c6f-8628-9700146c6213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:46.222193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f715-4f87-4c6f-8628-9700146c6213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:46.232418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95f715-4f87-4c6f-8628-9700146c6213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:46.233834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95f715-4f87-4c6f-8628-9700146c6213 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:46.243674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1218/2461] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:39:46.274717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3b18-b114-4263-aa7f-5804d061af63 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:46.276138 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8e5a3b18-b114-4263-aa7f-5804d061af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:46.359256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3b18-b114-4263-aa7f-5804d061af63 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:46.362299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47263f5-9ba9-42db-abc9-c9d00e2cce93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:46.363181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47263f5-9ba9-42db-abc9-c9d00e2cce93 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:46.363315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47263f5-9ba9-42db-abc9-c9d00e2cce93 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:46.363543 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47263f5-9ba9-42db-abc9-c9d00e2cce93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:46.365647 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b47263f5-9ba9-42db-abc9-c9d00e2cce93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:46.439166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47263f5-9ba9-42db-abc9-c9d00e2cce93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:46.440870 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47263f5-9ba9-42db-abc9-c9d00e2cce93 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:46.452434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1244/2462] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:39:46.516962 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f715-4f87-4c6f-8628-9700146c6213 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:46.518734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bb95f715-4f87-4c6f-8628-9700146c6213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:46.534023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f715-4f87-4c6f-8628-9700146c6213 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:46.539608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:46.540527 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:46.541019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:46.541492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] PATH_INFO: `/v3/users/03792da748af4b9a9c99c690df3dbfb8` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:46.542856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=03792da748af4b9a9c99c690df3dbfb8)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:46.544891 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:46.744506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03792da748af4b9a9c99c690df3dbfb8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:46.752486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03792da748af4b9a9c99c690df3dbfb8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:46.753267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03792da748af4b9a9c99c690df3dbfb8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:46.843860 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03792da748af4b9a9c99c690df3dbfb8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:46.869569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03792da748af4b9a9c99c690df3dbfb8'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:46.877219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1219/2463] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:39:46 2022] DELETE /identity/v3/users/03792da748af4b9a9c99c690df3dbfb8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:39:47.237613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47263f5-9ba9-42db-abc9-c9d00e2cce93 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:47.251206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47263f5-9ba9-42db-abc9-c9d00e2cce93 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:47.282429 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:47.330188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:47.330841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:47.331124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:47.331399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] PATH_INFO: `/v3/projects/d33a4f3669e844e7a07fdcc29e73efca` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:47.332699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d33a4f3669e844e7a07fdcc29e73efca)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:47.334775 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:47.433115 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd33a4f3669e844e7a07fdcc29e73efca', 'request_id': 'req-44772127-13f3-4d09-8f52-e19cde58b2b3'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:47.439466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd33a4f3669e844e7a07fdcc29e73efca', 'request_id': 'req-44772127-13f3-4d09-8f52-e19cde58b2b3'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:47.484102 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd33a4f3669e844e7a07fdcc29e73efca', 'request_id': 'req-44772127-13f3-4d09-8f52-e19cde58b2b3'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:47.495933 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] The token cache is being invalidate because project d33a4f3669e844e7a07fdcc29e73efca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:39:47.496700 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:47.496990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:39:47.498524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1245/2464] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:39:47 2022] DELETE /identity/v3/projects/d33a4f3669e844e7a07fdcc29e73efca => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:39:50.812041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:50.815058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:50.859017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:50.901485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea11ed6-8772-4f18-81a7-7b3930b60b0c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:50.974401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cb5b4-9c12-4ab1-9dc4-fe512255f97b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:50.975200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cb5b4-9c12-4ab1-9dc4-fe512255f97b service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:50.975932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cb5b4-9c12-4ab1-9dc4-fe512255f97b service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:50.976423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cb5b4-9c12-4ab1-9dc4-fe512255f97b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:50.980426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-705cb5b4-9c12-4ab1-9dc4-fe512255f97b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:51.046657 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:51.049304 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:51.077493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cb5b4-9c12-4ab1-9dc4-fe512255f97b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:51.081993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cb5b4-9c12-4ab1-9dc4-fe512255f97b service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:51.096839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1220/2465] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:39:51.148448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44772127-13f3-4d09-8f52-e19cde58b2b3 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:51.153001 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21b72-7a23-439a-8cac-fd4d05aeef3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6462736c485545d8a26766360ebe0c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:51.153716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21b72-7a23-439a-8cac-fd4d05aeef3e service glance] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:51.154064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21b72-7a23-439a-8cac-fd4d05aeef3e service glance] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:51.154342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21b72-7a23-439a-8cac-fd4d05aeef3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:51.165455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb21b72-7a23-439a-8cac-fd4d05aeef3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:51.167301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb21b72-7a23-439a-8cac-fd4d05aeef3e service glance] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:51.216893 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1246/2466] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:39:51.771572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90944376-3e77-44c5-a1d5-e8eeec0079ca None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:51.771856 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90944376-3e77-44c5-a1d5-e8eeec0079ca None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:51.772235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90944376-3e77-44c5-a1d5-e8eeec0079ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:51.800113 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-90944376-3e77-44c5-a1d5-e8eeec0079ca None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:39:51.801570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-90944376-3e77-44c5-a1d5-e8eeec0079ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:51.881934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1221/2467] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:39:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:39:52.090680 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21b72-7a23-439a-8cac-fd4d05aeef3e service glance] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:52.092757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cfb21b72-7a23-439a-8cac-fd4d05aeef3e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:52.111310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29259cad-6a22-4b03-82d4-57c075b82c56 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:52.111685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29259cad-6a22-4b03-82d4-57c075b82c56 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:52.112128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29259cad-6a22-4b03-82d4-57c075b82c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:52.137365 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:52.147155 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-29259cad-6a22-4b03-82d4-57c075b82c56 None None] MFA Rules not processed for user `7d0fa8beb6954a5d8662e581345e2a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:39:52.149257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-29259cad-6a22-4b03-82d4-57c075b82c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:52.171522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:39:52.219497 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21b72-7a23-439a-8cac-fd4d05aeef3e service glance] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:52.226447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc66ad-16fc-43cd-8c80-bad5ddd8b82c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:52.227157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc66ad-16fc-43cd-8c80-bad5ddd8b82c service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:52.227433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc66ad-16fc-43cd-8c80-bad5ddd8b82c service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:52.227978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc66ad-16fc-43cd-8c80-bad5ddd8b82c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:52.240346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc66ad-16fc-43cd-8c80-bad5ddd8b82c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:52.242970 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc66ad-16fc-43cd-8c80-bad5ddd8b82c service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:52.248391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1222/2468] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:39:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:39:52.262939 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1247/2469] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:39:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:39:52.265738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29259cad-6a22-4b03-82d4-57c075b82c56 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:52.267321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-29259cad-6a22-4b03-82d4-57c075b82c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:52.285109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29259cad-6a22-4b03-82d4-57c075b82c56 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:52.306941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f4047-3443-430d-840e-deb89e5d26c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:52.309741 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f4047-3443-430d-840e-deb89e5d26c3 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:52.310027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f4047-3443-430d-840e-deb89e5d26c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:52.311132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f4047-3443-430d-840e-deb89e5d26c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:52.339905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f4047-3443-430d-840e-deb89e5d26c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:52.342151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f4047-3443-430d-840e-deb89e5d26c3 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:52.356703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1223/2470] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:39:55.875334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be131552-f311-4c10-ae35-a093aeceb0bb None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:55.875898 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be131552-f311-4c10-ae35-a093aeceb0bb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:55.875898 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be131552-f311-4c10-ae35-a093aeceb0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:55.913683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-be131552-f311-4c10-ae35-a093aeceb0bb None None] MFA Rules not processed for user `7d0fa8beb6954a5d8662e581345e2a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:39:55.915080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-be131552-f311-4c10-ae35-a093aeceb0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:55.929325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1248/2471] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:39:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:39:56.248421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f4047-3443-430d-840e-deb89e5d26c3 service nova] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:56.249868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-046f4047-3443-430d-840e-deb89e5d26c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:56.309008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f4047-3443-430d-840e-deb89e5d26c3 service nova] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:56.312793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821f865-d792-401c-9dcc-eb456c8b1d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:56.313418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821f865-d792-401c-9dcc-eb456c8b1d46 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:56.313798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821f865-d792-401c-9dcc-eb456c8b1d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:56.314084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821f865-d792-401c-9dcc-eb456c8b1d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:56.315877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5821f865-d792-401c-9dcc-eb456c8b1d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:56.326300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821f865-d792-401c-9dcc-eb456c8b1d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:56.327718 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821f865-d792-401c-9dcc-eb456c8b1d46 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:56.337398 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1224/2472] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:39:56.953803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be131552-f311-4c10-ae35-a093aeceb0bb None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:39:56.955942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-be131552-f311-4c10-ae35-a093aeceb0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:57.090231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be131552-f311-4c10-ae35-a093aeceb0bb None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:39:57.096114 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2928715-d76b-42c7-85dd-97b1856ff9e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:39:57.099150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2928715-d76b-42c7-85dd-97b1856ff9e6 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:39:57.099150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2928715-d76b-42c7-85dd-97b1856ff9e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:39:57.099150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2928715-d76b-42c7-85dd-97b1856ff9e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:39:57.101935 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c2928715-d76b-42c7-85dd-97b1856ff9e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:39:57.117749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2928715-d76b-42c7-85dd-97b1856ff9e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:39:57.119476 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2928715-d76b-42c7-85dd-97b1856ff9e6 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:39:57.147207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1249/2473] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:39:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:40:04.949009 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821f865-d792-401c-9dcc-eb456c8b1d46 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:04.957818 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821f865-d792-401c-9dcc-eb456c8b1d46 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:04.961917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8f66e-ecef-45d1-a9f8-af36a9a9c016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:04.962516 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8f66e-ecef-45d1-a9f8-af36a9a9c016 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:04.962721 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8f66e-ecef-45d1-a9f8-af36a9a9c016 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:04.962988 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8f66e-ecef-45d1-a9f8-af36a9a9c016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:04.964874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2ac8f66e-ecef-45d1-a9f8-af36a9a9c016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:04.975677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8f66e-ecef-45d1-a9f8-af36a9a9c016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:04.977143 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8f66e-ecef-45d1-a9f8-af36a9a9c016 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:04.985807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1225/2474] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:07.126062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=45 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:13.129300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f3ea3-f6ab-4fae-bd00-bcdb5a30428e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:13.131175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f3ea3-f6ab-4fae-bd00-bcdb5a30428e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:13.131448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f3ea3-f6ab-4fae-bd00-bcdb5a30428e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:13.136517 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1250/2475] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:40:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:40:13.148964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b18a4b-359c-4b59-8f9b-b056ef90c941 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:13.149430 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b18a4b-359c-4b59-8f9b-b056ef90c941 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:13.149604 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b18a4b-359c-4b59-8f9b-b056ef90c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:13.178662 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-11b18a4b-359c-4b59-8f9b-b056ef90c941 None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:13.180059 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-11b18a4b-359c-4b59-8f9b-b056ef90c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:13.193562 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1226/2476] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:13.201148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f3ea3-f6ab-4fae-bd00-bcdb5a30428e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:13.214052 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f3ea3-f6ab-4fae-bd00-bcdb5a30428e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:13.217793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870310d-e97a-4482-b4b3-cabbc1b1d48d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6462736c485545d8a26766360ebe0c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:13.218491 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870310d-e97a-4482-b4b3-cabbc1b1d48d service glance] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:13.218838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870310d-e97a-4482-b4b3-cabbc1b1d48d service glance] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:13.219187 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870310d-e97a-4482-b4b3-cabbc1b1d48d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:13.230903 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870310d-e97a-4482-b4b3-cabbc1b1d48d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:13.232550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870310d-e97a-4482-b4b3-cabbc1b1d48d service glance] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:13.244154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1251/2477] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:13.369295 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b18a4b-359c-4b59-8f9b-b056ef90c941 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:13.369399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-11b18a4b-359c-4b59-8f9b-b056ef90c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:13.383350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b18a4b-359c-4b59-8f9b-b056ef90c941 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:13.389301 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab43bd0-43e7-42ab-97f6-77332f462b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:13.390088 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab43bd0-43e7-42ab-97f6-77332f462b23 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:13.390225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab43bd0-43e7-42ab-97f6-77332f462b23 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:13.390498 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab43bd0-43e7-42ab-97f6-77332f462b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:13.392229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cab43bd0-43e7-42ab-97f6-77332f462b23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:13.407881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab43bd0-43e7-42ab-97f6-77332f462b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:13.409533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab43bd0-43e7-42ab-97f6-77332f462b23 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:13.423935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1227/2478] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:13.508175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81609b-1d39-46db-a087-6735ec05635e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:13.508566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81609b-1d39-46db-a087-6735ec05635e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:13.508916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81609b-1d39-46db-a087-6735ec05635e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:13.510363 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1252/2479] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:40:13.516209 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed586a-53b0-41f6-84cd-3c4ecd68dfde None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:13.516573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed586a-53b0-41f6-84cd-3c4ecd68dfde None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:13.516912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed586a-53b0-41f6-84cd-3c4ecd68dfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:13.539053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5aed586a-53b0-41f6-84cd-3c4ecd68dfde None None] MFA Rules not processed for user `b040de20aa6f4e7b8366c7daa54c093c`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:13.540408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5aed586a-53b0-41f6-84cd-3c4ecd68dfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:13.547406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1228/2480] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:13.563822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81609b-1d39-46db-a087-6735ec05635e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:13.565715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6b81609b-1d39-46db-a087-6735ec05635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:13.580982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81609b-1d39-46db-a087-6735ec05635e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:13.584865 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbf9ec-bc75-41cb-b6d2-89f223b6726e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:13.585965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbf9ec-bc75-41cb-b6d2-89f223b6726e service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:13.586242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbf9ec-bc75-41cb-b6d2-89f223b6726e service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:13.586525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbf9ec-bc75-41cb-b6d2-89f223b6726e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:13.595670 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbf9ec-bc75-41cb-b6d2-89f223b6726e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:13.597269 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbf9ec-bc75-41cb-b6d2-89f223b6726e service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:13.608746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1253/2481] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:13.696660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8a713-12fe-404f-8932-bca2d9f1b0bc None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:13.697255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8a713-12fe-404f-8932-bca2d9f1b0bc None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:13.697530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8a713-12fe-404f-8932-bca2d9f1b0bc None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:13.699659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1229/2482] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 10:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 10:40:13.705710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728ea41-4190-4e1e-81c7-aada86b06c8e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:13.706925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728ea41-4190-4e1e-81c7-aada86b06c8e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:13.707308 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728ea41-4190-4e1e-81c7-aada86b06c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:13.731179 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4728ea41-4190-4e1e-81c7-aada86b06c8e None None] MFA Rules not processed for user `567188b7c4fe40c1a1623d2f60092d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:13.733035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4728ea41-4190-4e1e-81c7-aada86b06c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:13.745032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1254/2483] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:40:13.756492 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8a713-12fe-404f-8932-bca2d9f1b0bc None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:13.771053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8a713-12fe-404f-8932-bca2d9f1b0bc None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:13.775403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a096a-118a-4bed-9ba7-7b72f9fb76c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:13.776257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a096a-118a-4bed-9ba7-7b72f9fb76c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:13.776768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a096a-118a-4bed-9ba7-7b72f9fb76c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:13.777241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a096a-118a-4bed-9ba7-7b72f9fb76c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:13.790905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a096a-118a-4bed-9ba7-7b72f9fb76c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:13.792472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a096a-118a-4bed-9ba7-7b72f9fb76c7 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:13.803700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1230/2484] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:15.453386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728ea41-4190-4e1e-81c7-aada86b06c8e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:15.463819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728ea41-4190-4e1e-81c7-aada86b06c8e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:15.467569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed50a5-b139-4507-92b8-30a5e1483e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:15.468236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed50a5-b139-4507-92b8-30a5e1483e0f service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:15.468638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed50a5-b139-4507-92b8-30a5e1483e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:15.468912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed50a5-b139-4507-92b8-30a5e1483e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:15.470833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f0ed50a5-b139-4507-92b8-30a5e1483e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:15.540954 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed50a5-b139-4507-92b8-30a5e1483e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:15.542376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed50a5-b139-4507-92b8-30a5e1483e0f service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:15.552466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1255/2485] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:16.872278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd821760-4db1-4a7b-a798-88ca8bdd1fc5 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:16.872743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd821760-4db1-4a7b-a798-88ca8bdd1fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:16.872859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd821760-4db1-4a7b-a798-88ca8bdd1fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:16.891663 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-dd821760-4db1-4a7b-a798-88ca8bdd1fc5 None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:16.892886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dd821760-4db1-4a7b-a798-88ca8bdd1fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:16.900541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1231/2486] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:40:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:16.914698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed50a5-b139-4507-92b8-30a5e1483e0f service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:16.925516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed50a5-b139-4507-92b8-30a5e1483e0f service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:16.930703 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b0eb8-f019-4b61-a2ad-61122fd656c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:16.931289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0eb8-f019-4b61-a2ad-61122fd656c5 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:16.931563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0eb8-f019-4b61-a2ad-61122fd656c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:16.931829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0eb8-f019-4b61-a2ad-61122fd656c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:16.939755 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b0eb8-f019-4b61-a2ad-61122fd656c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:16.941355 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b0eb8-f019-4b61-a2ad-61122fd656c5 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:16.951272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1256/2487] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:40:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:40:20.294728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd821760-4db1-4a7b-a798-88ca8bdd1fc5 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:20.296586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dd821760-4db1-4a7b-a798-88ca8bdd1fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:20.319203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd821760-4db1-4a7b-a798-88ca8bdd1fc5 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:20.328604 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6a25f-586f-428f-999d-d52b0b74d88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:20.329401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6a25f-586f-428f-999d-d52b0b74d88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:20.329823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6a25f-586f-428f-999d-d52b0b74d88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:20.330165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6a25f-586f-428f-999d-d52b0b74d88b admin admin] PATH_INFO: `/v3/users/f040e47e66d145589b4233fe98c93507` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:20.331595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6a25f-586f-428f-999d-d52b0b74d88b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f040e47e66d145589b4233fe98c93507)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:20.333667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6a25f-586f-428f-999d-d52b0b74d88b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:20.478777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:20.595300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81b6a25f-586f-428f-999d-d52b0b74d88b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f040e47e66d145589b4233fe98c93507'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:20.609623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81b6a25f-586f-428f-999d-d52b0b74d88b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f040e47e66d145589b4233fe98c93507'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:20.612347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81b6a25f-586f-428f-999d-d52b0b74d88b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f040e47e66d145589b4233fe98c93507'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:20.746158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81b6a25f-586f-428f-999d-d52b0b74d88b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f040e47e66d145589b4233fe98c93507'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:20.762193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81b6a25f-586f-428f-999d-d52b0b74d88b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f040e47e66d145589b4233fe98c93507'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:20.768948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1232/2488] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:40:20 2022] DELETE /identity/v3/users/f040e47e66d145589b4233fe98c93507 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:21.045265 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b0eb8-f019-4b61-a2ad-61122fd656c5 service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:21.062180 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b0eb8-f019-4b61-a2ad-61122fd656c5 service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:21.134255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:21.135060 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:21.135432 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:21.135839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3 admin admin] PATH_INFO: `/v3/projects/3b40ed66232b4e99abf1107009fcd9f9` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:21.137095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b40ed66232b4e99abf1107009fcd9f9)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:21.139396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:21.279854 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b40ed66232b4e99abf1107009fcd9f9', 'request_id': 'req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:21.281041 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:21.286040 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b40ed66232b4e99abf1107009fcd9f9', 'request_id': 'req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:21.356921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b40ed66232b4e99abf1107009fcd9f9', 'request_id': 'req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:21.369874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3 admin admin] The token cache is being invalidate because project 3b40ed66232b4e99abf1107009fcd9f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:40:21.370168 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:21.370825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-59bd1a24-c1c1-4e15-8ced-bea0585eb6e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:21.372380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1257/2489] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:40:21 2022] DELETE /identity/v3/projects/3b40ed66232b4e99abf1107009fcd9f9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:21.377270 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1507772-ab89-4f18-beeb-0a63841c7fc7 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:21.377788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1507772-ab89-4f18-beeb-0a63841c7fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:21.377788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1507772-ab89-4f18-beeb-0a63841c7fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:21.422377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b1507772-ab89-4f18-beeb-0a63841c7fc7 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:21.423594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b1507772-ab89-4f18-beeb-0a63841c7fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:21.490395 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1233/2490] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:21.499030 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe8f3d-b9bc-4164-a4be-038032f24cce None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:21.499322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe8f3d-b9bc-4164-a4be-038032f24cce None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:21.499594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe8f3d-b9bc-4164-a4be-038032f24cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:21.520513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5bfe8f3d-b9bc-4164-a4be-038032f24cce None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:21.521748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5bfe8f3d-b9bc-4164-a4be-038032f24cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:21.533615 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1258/2491] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:21.534584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1507772-ab89-4f18-beeb-0a63841c7fc7 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:21.544780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1507772-ab89-4f18-beeb-0a63841c7fc7 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:21.549507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001236d-b258-4ffb-b248-34fba8ec63be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:21.550126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001236d-b258-4ffb-b248-34fba8ec63be admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:21.550404 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001236d-b258-4ffb-b248-34fba8ec63be admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:21.550674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001236d-b258-4ffb-b248-34fba8ec63be admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:21.551480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001236d-b258-4ffb-b248-34fba8ec63be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:40:21.551779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001236d-b258-4ffb-b248-34fba8ec63be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:21.554317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001236d-b258-4ffb-b248-34fba8ec63be admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:21.568313 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1234/2492] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:40:21.573327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe8f3d-b9bc-4164-a4be-038032f24cce None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:21.582866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe8f3d-b9bc-4164-a4be-038032f24cce None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:21.588242 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c820bb-7b61-4c07-aff9-4ff3a25e2254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:21.588846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c820bb-7b61-4c07-aff9-4ff3a25e2254 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:21.589122 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c820bb-7b61-4c07-aff9-4ff3a25e2254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:21.589393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c820bb-7b61-4c07-aff9-4ff3a25e2254 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:21.590100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c820bb-7b61-4c07-aff9-4ff3a25e2254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:21.591999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c820bb-7b61-4c07-aff9-4ff3a25e2254 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:21.709487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1259/2493] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:40:21 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:21.713456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001236d-b258-4ffb-b248-34fba8ec63be admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:21.725240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001236d-b258-4ffb-b248-34fba8ec63be admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:21.848500 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65603e3c-03ab-43d9-a74d-d6e863fe32bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:21.852725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65603e3c-03ab-43d9-a74d-d6e863fe32bc admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:21.853212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65603e3c-03ab-43d9-a74d-d6e863fe32bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:21.853329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65603e3c-03ab-43d9-a74d-d6e863fe32bc admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:21.854010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65603e3c-03ab-43d9-a74d-d6e863fe32bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:21.856007 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65603e3c-03ab-43d9-a74d-d6e863fe32bc admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:22.312884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1235/2494] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:40:21 2022] POST /identity/v3/users => generated 292 bytes in 600 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:40:22.316964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c820bb-7b61-4c07-aff9-4ff3a25e2254 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:22.328622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c820bb-7b61-4c07-aff9-4ff3a25e2254 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:22.333224 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eda38e-cfd5-4c03-abe2-6a8fdba88377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:22.333830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eda38e-cfd5-4c03-abe2-6a8fdba88377 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:22.334108 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eda38e-cfd5-4c03-abe2-6a8fdba88377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:22.334388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eda38e-cfd5-4c03-abe2-6a8fdba88377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:22.335035 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eda38e-cfd5-4c03-abe2-6a8fdba88377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:22.336643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eda38e-cfd5-4c03-abe2-6a8fdba88377 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:22.350673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1260/2495] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:22.353638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65603e3c-03ab-43d9-a74d-d6e863fe32bc admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:22.366748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65603e3c-03ab-43d9-a74d-d6e863fe32bc admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:22.372811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1f5d8-7a60-4707-a608-b1f01b677a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:22.373630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1f5d8-7a60-4707-a608-b1f01b677a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:22.373918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1f5d8-7a60-4707-a608-b1f01b677a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:22.374354 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1f5d8-7a60-4707-a608-b1f01b677a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:22.375362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1f5d8-7a60-4707-a608-b1f01b677a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:22.377043 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1f5d8-7a60-4707-a608-b1f01b677a39 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:22.390476 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1236/2496] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:22.394532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eda38e-cfd5-4c03-abe2-6a8fdba88377 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:22.411059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eda38e-cfd5-4c03-abe2-6a8fdba88377 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:22.419184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2669f67-33e4-4b5d-b675-43a221d9d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:22.419981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2669f67-33e4-4b5d-b675-43a221d9d775 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:22.420324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2669f67-33e4-4b5d-b675-43a221d9d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:22.420670 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2669f67-33e4-4b5d-b675-43a221d9d775 admin admin] PATH_INFO: `/v3/projects/2ec5b5126a19473bbe049b03df0f2429/users/a0637c3f02294a23b58a78034214545d/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:22.438927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2669f67-33e4-4b5d-b675-43a221d9d775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec5b5126a19473bbe049b03df0f2429, user_id=a0637c3f02294a23b58a78034214545d, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:22.442157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2669f67-33e4-4b5d-b675-43a221d9d775 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:23.061258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1261/2497] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:40:22 2022] PUT /identity/v3/projects/2ec5b5126a19473bbe049b03df0f2429/users/a0637c3f02294a23b58a78034214545d/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:23.076864 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e64b43-e8f4-4bea-9842-4e3f7ad1e28f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:23.077148 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e64b43-e8f4-4bea-9842-4e3f7ad1e28f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:23.077425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e64b43-e8f4-4bea-9842-4e3f7ad1e28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:23.110897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:23.121395 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-41e64b43-e8f4-4bea-9842-4e3f7ad1e28f None None] MFA Rules not processed for user `a0637c3f02294a23b58a78034214545d`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:23.122769 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-41e64b43-e8f4-4bea-9842-4e3f7ad1e28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:23.192021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1237/2498] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:23.203963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2669f67-33e4-4b5d-b675-43a221d9d775 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:23.205785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a2669f67-33e4-4b5d-b675-43a221d9d775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:23.284224 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2669f67-33e4-4b5d-b675-43a221d9d775 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:23.290531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc22d-0951-45e6-a112-5a8627074094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:23.291138 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc22d-0951-45e6-a112-5a8627074094 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:23.291413 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc22d-0951-45e6-a112-5a8627074094 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:23.291680 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc22d-0951-45e6-a112-5a8627074094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:23.299419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cc22d-0951-45e6-a112-5a8627074094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:23.301047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cc22d-0951-45e6-a112-5a8627074094 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:23.311157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1262/2499] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:29.485300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e64b43-e8f4-4bea-9842-4e3f7ad1e28f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:29.499350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e64b43-e8f4-4bea-9842-4e3f7ad1e28f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:29.507861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f50a0-2cc8-4388-b0c0-23cb1c316f88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:29.507861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f50a0-2cc8-4388-b0c0-23cb1c316f88 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:29.507861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f50a0-2cc8-4388-b0c0-23cb1c316f88 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:29.507861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f50a0-2cc8-4388-b0c0-23cb1c316f88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:29.509952 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3e9f50a0-2cc8-4388-b0c0-23cb1c316f88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:29.520914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f50a0-2cc8-4388-b0c0-23cb1c316f88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:29.522578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f50a0-2cc8-4388-b0c0-23cb1c316f88 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:29.534199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1238/2500] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:29.598833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc22d-0951-45e6-a112-5a8627074094 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:29.668913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc22d-0951-45e6-a112-5a8627074094 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:29.674112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:29.674780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:29.675091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:29.675366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] PATH_INFO: `/v3/users/a0637c3f02294a23b58a78034214545d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:29.676521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0637c3f02294a23b58a78034214545d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:29.678613 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:29.680150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:29.891123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0637c3f02294a23b58a78034214545d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:29.899150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0637c3f02294a23b58a78034214545d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:29.899863 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0637c3f02294a23b58a78034214545d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:29.900608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0637c3f02294a23b58a78034214545d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:30.048086 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0637c3f02294a23b58a78034214545d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:30.066512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1263/2501] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:40:29 2022] DELETE /identity/v3/users/a0637c3f02294a23b58a78034214545d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:30.071573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81084d0e-3a26-460d-8596-925e8bc8ca29 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:30.071865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81084d0e-3a26-460d-8596-925e8bc8ca29 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:30.072182 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81084d0e-3a26-460d-8596-925e8bc8ca29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:30.091713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-81084d0e-3a26-460d-8596-925e8bc8ca29 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:30.093015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-81084d0e-3a26-460d-8596-925e8bc8ca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:30.153945 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1239/2502] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:30.164704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:30.166040 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:30.223741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717f7ae-7484-4079-bc3b-a264b1600c31 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:30.227351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bff9d-3000-4da8-9846-00feeaa3294b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:30.228233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bff9d-3000-4da8-9846-00feeaa3294b service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:30.228516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bff9d-3000-4da8-9846-00feeaa3294b service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:30.228785 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bff9d-3000-4da8-9846-00feeaa3294b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:30.237485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bff9d-3000-4da8-9846-00feeaa3294b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:30.238900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bff9d-3000-4da8-9846-00feeaa3294b service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:30.248172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1264/2503] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:30.649935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81084d0e-3a26-460d-8596-925e8bc8ca29 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:30.651385 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-81084d0e-3a26-460d-8596-925e8bc8ca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:30.665406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81084d0e-3a26-460d-8596-925e8bc8ca29 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:30.670132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:30.670883 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:30.671157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:30.671926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c admin admin] PATH_INFO: `/v3/projects/2ec5b5126a19473bbe049b03df0f2429` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:30.673246 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec5b5126a19473bbe049b03df0f2429)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:30.675161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:30.780522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec5b5126a19473bbe049b03df0f2429', 'request_id': 'req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:30.786095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec5b5126a19473bbe049b03df0f2429', 'request_id': 'req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:30.792830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec5b5126a19473bbe049b03df0f2429', 'request_id': 'req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:30.887086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c admin admin] The token cache is being invalidate because project 2ec5b5126a19473bbe049b03df0f2429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:40:30.887368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:30.888008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-e8dcdd21-4ec9-4e0b-a8e5-5908baf4693c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:30.889725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1240/2504] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:40:30 2022] DELETE /identity/v3/projects/2ec5b5126a19473bbe049b03df0f2429 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:30.894616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30cdac-dc15-48f2-93e6-a6ba94d1c83d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:30.895107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30cdac-dc15-48f2-93e6-a6ba94d1c83d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:30.895220 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30cdac-dc15-48f2-93e6-a6ba94d1c83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:30.915282 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1e30cdac-dc15-48f2-93e6-a6ba94d1c83d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:30.916573 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1e30cdac-dc15-48f2-93e6-a6ba94d1c83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:30.974530 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1265/2505] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:30.983131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a084c9-50b5-4617-b872-bc9f566675b6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:30.983415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a084c9-50b5-4617-b872-bc9f566675b6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:30.983689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a084c9-50b5-4617-b872-bc9f566675b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:31.003589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d8a084c9-50b5-4617-b872-bc9f566675b6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:31.004822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d8a084c9-50b5-4617-b872-bc9f566675b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:31.012687 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1241/2506] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:40:31.016685 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30cdac-dc15-48f2-93e6-a6ba94d1c83d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:31.026890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30cdac-dc15-48f2-93e6-a6ba94d1c83d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:31.031477 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141193a-5abb-418f-a7c8-d6dcc30437d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:31.032149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141193a-5abb-418f-a7c8-d6dcc30437d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:31.032485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141193a-5abb-418f-a7c8-d6dcc30437d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:31.033020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141193a-5abb-418f-a7c8-d6dcc30437d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:31.033661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141193a-5abb-418f-a7c8-d6dcc30437d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:40:31.033960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141193a-5abb-418f-a7c8-d6dcc30437d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:31.035521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141193a-5abb-418f-a7c8-d6dcc30437d8 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:31.047372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1266/2507] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:40:31.051568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a084c9-50b5-4617-b872-bc9f566675b6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:31.056748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:31.062286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a084c9-50b5-4617-b872-bc9f566675b6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:31.067238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425223d-5213-4503-a569-d85775587ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:31.067884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425223d-5213-4503-a569-d85775587ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:31.068200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425223d-5213-4503-a569-d85775587ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:31.068504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425223d-5213-4503-a569-d85775587ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:31.069147 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425223d-5213-4503-a569-d85775587ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:31.071352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425223d-5213-4503-a569-d85775587ea2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:31.082233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d506a6-6165-42a4-9d37-65bb4c9e90c5 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:31.082466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d506a6-6165-42a4-9d37-65bb4c9e90c5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:31.082750 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d506a6-6165-42a4-9d37-65bb4c9e90c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:31.103336 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-13d506a6-6165-42a4-9d37-65bb4c9e90c5 None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:31.104588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-13d506a6-6165-42a4-9d37-65bb4c9e90c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:31.108947 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:31.159061 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1242/2508] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:40:31 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:31.160586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425223d-5213-4503-a569-d85775587ea2 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:31.161940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1267/2509] 10.222.0.33 () {58 vars in 967 bytes} [Tue Oct 4 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:40:31.178136 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d506a6-6165-42a4-9d37-65bb4c9e90c5 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:31.179851 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-13d506a6-6165-42a4-9d37-65bb4c9e90c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:31.228633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425223d-5213-4503-a569-d85775587ea2 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:31.233486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d83217-5f50-4c11-bd4a-196ca522df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:31.234091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d83217-5f50-4c11-bd4a-196ca522df71 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:31.234372 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d83217-5f50-4c11-bd4a-196ca522df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:31.234645 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d83217-5f50-4c11-bd4a-196ca522df71 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:31.235503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d83217-5f50-4c11-bd4a-196ca522df71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:31.237456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d83217-5f50-4c11-bd4a-196ca522df71 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:31.251111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d506a6-6165-42a4-9d37-65bb4c9e90c5 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:31.306208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1243/2510] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:40:31 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:31.311131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d83217-5f50-4c11-bd4a-196ca522df71 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:31.316067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201ae12-7d60-4028-977a-e086f5a697d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:31.317016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201ae12-7d60-4028-977a-e086f5a697d7 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:31.317464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201ae12-7d60-4028-977a-e086f5a697d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:31.317915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201ae12-7d60-4028-977a-e086f5a697d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:31.322318 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d83217-5f50-4c11-bd4a-196ca522df71 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:31.329179 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6feb4b-6420-4106-bf7b-49e535c61a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:31.330595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6feb4b-6420-4106-bf7b-49e535c61a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:31.330595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6feb4b-6420-4106-bf7b-49e535c61a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:31.330595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6feb4b-6420-4106-bf7b-49e535c61a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:31.331120 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6feb4b-6420-4106-bf7b-49e535c61a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:31.332795 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6feb4b-6420-4106-bf7b-49e535c61a31 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:31.346623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1244/2511] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:31.347691 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6feb4b-6420-4106-bf7b-49e535c61a31 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:31.359610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6feb4b-6420-4106-bf7b-49e535c61a31 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:31.365115 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14d772-8726-46b9-8b44-5fe42949beb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:31.365743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14d772-8726-46b9-8b44-5fe42949beb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:31.366022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14d772-8726-46b9-8b44-5fe42949beb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:31.366292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14d772-8726-46b9-8b44-5fe42949beb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:31.366973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14d772-8726-46b9-8b44-5fe42949beb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:31.368589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14d772-8726-46b9-8b44-5fe42949beb2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:31.380598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1245/2512] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:31.381729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201ae12-7d60-4028-977a-e086f5a697d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:31.383971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201ae12-7d60-4028-977a-e086f5a697d7 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:31.384501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14d772-8726-46b9-8b44-5fe42949beb2 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:31.394301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1268/2513] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:40:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 10:40:31.394442 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14d772-8726-46b9-8b44-5fe42949beb2 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:31.397742 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:31.401028 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141584b3-f74a-4870-a5f5-48f519cf18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:31.420286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141584b3-f74a-4870-a5f5-48f519cf18ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:31.420286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141584b3-f74a-4870-a5f5-48f519cf18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:31.420286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141584b3-f74a-4870-a5f5-48f519cf18ad admin admin] PATH_INFO: `/v3/projects/823ada43ebe34aa8a59cec814479832c/users/af8ddc33d54a47f3a805e76db3d089a7/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:31.420286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141584b3-f74a-4870-a5f5-48f519cf18ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=823ada43ebe34aa8a59cec814479832c, user_id=af8ddc33d54a47f3a805e76db3d089a7, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:31.422329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141584b3-f74a-4870-a5f5-48f519cf18ad admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:31.500058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1246/2514] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:40:31 2022] PUT /identity/v3/projects/823ada43ebe34aa8a59cec814479832c/users/af8ddc33d54a47f3a805e76db3d089a7/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:40:31.510856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12877df-4fea-47dd-b786-68af88d56ccd None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:31.511143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12877df-4fea-47dd-b786-68af88d56ccd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:31.511419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12877df-4fea-47dd-b786-68af88d56ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:31.539998 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d12877df-4fea-47dd-b786-68af88d56ccd None None] MFA Rules not processed for user `af8ddc33d54a47f3a805e76db3d089a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:31.541215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d12877df-4fea-47dd-b786-68af88d56ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:31.607566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1269/2515] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:31.618836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141584b3-f74a-4870-a5f5-48f519cf18ad admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:31.620558 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-141584b3-f74a-4870-a5f5-48f519cf18ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:31.696126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141584b3-f74a-4870-a5f5-48f519cf18ad admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:31.701674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e952e93-e130-4b69-b0c3-7339662b680c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:31.702279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e952e93-e130-4b69-b0c3-7339662b680c service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:31.702561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e952e93-e130-4b69-b0c3-7339662b680c service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:31.702830 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e952e93-e130-4b69-b0c3-7339662b680c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:31.711431 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e952e93-e130-4b69-b0c3-7339662b680c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:31.713044 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e952e93-e130-4b69-b0c3-7339662b680c service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:31.721816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1247/2516] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:31.947170 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12877df-4fea-47dd-b786-68af88d56ccd None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:32.010298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12877df-4fea-47dd-b786-68af88d56ccd None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:32.014771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:32.015394 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:32.015673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:32.015942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] PATH_INFO: `/v3/users/af8ddc33d54a47f3a805e76db3d089a7` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:32.017072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8ddc33d54a47f3a805e76db3d089a7)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:32.018963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:32.228664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8ddc33d54a47f3a805e76db3d089a7'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:32.235895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8ddc33d54a47f3a805e76db3d089a7'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:32.236631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8ddc33d54a47f3a805e76db3d089a7'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:32.237260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8ddc33d54a47f3a805e76db3d089a7'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:32.305542 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8ddc33d54a47f3a805e76db3d089a7'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:32.324351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1270/2517] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:40:31 2022] DELETE /identity/v3/users/af8ddc33d54a47f3a805e76db3d089a7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:32.328853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3250c-b3cf-4fff-89cf-3f1ca838b772 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:32.329143 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3250c-b3cf-4fff-89cf-3f1ca838b772 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:32.329420 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3250c-b3cf-4fff-89cf-3f1ca838b772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:32.349354 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-bef3250c-b3cf-4fff-89cf-3f1ca838b772 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:32.350531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bef3250c-b3cf-4fff-89cf-3f1ca838b772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:32.354854 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:32.410478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1248/2518] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:32.420193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:32.421607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:32.432073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:32.483462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b676ed4-b83f-4794-aff8-3152715e9e18 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:32.487084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c7752-cdba-47a2-b1d1-4f9354748370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:32.490986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c7752-cdba-47a2-b1d1-4f9354748370 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:32.490986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c7752-cdba-47a2-b1d1-4f9354748370 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:32.490986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c7752-cdba-47a2-b1d1-4f9354748370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:32.498207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c7752-cdba-47a2-b1d1-4f9354748370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:32.499825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c7752-cdba-47a2-b1d1-4f9354748370 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:32.510882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1271/2519] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:33.345443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3250c-b3cf-4fff-89cf-3f1ca838b772 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:33.345443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bef3250c-b3cf-4fff-89cf-3f1ca838b772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:33.355703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3250c-b3cf-4fff-89cf-3f1ca838b772 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:33.360263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7e07c-d51e-49a6-b81a-f6b1902e505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:33.360903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7e07c-d51e-49a6-b81a-f6b1902e505f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:33.361181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7e07c-d51e-49a6-b81a-f6b1902e505f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:33.361453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7e07c-d51e-49a6-b81a-f6b1902e505f admin admin] PATH_INFO: `/v3/projects/823ada43ebe34aa8a59cec814479832c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:33.362584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7e07c-d51e-49a6-b81a-f6b1902e505f admin admin] RBAC: Authorizing `identity:delete_project(project_id=823ada43ebe34aa8a59cec814479832c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:33.365047 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7e07c-d51e-49a6-b81a-f6b1902e505f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:33.483265 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-78c7e07c-d51e-49a6-b81a-f6b1902e505f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823ada43ebe34aa8a59cec814479832c', 'request_id': 'req-78c7e07c-d51e-49a6-b81a-f6b1902e505f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:33.488814 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-78c7e07c-d51e-49a6-b81a-f6b1902e505f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823ada43ebe34aa8a59cec814479832c', 'request_id': 'req-78c7e07c-d51e-49a6-b81a-f6b1902e505f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:33.495090 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-78c7e07c-d51e-49a6-b81a-f6b1902e505f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823ada43ebe34aa8a59cec814479832c', 'request_id': 'req-78c7e07c-d51e-49a6-b81a-f6b1902e505f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:33.572539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-78c7e07c-d51e-49a6-b81a-f6b1902e505f admin admin] The token cache is being invalidate because project 823ada43ebe34aa8a59cec814479832c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:40:33.572822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-78c7e07c-d51e-49a6-b81a-f6b1902e505f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:33.573433 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-78c7e07c-d51e-49a6-b81a-f6b1902e505f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:33.574944 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1249/2520] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:40:33 2022] DELETE /identity/v3/projects/823ada43ebe34aa8a59cec814479832c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:33.579732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cc1bf-f0bc-4522-955a-67ce4ecdf5e6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:33.580221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cc1bf-f0bc-4522-955a-67ce4ecdf5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:33.582190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cc1bf-f0bc-4522-955a-67ce4ecdf5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:33.600678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-954cc1bf-f0bc-4522-955a-67ce4ecdf5e6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:33.601804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-954cc1bf-f0bc-4522-955a-67ce4ecdf5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:33.657794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1272/2521] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:33.667298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482acf9-ff76-46dd-8c7b-abe276a9c1a1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:33.667700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482acf9-ff76-46dd-8c7b-abe276a9c1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:33.667832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482acf9-ff76-46dd-8c7b-abe276a9c1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:33.687322 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1482acf9-ff76-46dd-8c7b-abe276a9c1a1 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:33.688550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1482acf9-ff76-46dd-8c7b-abe276a9c1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:33.696411 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1250/2522] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:40:33.700799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cc1bf-f0bc-4522-955a-67ce4ecdf5e6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:33.711272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cc1bf-f0bc-4522-955a-67ce4ecdf5e6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:33.715979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d602e-6766-4dbf-b5e4-e55ae7995c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:33.716584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d602e-6766-4dbf-b5e4-e55ae7995c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:33.716882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d602e-6766-4dbf-b5e4-e55ae7995c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:33.717154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d602e-6766-4dbf-b5e4-e55ae7995c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:33.717799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d602e-6766-4dbf-b5e4-e55ae7995c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:40:33.718101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d602e-6766-4dbf-b5e4-e55ae7995c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:33.719689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d602e-6766-4dbf-b5e4-e55ae7995c3f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:33.732827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1273/2523] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:40:33.737188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482acf9-ff76-46dd-8c7b-abe276a9c1a1 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:33.746535 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482acf9-ff76-46dd-8c7b-abe276a9c1a1 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:33.751234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1bf76-41ba-4f41-bf63-e3b475c44076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:33.751832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1bf76-41ba-4f41-bf63-e3b475c44076 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:33.752143 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1bf76-41ba-4f41-bf63-e3b475c44076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:33.752414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1bf76-41ba-4f41-bf63-e3b475c44076 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:33.753051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1bf76-41ba-4f41-bf63-e3b475c44076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:33.755244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1bf76-41ba-4f41-bf63-e3b475c44076 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:33.902449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1251/2524] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:40:33 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:40:33.906383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d602e-6766-4dbf-b5e4-e55ae7995c3f admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:33.916722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d602e-6766-4dbf-b5e4-e55ae7995c3f admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:33.972175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e24d-208f-4da7-8393-7d65ca7f9d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:33.972770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e24d-208f-4da7-8393-7d65ca7f9d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:33.973043 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e24d-208f-4da7-8393-7d65ca7f9d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:33.973310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e24d-208f-4da7-8393-7d65ca7f9d09 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:33.973940 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230e24d-208f-4da7-8393-7d65ca7f9d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:33.975859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230e24d-208f-4da7-8393-7d65ca7f9d09 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:34.083021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1274/2525] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:40:33 2022] POST /identity/v3/users => generated 282 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:34.087734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1bf76-41ba-4f41-bf63-e3b475c44076 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:34.098168 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1bf76-41ba-4f41-bf63-e3b475c44076 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:34.103049 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa881fc-f5e5-4d73-aab5-2802e20cf745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:34.103636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa881fc-f5e5-4d73-aab5-2802e20cf745 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:34.103913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa881fc-f5e5-4d73-aab5-2802e20cf745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:34.104211 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa881fc-f5e5-4d73-aab5-2802e20cf745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:34.104849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa881fc-f5e5-4d73-aab5-2802e20cf745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:34.106421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa881fc-f5e5-4d73-aab5-2802e20cf745 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:34.116570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1252/2526] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:34.120357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e24d-208f-4da7-8393-7d65ca7f9d09 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:34.130006 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e24d-208f-4da7-8393-7d65ca7f9d09 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:34.135225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa144abd-cd36-4b19-a4f2-b2874a8654b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:34.135801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144abd-cd36-4b19-a4f2-b2874a8654b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:34.136118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144abd-cd36-4b19-a4f2-b2874a8654b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:34.136386 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144abd-cd36-4b19-a4f2-b2874a8654b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:34.137095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa144abd-cd36-4b19-a4f2-b2874a8654b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:34.138645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa144abd-cd36-4b19-a4f2-b2874a8654b0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:34.148925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1275/2527] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:34.152975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa881fc-f5e5-4d73-aab5-2802e20cf745 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:34.162749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa881fc-f5e5-4d73-aab5-2802e20cf745 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:34.167292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43424782-711f-406d-9640-c61e25666d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:34.167922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43424782-711f-406d-9640-c61e25666d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:34.168233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43424782-711f-406d-9640-c61e25666d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:34.168504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43424782-711f-406d-9640-c61e25666d6c admin admin] PATH_INFO: `/v3/projects/5d976a910e89467f92fbe131173313fc/users/fdcfa74988554bbba71dccbfab78fd54/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:34.183022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43424782-711f-406d-9640-c61e25666d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d976a910e89467f92fbe131173313fc, user_id=fdcfa74988554bbba71dccbfab78fd54, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:34.185690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43424782-711f-406d-9640-c61e25666d6c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:34.276574 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1253/2528] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:40:34 2022] PUT /identity/v3/projects/5d976a910e89467f92fbe131173313fc/users/fdcfa74988554bbba71dccbfab78fd54/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:34.291190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3633ac-11dd-4546-8ba0-191242deeaa3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:34.291486 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3633ac-11dd-4546-8ba0-191242deeaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:34.291747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3633ac-11dd-4546-8ba0-191242deeaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:34.321637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0e3633ac-11dd-4546-8ba0-191242deeaa3 None None] MFA Rules not processed for user `fdcfa74988554bbba71dccbfab78fd54`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:34.322847 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0e3633ac-11dd-4546-8ba0-191242deeaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:34.326776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:34.386878 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1276/2529] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:34.391439 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43424782-711f-406d-9640-c61e25666d6c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:34.422843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:34.453832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43424782-711f-406d-9640-c61e25666d6c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:34.458586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b896a5-0b61-4fb2-acdd-05b543e54be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:34.459187 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b896a5-0b61-4fb2-acdd-05b543e54be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:34.459466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b896a5-0b61-4fb2-acdd-05b543e54be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:34.459735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b896a5-0b61-4fb2-acdd-05b543e54be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:34.460407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b896a5-0b61-4fb2-acdd-05b543e54be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:34.462327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b896a5-0b61-4fb2-acdd-05b543e54be3 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:34.586180 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1254/2530] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:40:34 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:34.590289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3633ac-11dd-4546-8ba0-191242deeaa3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:34.601272 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3633ac-11dd-4546-8ba0-191242deeaa3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:34.655330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03277c8-a265-4ce5-b0c0-efd270ae4999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:34.655929 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03277c8-a265-4ce5-b0c0-efd270ae4999 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:34.656235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03277c8-a265-4ce5-b0c0-efd270ae4999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:34.656508 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03277c8-a265-4ce5-b0c0-efd270ae4999 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:34.657133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03277c8-a265-4ce5-b0c0-efd270ae4999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:34.659042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03277c8-a265-4ce5-b0c0-efd270ae4999 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:34.756918 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1277/2531] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:40:34 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:34.760903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b896a5-0b61-4fb2-acdd-05b543e54be3 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:34.771304 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b896a5-0b61-4fb2-acdd-05b543e54be3 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:34.776086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f4724-951c-4598-a656-f78ed429eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:34.776811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f4724-951c-4598-a656-f78ed429eb28 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:34.777094 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f4724-951c-4598-a656-f78ed429eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:34.777367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f4724-951c-4598-a656-f78ed429eb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:34.778027 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f4724-951c-4598-a656-f78ed429eb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:34.780186 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f4724-951c-4598-a656-f78ed429eb28 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:34.791073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1255/2532] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:40:34.795443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03277c8-a265-4ce5-b0c0-efd270ae4999 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:34.806219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03277c8-a265-4ce5-b0c0-efd270ae4999 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:34.810817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900189d3-d704-4121-9043-b0fbbc876166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:34.811466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900189d3-d704-4121-9043-b0fbbc876166 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:34.811753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900189d3-d704-4121-9043-b0fbbc876166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:34.812082 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900189d3-d704-4121-9043-b0fbbc876166 admin admin] PATH_INFO: `/v3/projects/fb5fe63db87242059e4e150b633c26de/users/a0dc7d831efa425eac2f83aa90fa21dd/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:34.826807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900189d3-d704-4121-9043-b0fbbc876166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5fe63db87242059e4e150b633c26de, user_id=a0dc7d831efa425eac2f83aa90fa21dd, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:34.829483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900189d3-d704-4121-9043-b0fbbc876166 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:34.934246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1278/2533] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:40:34 2022] PUT /identity/v3/projects/fb5fe63db87242059e4e150b633c26de/users/a0dc7d831efa425eac2f83aa90fa21dd/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:34.938216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f4724-951c-4598-a656-f78ed429eb28 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:34.948506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f4724-951c-4598-a656-f78ed429eb28 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:35.004549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423936d-d73b-4baf-ad97-c864215b56b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:35.005162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423936d-d73b-4baf-ad97-c864215b56b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:35.005439 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423936d-d73b-4baf-ad97-c864215b56b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:35.005706 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423936d-d73b-4baf-ad97-c864215b56b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:35.006335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423936d-d73b-4baf-ad97-c864215b56b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:35.007982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423936d-d73b-4baf-ad97-c864215b56b9 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:35.017357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1256/2534] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:35.022183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900189d3-d704-4121-9043-b0fbbc876166 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:35.032441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900189d3-d704-4121-9043-b0fbbc876166 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:35.036992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a84d90-00bf-47b1-86bd-e08c791c52e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:35.038240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a84d90-00bf-47b1-86bd-e08c791c52e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:35.038514 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a84d90-00bf-47b1-86bd-e08c791c52e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:35.038787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a84d90-00bf-47b1-86bd-e08c791c52e2 admin admin] PATH_INFO: `/v3/projects/fb5fe63db87242059e4e150b633c26de/users/a0dc7d831efa425eac2f83aa90fa21dd/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:35.040668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a84d90-00bf-47b1-86bd-e08c791c52e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5fe63db87242059e4e150b633c26de, user_id=a0dc7d831efa425eac2f83aa90fa21dd, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:35.043240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a84d90-00bf-47b1-86bd-e08c791c52e2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:35.053300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1279/2535] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:40:35 2022] PUT /identity/v3/projects/fb5fe63db87242059e4e150b633c26de/users/a0dc7d831efa425eac2f83aa90fa21dd/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:40:35.063258 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a044215-6299-4c21-b3be-ba78291ea171 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:35.063538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a044215-6299-4c21-b3be-ba78291ea171 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:35.063811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a044215-6299-4c21-b3be-ba78291ea171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:35.093107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0a044215-6299-4c21-b3be-ba78291ea171 None None] MFA Rules not processed for user `a0dc7d831efa425eac2f83aa90fa21dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:35.094352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0a044215-6299-4c21-b3be-ba78291ea171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:35.160576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1257/2536] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:35.174042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a84d90-00bf-47b1-86bd-e08c791c52e2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:35.175745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b1a84d90-00bf-47b1-86bd-e08c791c52e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:35.233135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a84d90-00bf-47b1-86bd-e08c791c52e2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:35.236840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43a2cf-6990-43cc-af09-7657fb67d4c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:35.237435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43a2cf-6990-43cc-af09-7657fb67d4c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:35.237714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43a2cf-6990-43cc-af09-7657fb67d4c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:35.237987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43a2cf-6990-43cc-af09-7657fb67d4c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:35.246850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43a2cf-6990-43cc-af09-7657fb67d4c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:35.248305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43a2cf-6990-43cc-af09-7657fb67d4c2 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:35.253194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:35.261731 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1280/2537] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:35.440063 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a044215-6299-4c21-b3be-ba78291ea171 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:35.450341 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a044215-6299-4c21-b3be-ba78291ea171 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:35.453884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dad60a-9843-4811-82cf-b16a4e4e59e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:35.454480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dad60a-9843-4811-82cf-b16a4e4e59e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:35.454757 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dad60a-9843-4811-82cf-b16a4e4e59e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:35.455026 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dad60a-9843-4811-82cf-b16a4e4e59e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:35.475613 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:35.511091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dad60a-9843-4811-82cf-b16a4e4e59e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:35.512605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dad60a-9843-4811-82cf-b16a4e4e59e3 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:35.521273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1258/2538] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:44.228746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43a2cf-6990-43cc-af09-7657fb67d4c2 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:44.289669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43a2cf-6990-43cc-af09-7657fb67d4c2 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:44.294350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:44.294973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:44.295252 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:44.295526 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] PATH_INFO: `/v3/users/fdcfa74988554bbba71dccbfab78fd54` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:44.296715 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdcfa74988554bbba71dccbfab78fd54)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:44.298651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:44.484134 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdcfa74988554bbba71dccbfab78fd54'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:44.491062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdcfa74988554bbba71dccbfab78fd54'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:44.491722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdcfa74988554bbba71dccbfab78fd54'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:44.492343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdcfa74988554bbba71dccbfab78fd54'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:44.561648 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdcfa74988554bbba71dccbfab78fd54'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:44.579531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1281/2539] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:40:44 2022] DELETE /identity/v3/users/fdcfa74988554bbba71dccbfab78fd54 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:44.584176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb8618-bab8-498f-9090-99e7123cedf8 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:44.584635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb8618-bab8-498f-9090-99e7123cedf8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:44.584730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb8618-bab8-498f-9090-99e7123cedf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:44.604164 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-98fb8618-bab8-498f-9090-99e7123cedf8 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:44.605357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-98fb8618-bab8-498f-9090-99e7123cedf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:44.668165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1259/2540] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:44.678348 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:44.679727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:44.735608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9999-4c9b-4bc4-b597-9168b1df69a9 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:44.739244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee233412-8a9a-4cce-9de8-5d0de356e158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:44.740384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee233412-8a9a-4cce-9de8-5d0de356e158 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:44.740660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee233412-8a9a-4cce-9de8-5d0de356e158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:44.740930 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee233412-8a9a-4cce-9de8-5d0de356e158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:44.749672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee233412-8a9a-4cce-9de8-5d0de356e158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:44.751093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee233412-8a9a-4cce-9de8-5d0de356e158 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:44.760923 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1282/2541] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:45.164223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb8618-bab8-498f-9090-99e7123cedf8 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:45.165762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-98fb8618-bab8-498f-9090-99e7123cedf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:45.178269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb8618-bab8-498f-9090-99e7123cedf8 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:45.183399 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:45.184055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:45.184334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:45.184603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] PATH_INFO: `/v3/projects/5d976a910e89467f92fbe131173313fc` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:45.185720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d976a910e89467f92fbe131173313fc)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:45.187617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:45.408197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d976a910e89467f92fbe131173313fc', 'request_id': 'req-87602a34-b31b-4424-a3d7-f23217e4e88f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:45.414325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d976a910e89467f92fbe131173313fc', 'request_id': 'req-87602a34-b31b-4424-a3d7-f23217e4e88f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:45.420680 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d976a910e89467f92fbe131173313fc', 'request_id': 'req-87602a34-b31b-4424-a3d7-f23217e4e88f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:45.492909 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] The token cache is being invalidate because project 5d976a910e89467f92fbe131173313fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:40:45.493128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:45.493742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:45.495201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1260/2542] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:40:45 2022] DELETE /identity/v3/projects/5d976a910e89467f92fbe131173313fc => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:45.499315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee233412-8a9a-4cce-9de8-5d0de356e158 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:45.508950 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee233412-8a9a-4cce-9de8-5d0de356e158 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:45.527354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:45.564697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4d334-6ba5-41ba-8c9b-143b4df43e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:45.565327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4d334-6ba5-41ba-8c9b-143b4df43e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:45.565606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4d334-6ba5-41ba-8c9b-143b4df43e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:45.565880 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4d334-6ba5-41ba-8c9b-143b4df43e36 admin admin] PATH_INFO: `/v3/users/a0dc7d831efa425eac2f83aa90fa21dd` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:45.566989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4d334-6ba5-41ba-8c9b-143b4df43e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0dc7d831efa425eac2f83aa90fa21dd)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:45.568939 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4d334-6ba5-41ba-8c9b-143b4df43e36 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:45.752625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-c6d4d334-6ba5-41ba-8c9b-143b4df43e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0dc7d831efa425eac2f83aa90fa21dd'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:45.760056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-c6d4d334-6ba5-41ba-8c9b-143b4df43e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0dc7d831efa425eac2f83aa90fa21dd'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:45.760747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-c6d4d334-6ba5-41ba-8c9b-143b4df43e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0dc7d831efa425eac2f83aa90fa21dd'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:45.761341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-c6d4d334-6ba5-41ba-8c9b-143b4df43e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0dc7d831efa425eac2f83aa90fa21dd'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:45.841533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-c6d4d334-6ba5-41ba-8c9b-143b4df43e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0dc7d831efa425eac2f83aa90fa21dd'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:45.859199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1283/2543] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:40:45 2022] DELETE /identity/v3/users/a0dc7d831efa425eac2f83aa90fa21dd => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:46.290381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:46.291887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:46.304964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87602a34-b31b-4424-a3d7-f23217e4e88f admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:46.348615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:46.362171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dacb9-1639-4878-be94-fb355d72e27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:46.362804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dacb9-1639-4878-be94-fb355d72e27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:46.363076 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dacb9-1639-4878-be94-fb355d72e27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:46.363345 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dacb9-1639-4878-be94-fb355d72e27f admin admin] PATH_INFO: `/v3/projects/fb5fe63db87242059e4e150b633c26de` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:46.364483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dacb9-1639-4878-be94-fb355d72e27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5fe63db87242059e4e150b633c26de)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:46.366393 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dacb9-1639-4878-be94-fb355d72e27f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:46.613486 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-814dacb9-1639-4878-be94-fb355d72e27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5fe63db87242059e4e150b633c26de', 'request_id': 'req-814dacb9-1639-4878-be94-fb355d72e27f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:46.619032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-814dacb9-1639-4878-be94-fb355d72e27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5fe63db87242059e4e150b633c26de', 'request_id': 'req-814dacb9-1639-4878-be94-fb355d72e27f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:46.625553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-814dacb9-1639-4878-be94-fb355d72e27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5fe63db87242059e4e150b633c26de', 'request_id': 'req-814dacb9-1639-4878-be94-fb355d72e27f'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:46.767303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-814dacb9-1639-4878-be94-fb355d72e27f admin admin] The token cache is being invalidate because project fb5fe63db87242059e4e150b633c26de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:40:46.767590 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-814dacb9-1639-4878-be94-fb355d72e27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:46.768238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-814dacb9-1639-4878-be94-fb355d72e27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:46.769796 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1261/2544] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:40:46 2022] DELETE /identity/v3/projects/fb5fe63db87242059e4e150b633c26de => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:46.775365 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2a89d-2be3-4132-a3d8-41761f89bc33 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:46.775853 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2a89d-2be3-4132-a3d8-41761f89bc33 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:46.775989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2a89d-2be3-4132-a3d8-41761f89bc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:46.795287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1df2a89d-2be3-4132-a3d8-41761f89bc33 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:46.796500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1df2a89d-2be3-4132-a3d8-41761f89bc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:46.855531 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1284/2545] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:46.863198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bde7c-bff3-40e5-a122-b745de11f205 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:46.863480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bde7c-bff3-40e5-a122-b745de11f205 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:46.863800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bde7c-bff3-40e5-a122-b745de11f205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:46.883803 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-400bde7c-bff3-40e5-a122-b745de11f205 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:46.885021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-400bde7c-bff3-40e5-a122-b745de11f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:46.892710 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1262/2546] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:46.896783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2a89d-2be3-4132-a3d8-41761f89bc33 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:46.906328 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2a89d-2be3-4132-a3d8-41761f89bc33 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:46.910945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea459b4-0688-4ff6-b925-c804bd0c6f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:46.911549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea459b4-0688-4ff6-b925-c804bd0c6f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:46.911931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea459b4-0688-4ff6-b925-c804bd0c6f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:46.912145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea459b4-0688-4ff6-b925-c804bd0c6f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:46.912779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea459b4-0688-4ff6-b925-c804bd0c6f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:40:46.913083 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea459b4-0688-4ff6-b925-c804bd0c6f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:46.914673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea459b4-0688-4ff6-b925-c804bd0c6f70 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:46.926233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1285/2547] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:40:46.931219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bde7c-bff3-40e5-a122-b745de11f205 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:46.940495 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bde7c-bff3-40e5-a122-b745de11f205 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:46.945643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420f284-3a2f-41c3-a0a9-f0ddd60faf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:46.946260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420f284-3a2f-41c3-a0a9-f0ddd60faf12 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:46.946533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420f284-3a2f-41c3-a0a9-f0ddd60faf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:46.946798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420f284-3a2f-41c3-a0a9-f0ddd60faf12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:46.947418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420f284-3a2f-41c3-a0a9-f0ddd60faf12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:46.949347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420f284-3a2f-41c3-a0a9-f0ddd60faf12 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:47.145756 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1263/2548] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:40:46 2022] POST /identity/v3/projects => generated 391 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:47.149941 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea459b4-0688-4ff6-b925-c804bd0c6f70 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:47.159775 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea459b4-0688-4ff6-b925-c804bd0c6f70 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:47.185023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:47.214219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d36b4f-61d4-42f3-ae9a-f9143f9ec6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:47.214871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d36b4f-61d4-42f3-ae9a-f9143f9ec6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:47.215148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d36b4f-61d4-42f3-ae9a-f9143f9ec6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:47.215419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d36b4f-61d4-42f3-ae9a-f9143f9ec6d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:47.216069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d36b4f-61d4-42f3-ae9a-f9143f9ec6d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:47.217938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d36b4f-61d4-42f3-ae9a-f9143f9ec6d2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:47.327668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1286/2549] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:40:47 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:47.331789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420f284-3a2f-41c3-a0a9-f0ddd60faf12 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:47.342002 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420f284-3a2f-41c3-a0a9-f0ddd60faf12 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:47.346560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d17a87-772f-4f71-9eba-b1f2875864ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:47.347145 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d17a87-772f-4f71-9eba-b1f2875864ce admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:47.347416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d17a87-772f-4f71-9eba-b1f2875864ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:47.347682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d17a87-772f-4f71-9eba-b1f2875864ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:47.348352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d17a87-772f-4f71-9eba-b1f2875864ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:47.350454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d17a87-772f-4f71-9eba-b1f2875864ce admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:47.360456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1264/2550] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:47.364487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d36b4f-61d4-42f3-ae9a-f9143f9ec6d2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:47.374888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d36b4f-61d4-42f3-ae9a-f9143f9ec6d2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:47.379466 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46ff7f-4c7b-402b-9554-e7371d49a07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:47.380111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46ff7f-4c7b-402b-9554-e7371d49a07c admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:47.380393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46ff7f-4c7b-402b-9554-e7371d49a07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:47.380671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46ff7f-4c7b-402b-9554-e7371d49a07c admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:47.381305 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46ff7f-4c7b-402b-9554-e7371d49a07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:47.382868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46ff7f-4c7b-402b-9554-e7371d49a07c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:47.393202 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1287/2551] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:47.397228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d17a87-772f-4f71-9eba-b1f2875864ce admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:47.407017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d17a87-772f-4f71-9eba-b1f2875864ce admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:47.412095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0c812-7cee-48c9-b955-c925f2a86e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:47.412730 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0c812-7cee-48c9-b955-c925f2a86e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:47.413008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0c812-7cee-48c9-b955-c925f2a86e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:47.413277 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0c812-7cee-48c9-b955-c925f2a86e51 admin admin] PATH_INFO: `/v3/projects/62e392f98c7d44a285ecc97364b5a54c/users/a22143dcecdf45589d1deb25bfb1da05/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:47.427248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0c812-7cee-48c9-b955-c925f2a86e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e392f98c7d44a285ecc97364b5a54c, user_id=a22143dcecdf45589d1deb25bfb1da05, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:47.429881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0c812-7cee-48c9-b955-c925f2a86e51 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:47.515922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1265/2552] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:40:47 2022] PUT /identity/v3/projects/62e392f98c7d44a285ecc97364b5a54c/users/a22143dcecdf45589d1deb25bfb1da05/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:47.526385 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82919f67-964d-47c4-97b0-be71d081b9e0 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:47.526671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82919f67-964d-47c4-97b0-be71d081b9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:47.526979 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82919f67-964d-47c4-97b0-be71d081b9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:47.555095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-82919f67-964d-47c4-97b0-be71d081b9e0 None None] MFA Rules not processed for user `a22143dcecdf45589d1deb25bfb1da05`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:47.556334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-82919f67-964d-47c4-97b0-be71d081b9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:47.618113 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1288/2553] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:47.622560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0c812-7cee-48c9-b955-c925f2a86e51 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:47.683000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0c812-7cee-48c9-b955-c925f2a86e51 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:47.687605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51555e-55a3-4c3d-8990-2b7ed2c0bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:47.688238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51555e-55a3-4c3d-8990-2b7ed2c0bc51 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:47.688518 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51555e-55a3-4c3d-8990-2b7ed2c0bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:47.688779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51555e-55a3-4c3d-8990-2b7ed2c0bc51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:47.689401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51555e-55a3-4c3d-8990-2b7ed2c0bc51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:47.691271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51555e-55a3-4c3d-8990-2b7ed2c0bc51 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:47.814077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:47.821114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1266/2554] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:40:47 2022] POST /identity/v3/projects => generated 391 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:47.825156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82919f67-964d-47c4-97b0-be71d081b9e0 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:47.836185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82919f67-964d-47c4-97b0-be71d081b9e0 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:47.892046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6e7aa-2c3a-41fc-add5-6e70e58739b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:47.892646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6e7aa-2c3a-41fc-add5-6e70e58739b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:47.892924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6e7aa-2c3a-41fc-add5-6e70e58739b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:47.893193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6e7aa-2c3a-41fc-add5-6e70e58739b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:47.893826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6e7aa-2c3a-41fc-add5-6e70e58739b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:47.895714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6e7aa-2c3a-41fc-add5-6e70e58739b0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:47.992522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1289/2555] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:40:47 2022] POST /identity/v3/users => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:47.996527 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51555e-55a3-4c3d-8990-2b7ed2c0bc51 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:48.007225 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51555e-55a3-4c3d-8990-2b7ed2c0bc51 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:48.011817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24813e5-3561-4ca7-9137-432ac4f315b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:48.012467 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24813e5-3561-4ca7-9137-432ac4f315b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:48.012989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24813e5-3561-4ca7-9137-432ac4f315b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:48.013269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24813e5-3561-4ca7-9137-432ac4f315b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:48.014072 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24813e5-3561-4ca7-9137-432ac4f315b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:48.015850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24813e5-3561-4ca7-9137-432ac4f315b1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:48.025707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1267/2556] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:48.029860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6e7aa-2c3a-41fc-add5-6e70e58739b0 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:48.040164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6e7aa-2c3a-41fc-add5-6e70e58739b0 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:48.044730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a80da-bdd7-4959-b7cc-9adec320c764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:48.045363 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a80da-bdd7-4959-b7cc-9adec320c764 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:48.051189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a80da-bdd7-4959-b7cc-9adec320c764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:48.051189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a80da-bdd7-4959-b7cc-9adec320c764 admin admin] PATH_INFO: `/v3/projects/b9c914ce47824d2a9116fdef7cfaed9a/users/ea00c56b11604f25a46fc51c0eea6140/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:48.061180 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a80da-bdd7-4959-b7cc-9adec320c764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c914ce47824d2a9116fdef7cfaed9a, user_id=ea00c56b11604f25a46fc51c0eea6140, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:48.064007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a80da-bdd7-4959-b7cc-9adec320c764 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:48.144631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1290/2557] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:40:48 2022] PUT /identity/v3/projects/b9c914ce47824d2a9116fdef7cfaed9a/users/ea00c56b11604f25a46fc51c0eea6140/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:48.148855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24813e5-3561-4ca7-9137-432ac4f315b1 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:48.158786 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24813e5-3561-4ca7-9137-432ac4f315b1 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:48.213451 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe99729-dd86-495d-9817-3c72f705b835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:48.213981 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe99729-dd86-495d-9817-3c72f705b835 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:48.214253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe99729-dd86-495d-9817-3c72f705b835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:48.214540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe99729-dd86-495d-9817-3c72f705b835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:48.215166 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe99729-dd86-495d-9817-3c72f705b835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:48.216747 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe99729-dd86-495d-9817-3c72f705b835 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:48.226735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1268/2558] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:48.231055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a80da-bdd7-4959-b7cc-9adec320c764 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:48.236830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:48.242852 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a80da-bdd7-4959-b7cc-9adec320c764 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:48.247494 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b41b-f458-4739-884a-adfb6776c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:48.248173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b41b-f458-4739-884a-adfb6776c586 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:48.248451 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b41b-f458-4739-884a-adfb6776c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:48.248727 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b41b-f458-4739-884a-adfb6776c586 admin admin] PATH_INFO: `/v3/projects/b9c914ce47824d2a9116fdef7cfaed9a/users/ea00c56b11604f25a46fc51c0eea6140/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:48.250660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91b41b-f458-4739-884a-adfb6776c586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c914ce47824d2a9116fdef7cfaed9a, user_id=ea00c56b11604f25a46fc51c0eea6140, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:48.253323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91b41b-f458-4739-884a-adfb6776c586 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:48.263265 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1291/2559] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:40:48 2022] PUT /identity/v3/projects/b9c914ce47824d2a9116fdef7cfaed9a/users/ea00c56b11604f25a46fc51c0eea6140/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:40:48.274474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba4349-2a45-4730-97e8-4ce89b1deb6f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:48.274761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba4349-2a45-4730-97e8-4ce89b1deb6f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:48.277858 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba4349-2a45-4730-97e8-4ce89b1deb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:48.304177 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a9ba4349-2a45-4730-97e8-4ce89b1deb6f None None] MFA Rules not processed for user `ea00c56b11604f25a46fc51c0eea6140`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:48.305437 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a9ba4349-2a45-4730-97e8-4ce89b1deb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:48.372690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1269/2560] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:48.384523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b41b-f458-4739-884a-adfb6776c586 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:48.386210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5b91b41b-f458-4739-884a-adfb6776c586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:48.443585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b41b-f458-4739-884a-adfb6776c586 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:48.447278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682f45c-73b4-4c33-8467-80e9043ad4b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:48.447875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f45c-73b4-4c33-8467-80e9043ad4b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:48.448187 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f45c-73b4-4c33-8467-80e9043ad4b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:48.448457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f45c-73b4-4c33-8467-80e9043ad4b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:48.457324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682f45c-73b4-4c33-8467-80e9043ad4b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:48.458796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682f45c-73b4-4c33-8467-80e9043ad4b3 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:48.468232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1292/2561] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:48.514867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba4349-2a45-4730-97e8-4ce89b1deb6f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:48.516291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a9ba4349-2a45-4730-97e8-4ce89b1deb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:48.528046 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba4349-2a45-4730-97e8-4ce89b1deb6f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:48.531624 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eef211-a99a-487f-9a19-6437d85c404c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:48.532255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef211-a99a-487f-9a19-6437d85c404c service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:48.532532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef211-a99a-487f-9a19-6437d85c404c service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:48.532801 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef211-a99a-487f-9a19-6437d85c404c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:48.587941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eef211-a99a-487f-9a19-6437d85c404c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:48.589419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eef211-a99a-487f-9a19-6437d85c404c service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:48.598271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1270/2562] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:54.216407 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682f45c-73b4-4c33-8467-80e9043ad4b3 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:54.319425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682f45c-73b4-4c33-8467-80e9043ad4b3 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:54.324369 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:54.324992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:54.325265 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:54.325559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] PATH_INFO: `/v3/users/a22143dcecdf45589d1deb25bfb1da05` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:54.326756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22143dcecdf45589d1deb25bfb1da05)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:54.328728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:54.518969 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22143dcecdf45589d1deb25bfb1da05'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:54.523918 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:54.526748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22143dcecdf45589d1deb25bfb1da05'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:54.527495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22143dcecdf45589d1deb25bfb1da05'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:54.528148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22143dcecdf45589d1deb25bfb1da05'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:54.625250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22143dcecdf45589d1deb25bfb1da05'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:54.642537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1293/2563] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:40:54 2022] DELETE /identity/v3/users/a22143dcecdf45589d1deb25bfb1da05 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:54.647518 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12cbaa-bdef-4014-ab40-7a669585c8ab None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:54.654920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12cbaa-bdef-4014-ab40-7a669585c8ab None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:54.654920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12cbaa-bdef-4014-ab40-7a669585c8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:54.658456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:54.695454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-2c12cbaa-bdef-4014-ab40-7a669585c8ab None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:54.696676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2c12cbaa-bdef-4014-ab40-7a669585c8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:54.757810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1271/2564] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:54.768815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:54.769838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:54.875513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798830-4199-414d-b8a8-3b6d29bab09e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:54.879515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c71600-0fdf-4b6e-ae90-eabdba454cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:54.880631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c71600-0fdf-4b6e-ae90-eabdba454cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:54.880911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c71600-0fdf-4b6e-ae90-eabdba454cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:54.881167 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c71600-0fdf-4b6e-ae90-eabdba454cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:54.891115 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c71600-0fdf-4b6e-ae90-eabdba454cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:54.893081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c71600-0fdf-4b6e-ae90-eabdba454cb5 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:54.903731 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1294/2565] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:55.454898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12cbaa-bdef-4014-ab40-7a669585c8ab None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:55.456533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2c12cbaa-bdef-4014-ab40-7a669585c8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:55.469310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12cbaa-bdef-4014-ab40-7a669585c8ab None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:55.483157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:55.483157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:55.483157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:55.483157 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] PATH_INFO: `/v3/projects/62e392f98c7d44a285ecc97364b5a54c` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:55.483836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e392f98c7d44a285ecc97364b5a54c)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:55.483836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:55.660458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e392f98c7d44a285ecc97364b5a54c', 'request_id': 'req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:55.667436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e392f98c7d44a285ecc97364b5a54c', 'request_id': 'req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:55.673577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e392f98c7d44a285ecc97364b5a54c', 'request_id': 'req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:55.773033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] The token cache is being invalidate because project 62e392f98c7d44a285ecc97364b5a54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:40:55.773479 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:55.774297 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:55.775845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1272/2566] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:40:55 2022] DELETE /identity/v3/projects/62e392f98c7d44a285ecc97364b5a54c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:55.779888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c71600-0fdf-4b6e-ae90-eabdba454cb5 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:55.790388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c71600-0fdf-4b6e-ae90-eabdba454cb5 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:55.853148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69beda7e-95cb-4bbc-8198-f0f497f9df2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:55.853767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beda7e-95cb-4bbc-8198-f0f497f9df2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:55.854042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beda7e-95cb-4bbc-8198-f0f497f9df2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:55.854310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beda7e-95cb-4bbc-8198-f0f497f9df2b admin admin] PATH_INFO: `/v3/users/ea00c56b11604f25a46fc51c0eea6140` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:55.855431 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beda7e-95cb-4bbc-8198-f0f497f9df2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea00c56b11604f25a46fc51c0eea6140)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:55.857360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beda7e-95cb-4bbc-8198-f0f497f9df2b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:56.159036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:56.165485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-69beda7e-95cb-4bbc-8198-f0f497f9df2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea00c56b11604f25a46fc51c0eea6140'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:56.172247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-69beda7e-95cb-4bbc-8198-f0f497f9df2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea00c56b11604f25a46fc51c0eea6140'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:56.175048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-69beda7e-95cb-4bbc-8198-f0f497f9df2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea00c56b11604f25a46fc51c0eea6140'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:56.175048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-69beda7e-95cb-4bbc-8198-f0f497f9df2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea00c56b11604f25a46fc51c0eea6140'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:56.253916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-69beda7e-95cb-4bbc-8198-f0f497f9df2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea00c56b11604f25a46fc51c0eea6140'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:56.272588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1295/2567] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:40:55 2022] DELETE /identity/v3/users/ea00c56b11604f25a46fc51c0eea6140 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:56.781784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:56.782641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:56.796667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1148d0-8b19-465a-9edc-e39ba2a1e71a admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:56.853671 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fccee0-63f5-482c-bfd0-0d17dedf5308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:56.854303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fccee0-63f5-482c-bfd0-0d17dedf5308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:56.854576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fccee0-63f5-482c-bfd0-0d17dedf5308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:56.854842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fccee0-63f5-482c-bfd0-0d17dedf5308 admin admin] PATH_INFO: `/v3/projects/b9c914ce47824d2a9116fdef7cfaed9a` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:56.855932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fccee0-63f5-482c-bfd0-0d17dedf5308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c914ce47824d2a9116fdef7cfaed9a)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:56.857824 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fccee0-63f5-482c-bfd0-0d17dedf5308 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:56.863836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:57.014411 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-10fccee0-63f5-482c-bfd0-0d17dedf5308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c914ce47824d2a9116fdef7cfaed9a', 'request_id': 'req-10fccee0-63f5-482c-bfd0-0d17dedf5308'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:57.019903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-10fccee0-63f5-482c-bfd0-0d17dedf5308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c914ce47824d2a9116fdef7cfaed9a', 'request_id': 'req-10fccee0-63f5-482c-bfd0-0d17dedf5308'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:57.026815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-10fccee0-63f5-482c-bfd0-0d17dedf5308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c914ce47824d2a9116fdef7cfaed9a', 'request_id': 'req-10fccee0-63f5-482c-bfd0-0d17dedf5308'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:57.138660 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-10fccee0-63f5-482c-bfd0-0d17dedf5308 admin admin] The token cache is being invalidate because project b9c914ce47824d2a9116fdef7cfaed9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:40:57.138952 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-10fccee0-63f5-482c-bfd0-0d17dedf5308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:57.139594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-10fccee0-63f5-482c-bfd0-0d17dedf5308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:40:57.141098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1273/2568] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:40:56 2022] DELETE /identity/v3/projects/b9c914ce47824d2a9116fdef7cfaed9a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:57.146552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1c867-ee29-41ff-88cb-d8e99d89f9d3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:57.147081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1c867-ee29-41ff-88cb-d8e99d89f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:57.147081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1c867-ee29-41ff-88cb-d8e99d89f9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:57.195671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0ec1c867-ee29-41ff-88cb-d8e99d89f9d3 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:57.197024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0ec1c867-ee29-41ff-88cb-d8e99d89f9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:57.257887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1296/2569] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:57.265664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fecea6-782e-4cc3-92e2-af30ddf68b39 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:57.265948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fecea6-782e-4cc3-92e2-af30ddf68b39 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:57.266222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fecea6-782e-4cc3-92e2-af30ddf68b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:57.286560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d3fecea6-782e-4cc3-92e2-af30ddf68b39 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:57.287683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d3fecea6-782e-4cc3-92e2-af30ddf68b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:57.295541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1274/2570] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:57.299851 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1c867-ee29-41ff-88cb-d8e99d89f9d3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:57.310249 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1c867-ee29-41ff-88cb-d8e99d89f9d3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:57.314901 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d0725-f1f5-4af2-8d47-86d69790336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:57.315492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0725-f1f5-4af2-8d47-86d69790336d admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:57.315772 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0725-f1f5-4af2-8d47-86d69790336d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:57.316082 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0725-f1f5-4af2-8d47-86d69790336d admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:57.316716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d0725-f1f5-4af2-8d47-86d69790336d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:40:57.317016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d0725-f1f5-4af2-8d47-86d69790336d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:57.318661 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d0725-f1f5-4af2-8d47-86d69790336d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:57.330556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1297/2571] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:40:57.334849 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fecea6-782e-4cc3-92e2-af30ddf68b39 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:57.343898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fecea6-782e-4cc3-92e2-af30ddf68b39 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:57.349062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e376d-e071-4bff-ab82-e6e67455d771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:57.349654 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e376d-e071-4bff-ab82-e6e67455d771 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:57.349954 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e376d-e071-4bff-ab82-e6e67455d771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:57.350220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e376d-e071-4bff-ab82-e6e67455d771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:57.350847 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e376d-e071-4bff-ab82-e6e67455d771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:57.353000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e376d-e071-4bff-ab82-e6e67455d771 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:57.479417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1275/2572] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:40:57 2022] POST /identity/v3/projects => generated 399 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:57.483797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d0725-f1f5-4af2-8d47-86d69790336d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:57.494576 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d0725-f1f5-4af2-8d47-86d69790336d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:57.555591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf94d-58e7-4a6c-a875-1d741e13b107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:57.556165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf94d-58e7-4a6c-a875-1d741e13b107 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:57.556449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf94d-58e7-4a6c-a875-1d741e13b107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:57.556721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf94d-58e7-4a6c-a875-1d741e13b107 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:57.557395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbf94d-58e7-4a6c-a875-1d741e13b107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:57.559287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbf94d-58e7-4a6c-a875-1d741e13b107 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:57.670862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1298/2573] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:40:57 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:57.675170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e376d-e071-4bff-ab82-e6e67455d771 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:57.686146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e376d-e071-4bff-ab82-e6e67455d771 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:57.691334 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17990f92-a1cb-49b0-9dbb-1c8546917d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:57.694960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17990f92-a1cb-49b0-9dbb-1c8546917d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:57.694960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17990f92-a1cb-49b0-9dbb-1c8546917d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:57.694960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17990f92-a1cb-49b0-9dbb-1c8546917d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:57.694960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17990f92-a1cb-49b0-9dbb-1c8546917d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:57.694960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17990f92-a1cb-49b0-9dbb-1c8546917d90 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:57.705686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1276/2574] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:57.710304 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf94d-58e7-4a6c-a875-1d741e13b107 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:57.720541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf94d-58e7-4a6c-a875-1d741e13b107 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:57.725860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d0c91-29b9-4dc2-9fd4-553a3195794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:57.726449 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0c91-29b9-4dc2-9fd4-553a3195794a admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:57.726729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0c91-29b9-4dc2-9fd4-553a3195794a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:57.727000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0c91-29b9-4dc2-9fd4-553a3195794a admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:57.727892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d0c91-29b9-4dc2-9fd4-553a3195794a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:57.729479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d0c91-29b9-4dc2-9fd4-553a3195794a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:57.731492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:57.740315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1299/2575] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:57.744414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17990f92-a1cb-49b0-9dbb-1c8546917d90 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:57.754543 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17990f92-a1cb-49b0-9dbb-1c8546917d90 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:57.759705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9f513-573f-41bc-8a43-9a356fbcc7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:57.761483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9f513-573f-41bc-8a43-9a356fbcc7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:57.761483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9f513-573f-41bc-8a43-9a356fbcc7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:57.761483 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9f513-573f-41bc-8a43-9a356fbcc7e3 admin admin] PATH_INFO: `/v3/projects/58dfcf9f37fb4a06ada2a972de3a6a63/users/724ab8dd03104f7dbfb9d4e20ef29227/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:57.776051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9f513-573f-41bc-8a43-9a356fbcc7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58dfcf9f37fb4a06ada2a972de3a6a63, user_id=724ab8dd03104f7dbfb9d4e20ef29227, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:57.778728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9f513-573f-41bc-8a43-9a356fbcc7e3 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:57.798585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83f1c8-32e5-46f7-91ba-b207a48a0198 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:57.798871 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83f1c8-32e5-46f7-91ba-b207a48a0198 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:57.799144 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83f1c8-32e5-46f7-91ba-b207a48a0198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:57.818726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fc83f1c8-32e5-46f7-91ba-b207a48a0198 None None] MFA Rules not processed for user `7d0fa8beb6954a5d8662e581345e2a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:57.819879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fc83f1c8-32e5-46f7-91ba-b207a48a0198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:57.860168 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1277/2576] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:40:57 2022] PUT /identity/v3/projects/58dfcf9f37fb4a06ada2a972de3a6a63/users/724ab8dd03104f7dbfb9d4e20ef29227/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:57.870468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb32ffa-769d-43c7-9890-4f07da3148dc None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:57.870749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb32ffa-769d-43c7-9890-4f07da3148dc None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:57.871025 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb32ffa-769d-43c7-9890-4f07da3148dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:57.879342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1300/2577] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:40:57.905629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-edb32ffa-769d-43c7-9890-4f07da3148dc None None] MFA Rules not processed for user `724ab8dd03104f7dbfb9d4e20ef29227`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:57.909779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-edb32ffa-769d-43c7-9890-4f07da3148dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:57.977091 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1278/2578] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:40:57.981974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83f1c8-32e5-46f7-91ba-b207a48a0198 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:57.993390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83f1c8-32e5-46f7-91ba-b207a48a0198 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:58.049886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b16fd-94f1-43f5-bc52-e42a937c5155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:58.050496 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b16fd-94f1-43f5-bc52-e42a937c5155 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:58.050776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b16fd-94f1-43f5-bc52-e42a937c5155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:58.051052 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b16fd-94f1-43f5-bc52-e42a937c5155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:58.051743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b16fd-94f1-43f5-bc52-e42a937c5155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:58.053753 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b16fd-94f1-43f5-bc52-e42a937c5155 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:58.184145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1301/2579] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:40:57 2022] POST /identity/v3/projects => generated 401 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:40:58.185270 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb32ffa-769d-43c7-9890-4f07da3148dc None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:58.185494 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b16fd-94f1-43f5-bc52-e42a937c5155 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:58.186707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-edb32ffa-769d-43c7-9890-4f07da3148dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:58.200859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:58.248854 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb32ffa-769d-43c7-9890-4f07da3148dc None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:58.249153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b16fd-94f1-43f5-bc52-e42a937c5155 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:58.254139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b1e01-3068-4683-9d98-b1bf33e3e24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:58.254779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b1e01-3068-4683-9d98-b1bf33e3e24c admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:58.255558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b1e01-3068-4683-9d98-b1bf33e3e24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:58.255826 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b1e01-3068-4683-9d98-b1bf33e3e24c admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:58.256485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b1e01-3068-4683-9d98-b1bf33e3e24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:58.258403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b1e01-3068-4683-9d98-b1bf33e3e24c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:58.296835 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607d05a-ac62-426e-aee1-a797a8971275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:58.297460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607d05a-ac62-426e-aee1-a797a8971275 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:58.297740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607d05a-ac62-426e-aee1-a797a8971275 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:58.298036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607d05a-ac62-426e-aee1-a797a8971275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:58.299744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a607d05a-ac62-426e-aee1-a797a8971275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:58.309552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607d05a-ac62-426e-aee1-a797a8971275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:58.310989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607d05a-ac62-426e-aee1-a797a8971275 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:58.319651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1279/2580] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:58.362563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1302/2581] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:40:58 2022] POST /identity/v3/users => generated 307 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:40:58.367509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607d05a-ac62-426e-aee1-a797a8971275 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:58.379405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607d05a-ac62-426e-aee1-a797a8971275 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:58.384782 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa1d30-9556-45b0-ac57-bd711ea5370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:58.385385 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa1d30-9556-45b0-ac57-bd711ea5370f admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:58.385662 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa1d30-9556-45b0-ac57-bd711ea5370f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:58.385930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa1d30-9556-45b0-ac57-bd711ea5370f admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:58.386570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa1d30-9556-45b0-ac57-bd711ea5370f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:58.388172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa1d30-9556-45b0-ac57-bd711ea5370f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:58.401475 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1280/2582] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:58.402708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b1e01-3068-4683-9d98-b1bf33e3e24c admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:58.412767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b1e01-3068-4683-9d98-b1bf33e3e24c admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:58.417448 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa84476-8e74-4db3-b4e2-95c93edee387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:58.418083 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa84476-8e74-4db3-b4e2-95c93edee387 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:58.418368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa84476-8e74-4db3-b4e2-95c93edee387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:58.418644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa84476-8e74-4db3-b4e2-95c93edee387 admin admin] PATH_INFO: `/v3/projects/2300039235db43c5bc0fc0c5e5933f36/users/cd4c69260fea405ba46cc1a97f1c1a1e/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:58.436722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa84476-8e74-4db3-b4e2-95c93edee387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2300039235db43c5bc0fc0c5e5933f36, user_id=cd4c69260fea405ba46cc1a97f1c1a1e, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:58.439324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa84476-8e74-4db3-b4e2-95c93edee387 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:58.441676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:58.511608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1303/2583] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:40:58 2022] PUT /identity/v3/projects/2300039235db43c5bc0fc0c5e5933f36/users/cd4c69260fea405ba46cc1a97f1c1a1e/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:58.515998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa1d30-9556-45b0-ac57-bd711ea5370f admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:58.525752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa1d30-9556-45b0-ac57-bd711ea5370f admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:58.583756 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af166b73-3cad-43d1-bff5-a53ae8b0a193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:58.588331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af166b73-3cad-43d1-bff5-a53ae8b0a193 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:58.588331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af166b73-3cad-43d1-bff5-a53ae8b0a193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:58.588331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af166b73-3cad-43d1-bff5-a53ae8b0a193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:58.588331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af166b73-3cad-43d1-bff5-a53ae8b0a193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:58.588331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af166b73-3cad-43d1-bff5-a53ae8b0a193 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:58.596764 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1281/2584] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:40:58.601636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa84476-8e74-4db3-b4e2-95c93edee387 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:58.611963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa84476-8e74-4db3-b4e2-95c93edee387 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:58.617387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d4b48-ed7f-4550-bcf4-f4e4b8c24298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:58.617908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d4b48-ed7f-4550-bcf4-f4e4b8c24298 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:58.618185 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d4b48-ed7f-4550-bcf4-f4e4b8c24298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:58.618457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d4b48-ed7f-4550-bcf4-f4e4b8c24298 admin admin] PATH_INFO: `/v3/projects/2300039235db43c5bc0fc0c5e5933f36/users/cd4c69260fea405ba46cc1a97f1c1a1e/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:58.620552 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d4b48-ed7f-4550-bcf4-f4e4b8c24298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2300039235db43c5bc0fc0c5e5933f36, user_id=cd4c69260fea405ba46cc1a97f1c1a1e, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:58.623153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d4b48-ed7f-4550-bcf4-f4e4b8c24298 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:58.633585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1304/2585] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:40:58 2022] PUT /identity/v3/projects/2300039235db43c5bc0fc0c5e5933f36/users/cd4c69260fea405ba46cc1a97f1c1a1e/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:40:58.644749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895efff3-43d4-4cca-a69c-934929bbf869 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:58.651637 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895efff3-43d4-4cca-a69c-934929bbf869 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:58.651637 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895efff3-43d4-4cca-a69c-934929bbf869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:58.673141 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-895efff3-43d4-4cca-a69c-934929bbf869 None None] MFA Rules not processed for user `cd4c69260fea405ba46cc1a97f1c1a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:40:58.674338 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-895efff3-43d4-4cca-a69c-934929bbf869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:58.718247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:40:58.743716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1282/2586] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:40:58 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:40:58.754547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d4b48-ed7f-4550-bcf4-f4e4b8c24298 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:58.756262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4f5d4b48-ed7f-4550-bcf4-f4e4b8c24298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:40:58.834098 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d4b48-ed7f-4550-bcf4-f4e4b8c24298 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:58.837848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c6abc-e556-4bef-814e-ef2584145e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:58.838450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6abc-e556-4bef-814e-ef2584145e85 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:58.838726 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6abc-e556-4bef-814e-ef2584145e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:58.838994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6abc-e556-4bef-814e-ef2584145e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:58.847882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c6abc-e556-4bef-814e-ef2584145e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:58.849805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c6abc-e556-4bef-814e-ef2584145e85 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:58.859255 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1305/2587] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:58 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:40:59.084522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895efff3-43d4-4cca-a69c-934929bbf869 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:40:59.093995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895efff3-43d4-4cca-a69c-934929bbf869 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:40:59.097536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbfcf3-8076-4f09-9c7f-4af6d3f82615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:40:59.098123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbfcf3-8076-4f09-9c7f-4af6d3f82615 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:40:59.098396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbfcf3-8076-4f09-9c7f-4af6d3f82615 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:40:59.099331 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbfcf3-8076-4f09-9c7f-4af6d3f82615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:40:59.154372 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbfcf3-8076-4f09-9c7f-4af6d3f82615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:40:59.155837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbfcf3-8076-4f09-9c7f-4af6d3f82615 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:40:59.165718 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1283/2588] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:40:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:04.565706 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c6abc-e556-4bef-814e-ef2584145e85 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:04.627233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c6abc-e556-4bef-814e-ef2584145e85 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:04.631843 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:04.632486 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:04.632760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:04.633028 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] PATH_INFO: `/v3/users/724ab8dd03104f7dbfb9d4e20ef29227` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:04.634351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] RBAC: Authorizing `identity:delete_user(user_id=724ab8dd03104f7dbfb9d4e20ef29227)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:04.636147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:04.809999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724ab8dd03104f7dbfb9d4e20ef29227'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:04.816972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724ab8dd03104f7dbfb9d4e20ef29227'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:04.817718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724ab8dd03104f7dbfb9d4e20ef29227'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:04.818313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724ab8dd03104f7dbfb9d4e20ef29227'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:04.892713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724ab8dd03104f7dbfb9d4e20ef29227'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:04.894740 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:04.911778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1306/2589] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:04 2022] DELETE /identity/v3/users/724ab8dd03104f7dbfb9d4e20ef29227 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:04.919258 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc39ee-df78-4633-a165-834cc7fee403 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:04.919700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc39ee-df78-4633-a165-834cc7fee403 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:04.919878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc39ee-df78-4633-a165-834cc7fee403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:04.938965 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-89fc39ee-df78-4633-a165-834cc7fee403 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:04.944705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-89fc39ee-df78-4633-a165-834cc7fee403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:04.997721 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1284/2590] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:05.007585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:05.019119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:05.064942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade7525-9ee5-42f2-950a-4ec403a1877c admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:05.069053 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3928c-1b84-4467-b42f-fb01a4e3a4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:05.069642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3928c-1b84-4467-b42f-fb01a4e3a4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:05.069915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3928c-1b84-4467-b42f-fb01a4e3a4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:05.070181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3928c-1b84-4467-b42f-fb01a4e3a4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:05.079020 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3928c-1b84-4467-b42f-fb01a4e3a4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:05.080459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3928c-1b84-4467-b42f-fb01a4e3a4f0 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:05.090998 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1307/2591] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:05.550606 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc39ee-df78-4633-a165-834cc7fee403 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:05.553893 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-89fc39ee-df78-4633-a165-834cc7fee403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:05.572012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc39ee-df78-4633-a165-834cc7fee403 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:05.576720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:05.577367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:05.577635 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:05.577907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] PATH_INFO: `/v3/projects/58dfcf9f37fb4a06ada2a972de3a6a63` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:05.579034 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58dfcf9f37fb4a06ada2a972de3a6a63)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:05.580975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:05.712962 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58dfcf9f37fb4a06ada2a972de3a6a63', 'request_id': 'req-0cf76a20-c200-45bb-8207-3896df205df7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:05.719088 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58dfcf9f37fb4a06ada2a972de3a6a63', 'request_id': 'req-0cf76a20-c200-45bb-8207-3896df205df7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:05.725855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58dfcf9f37fb4a06ada2a972de3a6a63', 'request_id': 'req-0cf76a20-c200-45bb-8207-3896df205df7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:05.835236 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] The token cache is being invalidate because project 58dfcf9f37fb4a06ada2a972de3a6a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:05.835586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:05.836257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:05.837731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1285/2592] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:05 2022] DELETE /identity/v3/projects/58dfcf9f37fb4a06ada2a972de3a6a63 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:05.841619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3928c-1b84-4467-b42f-fb01a4e3a4f0 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:05.851499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3928c-1b84-4467-b42f-fb01a4e3a4f0 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:05.908988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71888a0-d75f-48bf-a512-c558a617fccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:05.909859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71888a0-d75f-48bf-a512-c558a617fccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:05.910148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71888a0-d75f-48bf-a512-c558a617fccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:05.910424 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71888a0-d75f-48bf-a512-c558a617fccc admin admin] PATH_INFO: `/v3/users/cd4c69260fea405ba46cc1a97f1c1a1e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:05.911713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71888a0-d75f-48bf-a512-c558a617fccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4c69260fea405ba46cc1a97f1c1a1e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:05.913676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71888a0-d75f-48bf-a512-c558a617fccc admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:06.089453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a71888a0-d75f-48bf-a512-c558a617fccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4c69260fea405ba46cc1a97f1c1a1e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:06.096431 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a71888a0-d75f-48bf-a512-c558a617fccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4c69260fea405ba46cc1a97f1c1a1e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:06.097097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a71888a0-d75f-48bf-a512-c558a617fccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4c69260fea405ba46cc1a97f1c1a1e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:06.097696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a71888a0-d75f-48bf-a512-c558a617fccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4c69260fea405ba46cc1a97f1c1a1e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:06.166977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a71888a0-d75f-48bf-a512-c558a617fccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4c69260fea405ba46cc1a97f1c1a1e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:06.184857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1308/2593] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:05 2022] DELETE /identity/v3/users/cd4c69260fea405ba46cc1a97f1c1a1e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:06.626408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:06.630623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:06.638581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:06.648378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76a20-c200-45bb-8207-3896df205df7 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:06.730817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072caff-ffe9-4233-9093-865214615d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:06.730817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072caff-ffe9-4233-9093-865214615d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:06.730817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072caff-ffe9-4233-9093-865214615d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:06.730817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072caff-ffe9-4233-9093-865214615d12 admin admin] PATH_INFO: `/v3/projects/2300039235db43c5bc0fc0c5e5933f36` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:06.731202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072caff-ffe9-4233-9093-865214615d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2300039235db43c5bc0fc0c5e5933f36)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:06.731202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072caff-ffe9-4233-9093-865214615d12 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:06.853992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-a072caff-ffe9-4233-9093-865214615d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2300039235db43c5bc0fc0c5e5933f36', 'request_id': 'req-a072caff-ffe9-4233-9093-865214615d12'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:06.859520 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-a072caff-ffe9-4233-9093-865214615d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2300039235db43c5bc0fc0c5e5933f36', 'request_id': 'req-a072caff-ffe9-4233-9093-865214615d12'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:06.867788 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-a072caff-ffe9-4233-9093-865214615d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2300039235db43c5bc0fc0c5e5933f36', 'request_id': 'req-a072caff-ffe9-4233-9093-865214615d12'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:06.983712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-a072caff-ffe9-4233-9093-865214615d12 admin admin] The token cache is being invalidate because project 2300039235db43c5bc0fc0c5e5933f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:06.984024 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-a072caff-ffe9-4233-9093-865214615d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:06.984644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-a072caff-ffe9-4233-9093-865214615d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:06.986132 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1286/2594] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:06 2022] DELETE /identity/v3/projects/2300039235db43c5bc0fc0c5e5933f36 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:41:06.991518 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741a01a-afb0-4f69-980c-fa0552f4e4da None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:06.991999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741a01a-afb0-4f69-980c-fa0552f4e4da None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:06.992097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741a01a-afb0-4f69-980c-fa0552f4e4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:07.000605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:07.011280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5741a01a-afb0-4f69-980c-fa0552f4e4da None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:07.012509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5741a01a-afb0-4f69-980c-fa0552f4e4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:07.071527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1309/2595] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:07.079342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6be9a-14b6-4197-a5b8-e894c9d4f40f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:07.079619 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6be9a-14b6-4197-a5b8-e894c9d4f40f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:07.079887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6be9a-14b6-4197-a5b8-e894c9d4f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:07.099493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-70b6be9a-14b6-4197-a5b8-e894c9d4f40f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:07.100719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-70b6be9a-14b6-4197-a5b8-e894c9d4f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:07.108646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1287/2596] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:07.112703 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741a01a-afb0-4f69-980c-fa0552f4e4da None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:07.122997 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741a01a-afb0-4f69-980c-fa0552f4e4da None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:07.127674 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0c5a6-4bb6-46a3-a088-187267aa91b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:07.128297 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0c5a6-4bb6-46a3-a088-187267aa91b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:07.128575 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0c5a6-4bb6-46a3-a088-187267aa91b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:07.132042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0c5a6-4bb6-46a3-a088-187267aa91b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:07.132042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0c5a6-4bb6-46a3-a088-187267aa91b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:41:07.132042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0c5a6-4bb6-46a3-a088-187267aa91b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:07.132042 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0c5a6-4bb6-46a3-a088-187267aa91b1 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:07.142808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1310/2597] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:41:07.147670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6be9a-14b6-4197-a5b8-e894c9d4f40f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:07.157300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6be9a-14b6-4197-a5b8-e894c9d4f40f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:07.162494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b3012-c45e-448b-9d37-5c4f5b75c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:07.163086 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b3012-c45e-448b-9d37-5c4f5b75c205 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:07.163363 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b3012-c45e-448b-9d37-5c4f5b75c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:07.163630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b3012-c45e-448b-9d37-5c4f5b75c205 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:07.164291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b3012-c45e-448b-9d37-5c4f5b75c205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:07.166299 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b3012-c45e-448b-9d37-5c4f5b75c205 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:07.255277 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1288/2598] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:07 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:07.259560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0c5a6-4bb6-46a3-a088-187267aa91b1 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:07.270427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0c5a6-4bb6-46a3-a088-187267aa91b1 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:07.328106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635069c1-fb0e-4320-95ac-9405f721e38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:07.328741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635069c1-fb0e-4320-95ac-9405f721e38f admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:07.329016 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635069c1-fb0e-4320-95ac-9405f721e38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:07.329283 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635069c1-fb0e-4320-95ac-9405f721e38f admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:07.329921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635069c1-fb0e-4320-95ac-9405f721e38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:07.331795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635069c1-fb0e-4320-95ac-9405f721e38f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:07.476983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1311/2599] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:07 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:07.481379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b3012-c45e-448b-9d37-5c4f5b75c205 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:07.491383 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b3012-c45e-448b-9d37-5c4f5b75c205 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:07.495780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475a09-8dd2-4a1a-9677-8aeb081b935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:07.496397 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475a09-8dd2-4a1a-9677-8aeb081b935e admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:07.496668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475a09-8dd2-4a1a-9677-8aeb081b935e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:07.496933 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475a09-8dd2-4a1a-9677-8aeb081b935e admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:07.497569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475a09-8dd2-4a1a-9677-8aeb081b935e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:07.499131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475a09-8dd2-4a1a-9677-8aeb081b935e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:07.510197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1289/2600] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:07.514245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635069c1-fb0e-4320-95ac-9405f721e38f admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:07.524900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635069c1-fb0e-4320-95ac-9405f721e38f admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:07.529973 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33577a2-131b-4129-a18a-e5256efbac86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:07.530891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33577a2-131b-4129-a18a-e5256efbac86 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:07.530891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33577a2-131b-4129-a18a-e5256efbac86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:07.531124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33577a2-131b-4129-a18a-e5256efbac86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:07.531713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33577a2-131b-4129-a18a-e5256efbac86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:07.533388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33577a2-131b-4129-a18a-e5256efbac86 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:07.544621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1312/2601] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:07.548490 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475a09-8dd2-4a1a-9677-8aeb081b935e admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:07.558786 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475a09-8dd2-4a1a-9677-8aeb081b935e admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:07.563554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5800741-422d-4a0a-8178-84a71e67bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:07.564241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5800741-422d-4a0a-8178-84a71e67bbad admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:07.564514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5800741-422d-4a0a-8178-84a71e67bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:07.564776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5800741-422d-4a0a-8178-84a71e67bbad admin admin] PATH_INFO: `/v3/projects/263198abba134024b5e9d008c1e2eb40/users/8b56e921832b460b9c6ece874065227a/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:07.580311 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5800741-422d-4a0a-8178-84a71e67bbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=263198abba134024b5e9d008c1e2eb40, user_id=8b56e921832b460b9c6ece874065227a, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:07.583813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5800741-422d-4a0a-8178-84a71e67bbad admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:07.681899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1290/2602] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:07 2022] PUT /identity/v3/projects/263198abba134024b5e9d008c1e2eb40/users/8b56e921832b460b9c6ece874065227a/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:07.687082 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344096ad-f657-47e6-91d8-3ca5f20ca70c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:07.687398 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344096ad-f657-47e6-91d8-3ca5f20ca70c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:07.687677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344096ad-f657-47e6-91d8-3ca5f20ca70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:07.709415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-344096ad-f657-47e6-91d8-3ca5f20ca70c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:07.710626 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-344096ad-f657-47e6-91d8-3ca5f20ca70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:07.893867 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1313/2603] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:07.900488 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5800741-422d-4a0a-8178-84a71e67bbad admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:07.902182 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c5800741-422d-4a0a-8178-84a71e67bbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:07.935421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:07.961272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5800741-422d-4a0a-8178-84a71e67bbad admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:07.964899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905685-1c82-4adc-9221-2b3a4b1d7545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:07.965497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905685-1c82-4adc-9221-2b3a4b1d7545 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:07.965805 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905685-1c82-4adc-9221-2b3a4b1d7545 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:07.966073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905685-1c82-4adc-9221-2b3a4b1d7545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:07.974857 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e905685-1c82-4adc-9221-2b3a4b1d7545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:07.976309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e905685-1c82-4adc-9221-2b3a4b1d7545 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:07.985707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1291/2604] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:09.858131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6606b4d-c3b3-49be-9dc8-c0c473e39f9f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:09.858630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6606b4d-c3b3-49be-9dc8-c0c473e39f9f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:09.858728 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6606b4d-c3b3-49be-9dc8-c0c473e39f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:09.894860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:09.908409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e6606b4d-c3b3-49be-9dc8-c0c473e39f9f None None] MFA Rules not processed for user `8b56e921832b460b9c6ece874065227a`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:09.909816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e6606b4d-c3b3-49be-9dc8-c0c473e39f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:09.995622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1314/2605] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:10.000629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905685-1c82-4adc-9221-2b3a4b1d7545 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:10.010537 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905685-1c82-4adc-9221-2b3a4b1d7545 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:10.019145 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac9dcd-81ee-44e3-a11b-d005bca3b54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:10.019785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac9dcd-81ee-44e3-a11b-d005bca3b54e admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:10.020313 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac9dcd-81ee-44e3-a11b-d005bca3b54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:10.020585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac9dcd-81ee-44e3-a11b-d005bca3b54e admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:10.021391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac9dcd-81ee-44e3-a11b-d005bca3b54e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:10.023448 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac9dcd-81ee-44e3-a11b-d005bca3b54e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:10.197964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1292/2606] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:09 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:10.202011 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6606b4d-c3b3-49be-9dc8-c0c473e39f9f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:10.218066 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6606b4d-c3b3-49be-9dc8-c0c473e39f9f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:10.291302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7e8e4-60de-4c92-9e0a-b325ef95eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:10.291925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7e8e4-60de-4c92-9e0a-b325ef95eb52 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:10.292254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7e8e4-60de-4c92-9e0a-b325ef95eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:10.292525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7e8e4-60de-4c92-9e0a-b325ef95eb52 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:10.293178 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7e8e4-60de-4c92-9e0a-b325ef95eb52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:10.296160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7e8e4-60de-4c92-9e0a-b325ef95eb52 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:10.451611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1315/2607] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:10 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:41:10.452871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac9dcd-81ee-44e3-a11b-d005bca3b54e admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:10.465414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac9dcd-81ee-44e3-a11b-d005bca3b54e admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:10.471216 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f63018-d04b-485a-bd60-3691e06f2c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:10.471838 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f63018-d04b-485a-bd60-3691e06f2c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:10.472167 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f63018-d04b-485a-bd60-3691e06f2c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:10.472437 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f63018-d04b-485a-bd60-3691e06f2c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:10.473915 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f63018-d04b-485a-bd60-3691e06f2c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:10.475638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f63018-d04b-485a-bd60-3691e06f2c5c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:10.486913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1293/2608] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:10.491155 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7e8e4-60de-4c92-9e0a-b325ef95eb52 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:10.501303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7e8e4-60de-4c92-9e0a-b325ef95eb52 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:10.506494 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23398098-ab99-4507-8921-98dc74175bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:10.507155 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23398098-ab99-4507-8921-98dc74175bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:10.507606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23398098-ab99-4507-8921-98dc74175bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:10.507883 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23398098-ab99-4507-8921-98dc74175bbb admin admin] PATH_INFO: `/v3/projects/7486c9a81df841e89a53f5704e995562/users/3ce9ebe99e7c45488915ceb1f462eb36/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:10.525116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23398098-ab99-4507-8921-98dc74175bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7486c9a81df841e89a53f5704e995562, user_id=3ce9ebe99e7c45488915ceb1f462eb36, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:10.529430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23398098-ab99-4507-8921-98dc74175bbb admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:10.643761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1316/2609] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:10 2022] PUT /identity/v3/projects/7486c9a81df841e89a53f5704e995562/users/3ce9ebe99e7c45488915ceb1f462eb36/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:10.648141 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f63018-d04b-485a-bd60-3691e06f2c5c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:10.658897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f63018-d04b-485a-bd60-3691e06f2c5c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:10.719749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4867c-a551-4932-9e04-79031765f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:10.720456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4867c-a551-4932-9e04-79031765f473 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:10.720734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4867c-a551-4932-9e04-79031765f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:10.721001 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4867c-a551-4932-9e04-79031765f473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:10.721727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4867c-a551-4932-9e04-79031765f473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:10.723381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4867c-a551-4932-9e04-79031765f473 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:10.736342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1294/2610] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:10.742235 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23398098-ab99-4507-8921-98dc74175bbb admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:10.753665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23398098-ab99-4507-8921-98dc74175bbb admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:10.759332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbabb67-cc2a-4115-bef6-cfa9ad363d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:10.760018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbabb67-cc2a-4115-bef6-cfa9ad363d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:10.760300 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbabb67-cc2a-4115-bef6-cfa9ad363d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:10.760571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbabb67-cc2a-4115-bef6-cfa9ad363d63 admin admin] PATH_INFO: `/v3/projects/7486c9a81df841e89a53f5704e995562/users/3ce9ebe99e7c45488915ceb1f462eb36/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:10.762636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbabb67-cc2a-4115-bef6-cfa9ad363d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7486c9a81df841e89a53f5704e995562, user_id=3ce9ebe99e7c45488915ceb1f462eb36, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:10.765244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbabb67-cc2a-4115-bef6-cfa9ad363d63 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:10.777907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1317/2611] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:10 2022] PUT /identity/v3/projects/7486c9a81df841e89a53f5704e995562/users/3ce9ebe99e7c45488915ceb1f462eb36/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:12.551045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea325c-00cf-486e-a9ba-0a57fdf524eb None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:12.551585 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea325c-00cf-486e-a9ba-0a57fdf524eb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:12.551681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea325c-00cf-486e-a9ba-0a57fdf524eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:12.582582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4bea325c-00cf-486e-a9ba-0a57fdf524eb None None] MFA Rules not processed for user `3ce9ebe99e7c45488915ceb1f462eb36`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:12.584344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4bea325c-00cf-486e-a9ba-0a57fdf524eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:12.656973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1295/2612] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:12.668649 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310b305-55f6-4ad1-b0e9-4909ccc7d54e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:12.669250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310b305-55f6-4ad1-b0e9-4909ccc7d54e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:12.669250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310b305-55f6-4ad1-b0e9-4909ccc7d54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:12.689338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5310b305-55f6-4ad1-b0e9-4909ccc7d54e None None] MFA Rules not processed for user `8b56e921832b460b9c6ece874065227a`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:12.690624 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5310b305-55f6-4ad1-b0e9-4909ccc7d54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:12.741974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:12.750192 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1318/2613] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:12.762419 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea325c-00cf-486e-a9ba-0a57fdf524eb None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:12.764249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4bea325c-00cf-486e-a9ba-0a57fdf524eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:12.787436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:12.859693 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea325c-00cf-486e-a9ba-0a57fdf524eb None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:12.866138 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca897ff7-d99f-4c27-97bd-c20416c62a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:12.866297 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca897ff7-d99f-4c27-97bd-c20416c62a04 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:12.866493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca897ff7-d99f-4c27-97bd-c20416c62a04 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:12.866711 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca897ff7-d99f-4c27-97bd-c20416c62a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:12.876355 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca897ff7-d99f-4c27-97bd-c20416c62a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:12.878247 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca897ff7-d99f-4c27-97bd-c20416c62a04 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:12.889777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1296/2614] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:16.162972 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310b305-55f6-4ad1-b0e9-4909ccc7d54e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:16.223290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310b305-55f6-4ad1-b0e9-4909ccc7d54e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:16.226823 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f9727-9fb6-4561-992f-bf4e4c9a17f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:16.227673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f9727-9fb6-4561-992f-bf4e4c9a17f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:16.227961 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f9727-9fb6-4561-992f-bf4e4c9a17f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:16.228237 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f9727-9fb6-4561-992f-bf4e4c9a17f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:16.229935 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-144f9727-9fb6-4561-992f-bf4e4c9a17f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:16.294711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f9727-9fb6-4561-992f-bf4e4c9a17f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:16.296163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f9727-9fb6-4561-992f-bf4e4c9a17f3 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:16.306343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1319/2615] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:21.380307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca897ff7-d99f-4c27-97bd-c20416c62a04 service nova] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:21.382708 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ca897ff7-d99f-4c27-97bd-c20416c62a04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:21.403118 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca897ff7-d99f-4c27-97bd-c20416c62a04 service nova] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:21.407684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1b85e-5e8a-4d77-8156-55a44efcac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:21.414774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1b85e-5e8a-4d77-8156-55a44efcac8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:21.414774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1b85e-5e8a-4d77-8156-55a44efcac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:21.414774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1b85e-5e8a-4d77-8156-55a44efcac8e admin admin] PATH_INFO: `/v3/users/58a89d6843d34c37814ec5508a7f1da4` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:21.414774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1b85e-5e8a-4d77-8156-55a44efcac8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a89d6843d34c37814ec5508a7f1da4)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:21.414774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1b85e-5e8a-4d77-8156-55a44efcac8e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:21.568983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b8c1b85e-5e8a-4d77-8156-55a44efcac8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a89d6843d34c37814ec5508a7f1da4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:21.575862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b8c1b85e-5e8a-4d77-8156-55a44efcac8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a89d6843d34c37814ec5508a7f1da4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:21.576545 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b8c1b85e-5e8a-4d77-8156-55a44efcac8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a89d6843d34c37814ec5508a7f1da4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:21.709847 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b8c1b85e-5e8a-4d77-8156-55a44efcac8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a89d6843d34c37814ec5508a7f1da4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:21.722264 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b8c1b85e-5e8a-4d77-8156-55a44efcac8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a89d6843d34c37814ec5508a7f1da4'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:21.729396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1297/2616] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:21 2022] DELETE /identity/v3/users/58a89d6843d34c37814ec5508a7f1da4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:22.016971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f9727-9fb6-4561-992f-bf4e4c9a17f3 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:22.027685 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f9727-9fb6-4561-992f-bf4e4c9a17f3 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:22.090703 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e014651-e7de-4026-b811-aaf27b28b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:22.091335 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e014651-e7de-4026-b811-aaf27b28b110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:22.091646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e014651-e7de-4026-b811-aaf27b28b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:22.091921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e014651-e7de-4026-b811-aaf27b28b110 admin admin] PATH_INFO: `/v3/projects/4d362ff0a81d4a84950e1f9b3e856ac1` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:22.093088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e014651-e7de-4026-b811-aaf27b28b110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d362ff0a81d4a84950e1f9b3e856ac1)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:22.094960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e014651-e7de-4026-b811-aaf27b28b110 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:22.212634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8e014651-e7de-4026-b811-aaf27b28b110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d362ff0a81d4a84950e1f9b3e856ac1', 'request_id': 'req-8e014651-e7de-4026-b811-aaf27b28b110'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:22.213803 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:22.218792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8e014651-e7de-4026-b811-aaf27b28b110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d362ff0a81d4a84950e1f9b3e856ac1', 'request_id': 'req-8e014651-e7de-4026-b811-aaf27b28b110'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:22.275064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8e014651-e7de-4026-b811-aaf27b28b110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d362ff0a81d4a84950e1f9b3e856ac1', 'request_id': 'req-8e014651-e7de-4026-b811-aaf27b28b110'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:22.286324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8e014651-e7de-4026-b811-aaf27b28b110 admin admin] The token cache is being invalidate because project 4d362ff0a81d4a84950e1f9b3e856ac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:22.286606 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8e014651-e7de-4026-b811-aaf27b28b110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:22.287228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8e014651-e7de-4026-b811-aaf27b28b110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:22.288733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1320/2617] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:22 2022] DELETE /identity/v3/projects/4d362ff0a81d4a84950e1f9b3e856ac1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:22.293752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386da67-05d9-46ec-8b7b-4b597dee1502 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:22.294129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386da67-05d9-46ec-8b7b-4b597dee1502 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:22.294409 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386da67-05d9-46ec-8b7b-4b597dee1502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:22.314016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1386da67-05d9-46ec-8b7b-4b597dee1502 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:22.315938 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1386da67-05d9-46ec-8b7b-4b597dee1502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:22.373723 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1298/2618] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:22.382737 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76d827-fd7a-48e3-92c0-aa6d890af6b1 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:22.383019 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76d827-fd7a-48e3-92c0-aa6d890af6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:22.383274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76d827-fd7a-48e3-92c0-aa6d890af6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:22.402897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-db76d827-fd7a-48e3-92c0-aa6d890af6b1 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:22.404157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-db76d827-fd7a-48e3-92c0-aa6d890af6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:22.412623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1321/2619] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:22.416645 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386da67-05d9-46ec-8b7b-4b597dee1502 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:22.426255 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386da67-05d9-46ec-8b7b-4b597dee1502 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:22.431269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bd66d-7568-48ee-af22-784a6172f18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:22.431857 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd66d-7568-48ee-af22-784a6172f18d admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:22.432158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd66d-7568-48ee-af22-784a6172f18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:22.432423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd66d-7568-48ee-af22-784a6172f18d admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:22.433053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bd66d-7568-48ee-af22-784a6172f18d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:41:22.433349 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bd66d-7568-48ee-af22-784a6172f18d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:22.434912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bd66d-7568-48ee-af22-784a6172f18d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:22.447284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1299/2620] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:41:22.451597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76d827-fd7a-48e3-92c0-aa6d890af6b1 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:22.461036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76d827-fd7a-48e3-92c0-aa6d890af6b1 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:22.465994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb37008-ac90-4fb6-bd4b-ecf706ce9db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:22.466596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37008-ac90-4fb6-bd4b-ecf706ce9db8 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:22.467212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37008-ac90-4fb6-bd4b-ecf706ce9db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:22.467771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37008-ac90-4fb6-bd4b-ecf706ce9db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:22.468716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb37008-ac90-4fb6-bd4b-ecf706ce9db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:22.470705 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb37008-ac90-4fb6-bd4b-ecf706ce9db8 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:22.597097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1322/2621] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:22 2022] POST /identity/v3/projects => generated 403 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:22.601755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bd66d-7568-48ee-af22-784a6172f18d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:22.608323 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:22.612042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bd66d-7568-48ee-af22-784a6172f18d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:22.666894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d80e05-e29f-4ec6-a44a-43b6e826f0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:22.667494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d80e05-e29f-4ec6-a44a-43b6e826f0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:22.667773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d80e05-e29f-4ec6-a44a-43b6e826f0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:22.668083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d80e05-e29f-4ec6-a44a-43b6e826f0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:22.668699 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d80e05-e29f-4ec6-a44a-43b6e826f0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:22.670586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d80e05-e29f-4ec6-a44a-43b6e826f0f9 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:22.778538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1300/2622] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:22 2022] POST /identity/v3/users => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:22.782995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb37008-ac90-4fb6-bd4b-ecf706ce9db8 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:22.793911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb37008-ac90-4fb6-bd4b-ecf706ce9db8 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:22.798410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261681f-2232-4369-999f-9d85f1aeb2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:22.798990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261681f-2232-4369-999f-9d85f1aeb2cd admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:22.799263 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261681f-2232-4369-999f-9d85f1aeb2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:22.799616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261681f-2232-4369-999f-9d85f1aeb2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:22.800286 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261681f-2232-4369-999f-9d85f1aeb2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:22.801837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261681f-2232-4369-999f-9d85f1aeb2cd admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:22.812201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1323/2623] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:22.816074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d80e05-e29f-4ec6-a44a-43b6e826f0f9 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:22.826662 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d80e05-e29f-4ec6-a44a-43b6e826f0f9 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:22.831322 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89089d-5d3d-4f7d-afd6-a822a67d0f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:22.831914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89089d-5d3d-4f7d-afd6-a822a67d0f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:22.832221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89089d-5d3d-4f7d-afd6-a822a67d0f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:22.832489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89089d-5d3d-4f7d-afd6-a822a67d0f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:22.833158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89089d-5d3d-4f7d-afd6-a822a67d0f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:22.835452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89089d-5d3d-4f7d-afd6-a822a67d0f88 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:22.846412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1301/2624] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:22.851075 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261681f-2232-4369-999f-9d85f1aeb2cd admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:22.861181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261681f-2232-4369-999f-9d85f1aeb2cd admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:22.865697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78275006-5c08-41c0-9124-8737a50edcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:22.866321 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78275006-5c08-41c0-9124-8737a50edcaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:22.866596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78275006-5c08-41c0-9124-8737a50edcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:22.866862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78275006-5c08-41c0-9124-8737a50edcaa admin admin] PATH_INFO: `/v3/projects/a5e395cff1c04161944b9b42578b30fb/users/0756dc7fe1864ee9b1fceea90c1ebbfa/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:22.881022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78275006-5c08-41c0-9124-8737a50edcaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e395cff1c04161944b9b42578b30fb, user_id=0756dc7fe1864ee9b1fceea90c1ebbfa, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:22.883636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78275006-5c08-41c0-9124-8737a50edcaa admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:23.058930 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1324/2625] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:22 2022] PUT /identity/v3/projects/a5e395cff1c04161944b9b42578b30fb/users/0756dc7fe1864ee9b1fceea90c1ebbfa/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:23.063956 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b1930-6ebf-4815-b2b8-90a49c41c063 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:23.064253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b1930-6ebf-4815-b2b8-90a49c41c063 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:23.064524 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b1930-6ebf-4815-b2b8-90a49c41c063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:23.082789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-713b1930-6ebf-4815-b2b8-90a49c41c063 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:23.084536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-713b1930-6ebf-4815-b2b8-90a49c41c063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:23.141261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1302/2626] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:23.151421 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78275006-5c08-41c0-9124-8737a50edcaa admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:23.153162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-78275006-5c08-41c0-9124-8737a50edcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:23.212276 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78275006-5c08-41c0-9124-8737a50edcaa admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:23.215891 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461bf2f-6ff4-4781-867b-e8373617a449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:23.216519 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461bf2f-6ff4-4781-867b-e8373617a449 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:23.216821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461bf2f-6ff4-4781-867b-e8373617a449 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:23.217093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461bf2f-6ff4-4781-867b-e8373617a449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:23.226224 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461bf2f-6ff4-4781-867b-e8373617a449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:23.227892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461bf2f-6ff4-4781-867b-e8373617a449 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:23.237159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1325/2627] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:24.579286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98b702-d287-40d8-b268-d091eecc78b0 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:24.585501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98b702-d287-40d8-b268-d091eecc78b0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:24.585501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98b702-d287-40d8-b268-d091eecc78b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:24.608341 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-7a98b702-d287-40d8-b268-d091eecc78b0 None None] MFA Rules not processed for user `0756dc7fe1864ee9b1fceea90c1ebbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:24.609455 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7a98b702-d287-40d8-b268-d091eecc78b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:24.672681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1303/2628] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:24 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:24.677225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461bf2f-6ff4-4781-867b-e8373617a449 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:24.687592 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461bf2f-6ff4-4781-867b-e8373617a449 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:24.692199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb4ed8-650d-4941-acd3-7d9c913960c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:24.692787 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb4ed8-650d-4941-acd3-7d9c913960c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:24.693085 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb4ed8-650d-4941-acd3-7d9c913960c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:24.694005 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb4ed8-650d-4941-acd3-7d9c913960c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:24.694639 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb4ed8-650d-4941-acd3-7d9c913960c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:24.696541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb4ed8-650d-4941-acd3-7d9c913960c3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:24.808822 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1326/2629] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:24 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:24.812934 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98b702-d287-40d8-b268-d091eecc78b0 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:24.823582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98b702-d287-40d8-b268-d091eecc78b0 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:24.832353 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:24.878894 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6ef7c-c993-4f24-9c63-3e7e8594042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:24.879507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6ef7c-c993-4f24-9c63-3e7e8594042e admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:24.879786 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6ef7c-c993-4f24-9c63-3e7e8594042e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:24.880100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6ef7c-c993-4f24-9c63-3e7e8594042e admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:24.880748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6ef7c-c993-4f24-9c63-3e7e8594042e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:24.882684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6ef7c-c993-4f24-9c63-3e7e8594042e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:24.984307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1304/2630] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:24 2022] POST /identity/v3/users => generated 308 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:24.988367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb4ed8-650d-4941-acd3-7d9c913960c3 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:24.999111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb4ed8-650d-4941-acd3-7d9c913960c3 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:25.003988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c2391-d486-45ec-b094-40037869f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:25.007065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c2391-d486-45ec-b094-40037869f8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:25.007065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c2391-d486-45ec-b094-40037869f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:25.007065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c2391-d486-45ec-b094-40037869f8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:25.007065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c2391-d486-45ec-b094-40037869f8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:25.007478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c2391-d486-45ec-b094-40037869f8c0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:25.017671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1327/2631] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:25.021697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6ef7c-c993-4f24-9c63-3e7e8594042e admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:25.031400 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6ef7c-c993-4f24-9c63-3e7e8594042e admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:25.035975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71e75b-4247-4325-9029-6c20f5abc6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:25.036630 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71e75b-4247-4325-9029-6c20f5abc6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:25.036905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71e75b-4247-4325-9029-6c20f5abc6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:25.037678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71e75b-4247-4325-9029-6c20f5abc6ea admin admin] PATH_INFO: `/v3/projects/0d6f4866bc1745f586a77c7ad1e22607/users/eb3bd0efbbd34510a3748e1c1d4e7391/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:25.051928 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71e75b-4247-4325-9029-6c20f5abc6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6f4866bc1745f586a77c7ad1e22607, user_id=eb3bd0efbbd34510a3748e1c1d4e7391, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:25.055212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71e75b-4247-4325-9029-6c20f5abc6ea admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:25.126725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1305/2632] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:25 2022] PUT /identity/v3/projects/0d6f4866bc1745f586a77c7ad1e22607/users/eb3bd0efbbd34510a3748e1c1d4e7391/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:41:25.130844 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c2391-d486-45ec-b094-40037869f8c0 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:25.140545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c2391-d486-45ec-b094-40037869f8c0 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:25.181646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:25.196183 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46ae8d-2fda-48ff-9d58-53377d40b96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:25.196781 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46ae8d-2fda-48ff-9d58-53377d40b96c admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:25.197055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46ae8d-2fda-48ff-9d58-53377d40b96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:25.197320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46ae8d-2fda-48ff-9d58-53377d40b96c admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:25.197952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46ae8d-2fda-48ff-9d58-53377d40b96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:25.199523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46ae8d-2fda-48ff-9d58-53377d40b96c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:25.209648 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1328/2633] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:25.213742 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71e75b-4247-4325-9029-6c20f5abc6ea admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:25.224131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71e75b-4247-4325-9029-6c20f5abc6ea admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:25.229735 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd9a14-13b3-4a1d-8f79-f1dfa159794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:25.230380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd9a14-13b3-4a1d-8f79-f1dfa159794c admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:25.230658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd9a14-13b3-4a1d-8f79-f1dfa159794c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:25.230928 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd9a14-13b3-4a1d-8f79-f1dfa159794c admin admin] PATH_INFO: `/v3/projects/0d6f4866bc1745f586a77c7ad1e22607/users/eb3bd0efbbd34510a3748e1c1d4e7391/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:25.232892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd9a14-13b3-4a1d-8f79-f1dfa159794c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6f4866bc1745f586a77c7ad1e22607, user_id=eb3bd0efbbd34510a3748e1c1d4e7391, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:25.235491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd9a14-13b3-4a1d-8f79-f1dfa159794c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:25.245600 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1306/2634] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:25 2022] PUT /identity/v3/projects/0d6f4866bc1745f586a77c7ad1e22607/users/eb3bd0efbbd34510a3748e1c1d4e7391/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:26.702409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4dbf3-320d-4d16-b2d7-0ef43559b2fc None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:26.702924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4dbf3-320d-4d16-b2d7-0ef43559b2fc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:26.703227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4dbf3-320d-4d16-b2d7-0ef43559b2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:26.735639 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-40a4dbf3-320d-4d16-b2d7-0ef43559b2fc None None] MFA Rules not processed for user `eb3bd0efbbd34510a3748e1c1d4e7391`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:26.738194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-40a4dbf3-320d-4d16-b2d7-0ef43559b2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:26.819032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1329/2635] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:26 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:28.068780 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd9a14-13b3-4a1d-8f79-f1dfa159794c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:28.080241 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7bcd9a14-13b3-4a1d-8f79-f1dfa159794c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:28.158005 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd9a14-13b3-4a1d-8f79-f1dfa159794c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:28.159714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f5420-997f-4a54-b2fc-cd9c9ef23004 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:28.160367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f5420-997f-4a54-b2fc-cd9c9ef23004 service placement] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:28.160647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f5420-997f-4a54-b2fc-cd9c9ef23004 service placement] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:28.160918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f5420-997f-4a54-b2fc-cd9c9ef23004 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:28.163276 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-046f5420-997f-4a54-b2fc-cd9c9ef23004 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:28.176450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f5420-997f-4a54-b2fc-cd9c9ef23004 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:28.183324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f5420-997f-4a54-b2fc-cd9c9ef23004 service placement] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:28.195171 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1307/2636] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:28.205395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4dbf3-320d-4d16-b2d7-0ef43559b2fc None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:28.272147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4dbf3-320d-4d16-b2d7-0ef43559b2fc None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:28.276565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:28.277201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:28.277493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:28.277761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] PATH_INFO: `/v3/users/0756dc7fe1864ee9b1fceea90c1ebbfa` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:28.278846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0756dc7fe1864ee9b1fceea90c1ebbfa)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:28.280756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:28.472779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0756dc7fe1864ee9b1fceea90c1ebbfa'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:28.480474 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0756dc7fe1864ee9b1fceea90c1ebbfa'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:28.481142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0756dc7fe1864ee9b1fceea90c1ebbfa'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:28.481815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0756dc7fe1864ee9b1fceea90c1ebbfa'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:28.544065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0756dc7fe1864ee9b1fceea90c1ebbfa'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:28.548888 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:28.562294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1330/2637] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:28 2022] DELETE /identity/v3/users/0756dc7fe1864ee9b1fceea90c1ebbfa => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:28.814697 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f5420-997f-4a54-b2fc-cd9c9ef23004 service placement] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:28.826889 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f5420-997f-4a54-b2fc-cd9c9ef23004 service placement] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:28.883224 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:28.890123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:28.890847 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:28.891126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:28.891396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] PATH_INFO: `/v3/projects/a5e395cff1c04161944b9b42578b30fb` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:28.892570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e395cff1c04161944b9b42578b30fb)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:28.894456 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:29.018892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e395cff1c04161944b9b42578b30fb', 'request_id': 'req-81612614-792b-4fcf-a074-ce09183f26fd'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:29.024472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e395cff1c04161944b9b42578b30fb', 'request_id': 'req-81612614-792b-4fcf-a074-ce09183f26fd'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:29.030891 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e395cff1c04161944b9b42578b30fb', 'request_id': 'req-81612614-792b-4fcf-a074-ce09183f26fd'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:29.137702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] The token cache is being invalidate because project a5e395cff1c04161944b9b42578b30fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:29.138332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:29.138911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:29.140373 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1308/2638] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:28 2022] DELETE /identity/v3/projects/a5e395cff1c04161944b9b42578b30fb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:41:29.144358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:29.145920 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:29.158859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea66181-671b-4520-b2ed-502b3970ad8b admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:29.214925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4d867-85de-4baa-8300-19f2911904c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:29.215556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4d867-85de-4baa-8300-19f2911904c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:29.215751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4d867-85de-4baa-8300-19f2911904c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:29.216056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4d867-85de-4baa-8300-19f2911904c6 admin admin] PATH_INFO: `/v3/users/eb3bd0efbbd34510a3748e1c1d4e7391` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:29.217195 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4d867-85de-4baa-8300-19f2911904c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3bd0efbbd34510a3748e1c1d4e7391)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:29.219175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4d867-85de-4baa-8300-19f2911904c6 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:29.390805 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bcc4d867-85de-4baa-8300-19f2911904c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3bd0efbbd34510a3748e1c1d4e7391'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:29.397733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bcc4d867-85de-4baa-8300-19f2911904c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3bd0efbbd34510a3748e1c1d4e7391'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:29.399641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bcc4d867-85de-4baa-8300-19f2911904c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3bd0efbbd34510a3748e1c1d4e7391'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:29.399641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bcc4d867-85de-4baa-8300-19f2911904c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3bd0efbbd34510a3748e1c1d4e7391'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:29.463758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-bcc4d867-85de-4baa-8300-19f2911904c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3bd0efbbd34510a3748e1c1d4e7391'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:29.482123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1331/2639] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:29 2022] DELETE /identity/v3/users/eb3bd0efbbd34510a3748e1c1d4e7391 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:29.717129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:29.726454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:29.733321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81612614-792b-4fcf-a074-ce09183f26fd admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:29.791229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256573f3-e879-48ea-af76-21ce334421ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:29.791955 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256573f3-e879-48ea-af76-21ce334421ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:29.792245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256573f3-e879-48ea-af76-21ce334421ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:29.792510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256573f3-e879-48ea-af76-21ce334421ba admin admin] PATH_INFO: `/v3/projects/0d6f4866bc1745f586a77c7ad1e22607` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:29.793612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256573f3-e879-48ea-af76-21ce334421ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6f4866bc1745f586a77c7ad1e22607)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:29.795472 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256573f3-e879-48ea-af76-21ce334421ba admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:29.910799 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-256573f3-e879-48ea-af76-21ce334421ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6f4866bc1745f586a77c7ad1e22607', 'request_id': 'req-256573f3-e879-48ea-af76-21ce334421ba'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:29.919653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-256573f3-e879-48ea-af76-21ce334421ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6f4866bc1745f586a77c7ad1e22607', 'request_id': 'req-256573f3-e879-48ea-af76-21ce334421ba'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:29.926228 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-256573f3-e879-48ea-af76-21ce334421ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6f4866bc1745f586a77c7ad1e22607', 'request_id': 'req-256573f3-e879-48ea-af76-21ce334421ba'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:30.007347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-256573f3-e879-48ea-af76-21ce334421ba admin admin] The token cache is being invalidate because project 0d6f4866bc1745f586a77c7ad1e22607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:30.007565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-256573f3-e879-48ea-af76-21ce334421ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:30.008239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-256573f3-e879-48ea-af76-21ce334421ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:30.009749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1309/2640] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:29 2022] DELETE /identity/v3/projects/0d6f4866bc1745f586a77c7ad1e22607 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:30.014796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbf919-cea4-4f10-97cc-de3ea1736924 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:30.015084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbf919-cea4-4f10-97cc-de3ea1736924 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:30.015361 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbf919-cea4-4f10-97cc-de3ea1736924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:30.035118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c0cbf919-cea4-4f10-97cc-de3ea1736924 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:30.036362 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c0cbf919-cea4-4f10-97cc-de3ea1736924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:30.095038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1332/2641] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:30.107990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0f6c2-de69-4b0a-acc5-539328180643 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:30.108426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0f6c2-de69-4b0a-acc5-539328180643 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:30.108764 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0f6c2-de69-4b0a-acc5-539328180643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:30.128923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-cec0f6c2-de69-4b0a-acc5-539328180643 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:30.132836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cec0f6c2-de69-4b0a-acc5-539328180643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:30.139007 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1310/2642] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:30.143334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbf919-cea4-4f10-97cc-de3ea1736924 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:30.149952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:30.153874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbf919-cea4-4f10-97cc-de3ea1736924 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:30.158558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34bb4-64e5-4e06-8659-d826c404e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:30.159149 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34bb4-64e5-4e06-8659-d826c404e24d admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:30.159427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34bb4-64e5-4e06-8659-d826c404e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:30.159776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34bb4-64e5-4e06-8659-d826c404e24d admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:30.160459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa34bb4-64e5-4e06-8659-d826c404e24d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:41:30.160769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa34bb4-64e5-4e06-8659-d826c404e24d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:30.162392 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa34bb4-64e5-4e06-8659-d826c404e24d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:30.173610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1333/2643] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:41:30.178017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0f6c2-de69-4b0a-acc5-539328180643 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:30.187305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0f6c2-de69-4b0a-acc5-539328180643 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:30.192075 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9aebfc-bc83-445b-a5ed-8f6e81d64d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:30.192668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9aebfc-bc83-445b-a5ed-8f6e81d64d3d admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:30.193469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9aebfc-bc83-445b-a5ed-8f6e81d64d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:30.193754 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9aebfc-bc83-445b-a5ed-8f6e81d64d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:30.194383 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9aebfc-bc83-445b-a5ed-8f6e81d64d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:30.196290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9aebfc-bc83-445b-a5ed-8f6e81d64d3d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:30.201673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:30.309269 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1311/2644] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:30 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:41:30.310379 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34bb4-64e5-4e06-8659-d826c404e24d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:30.320570 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34bb4-64e5-4e06-8659-d826c404e24d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:30.376452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5d908-9ff8-4068-98fe-2b99a0372bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:30.377211 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5d908-9ff8-4068-98fe-2b99a0372bbc admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:30.377490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5d908-9ff8-4068-98fe-2b99a0372bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:30.377758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5d908-9ff8-4068-98fe-2b99a0372bbc admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:30.378396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5d908-9ff8-4068-98fe-2b99a0372bbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:30.380313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5d908-9ff8-4068-98fe-2b99a0372bbc admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:30.398970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9aebfc-bc83-445b-a5ed-8f6e81d64d3d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:30.400713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fa9aebfc-bc83-445b-a5ed-8f6e81d64d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:30.455238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9aebfc-bc83-445b-a5ed-8f6e81d64d3d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:30.458794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596feb15-d1ee-4004-9ab8-01f3732967fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:30.459392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596feb15-d1ee-4004-9ab8-01f3732967fc service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:30.459811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596feb15-d1ee-4004-9ab8-01f3732967fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:30.460178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596feb15-d1ee-4004-9ab8-01f3732967fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:30.462041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-596feb15-d1ee-4004-9ab8-01f3732967fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:30.472742 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1334/2645] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:30 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:30.473747 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5d908-9ff8-4068-98fe-2b99a0372bbc admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:30.484835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5d908-9ff8-4068-98fe-2b99a0372bbc admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:30.489845 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cce4ed-3e24-406a-b3f4-51a25c28c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:30.493651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cce4ed-3e24-406a-b3f4-51a25c28c0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:30.493651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cce4ed-3e24-406a-b3f4-51a25c28c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:30.493651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cce4ed-3e24-406a-b3f4-51a25c28c0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:30.493651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cce4ed-3e24-406a-b3f4-51a25c28c0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:30.494107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cce4ed-3e24-406a-b3f4-51a25c28c0c8 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:30.504145 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1335/2646] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:41:30.508808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cce4ed-3e24-406a-b3f4-51a25c28c0c8 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:30.519102 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cce4ed-3e24-406a-b3f4-51a25c28c0c8 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:30.523671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85407a-106b-40ce-9028-880ded2f1be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:30.524334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85407a-106b-40ce-9028-880ded2f1be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:30.524609 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85407a-106b-40ce-9028-880ded2f1be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:30.524882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85407a-106b-40ce-9028-880ded2f1be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:30.525513 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85407a-106b-40ce-9028-880ded2f1be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:30.527053 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85407a-106b-40ce-9028-880ded2f1be7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:30.528658 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596feb15-d1ee-4004-9ab8-01f3732967fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:30.530114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596feb15-d1ee-4004-9ab8-01f3732967fc service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:30.537100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1336/2647] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:30.540995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85407a-106b-40ce-9028-880ded2f1be7 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:30.543485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1312/2648] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:41:30.550503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85407a-106b-40ce-9028-880ded2f1be7 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:30.555714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0798b65-7d33-4d84-bfb8-8e855cd65981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:30.556396 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0798b65-7d33-4d84-bfb8-8e855cd65981 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:30.556673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0798b65-7d33-4d84-bfb8-8e855cd65981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:30.556946 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0798b65-7d33-4d84-bfb8-8e855cd65981 admin admin] PATH_INFO: `/v3/projects/40b88735fe7045cead0fd149ca648276/users/30f3bcd90e5b4be6af66d689cafb8a96/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:30.572712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0798b65-7d33-4d84-bfb8-8e855cd65981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b88735fe7045cead0fd149ca648276, user_id=30f3bcd90e5b4be6af66d689cafb8a96, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:30.575316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0798b65-7d33-4d84-bfb8-8e855cd65981 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:30.634839 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1337/2649] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:30 2022] PUT /identity/v3/projects/40b88735fe7045cead0fd149ca648276/users/30f3bcd90e5b4be6af66d689cafb8a96/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:41:30.645358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce3fcf-eee1-48af-882c-6ec9f2727c9b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:30.645647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce3fcf-eee1-48af-882c-6ec9f2727c9b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:30.645918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce3fcf-eee1-48af-882c-6ec9f2727c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:30.674506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-43ce3fcf-eee1-48af-882c-6ec9f2727c9b None None] MFA Rules not processed for user `30f3bcd90e5b4be6af66d689cafb8a96`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:30.675733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-43ce3fcf-eee1-48af-882c-6ec9f2727c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:30.742403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1313/2650] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:30.759093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0798b65-7d33-4d84-bfb8-8e855cd65981 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:30.822924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0798b65-7d33-4d84-bfb8-8e855cd65981 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:30.827963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d85594-4ae6-473a-b85a-2d784614c04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:30.828646 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d85594-4ae6-473a-b85a-2d784614c04a admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:30.828964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d85594-4ae6-473a-b85a-2d784614c04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:30.829238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d85594-4ae6-473a-b85a-2d784614c04a admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:30.829880 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d85594-4ae6-473a-b85a-2d784614c04a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:30.831748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d85594-4ae6-473a-b85a-2d784614c04a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:30.920945 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1338/2651] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:30 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:30.925163 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce3fcf-eee1-48af-882c-6ec9f2727c9b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:30.935751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce3fcf-eee1-48af-882c-6ec9f2727c9b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:30.961183 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:30.992612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532cfc0-a107-4488-a7a9-7c8258ebaf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:30.993218 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532cfc0-a107-4488-a7a9-7c8258ebaf40 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:30.993497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532cfc0-a107-4488-a7a9-7c8258ebaf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:30.993781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532cfc0-a107-4488-a7a9-7c8258ebaf40 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:30.994460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532cfc0-a107-4488-a7a9-7c8258ebaf40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:30.997069 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532cfc0-a107-4488-a7a9-7c8258ebaf40 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:31.102577 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1314/2652] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:30 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:41:31.104046 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d85594-4ae6-473a-b85a-2d784614c04a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:31.114668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d85594-4ae6-473a-b85a-2d784614c04a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:31.123349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49743746-7e45-4827-ab94-b382b47e1754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:31.123349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49743746-7e45-4827-ab94-b382b47e1754 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:31.123349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49743746-7e45-4827-ab94-b382b47e1754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:31.123349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49743746-7e45-4827-ab94-b382b47e1754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:31.123732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49743746-7e45-4827-ab94-b382b47e1754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:31.123732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49743746-7e45-4827-ab94-b382b47e1754 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:31.135532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1339/2653] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:31.139725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532cfc0-a107-4488-a7a9-7c8258ebaf40 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:31.150347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532cfc0-a107-4488-a7a9-7c8258ebaf40 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:31.155094 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbed7ae-4679-419d-9cb0-259dd9d8a655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:31.155771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed7ae-4679-419d-9cb0-259dd9d8a655 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:31.156078 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed7ae-4679-419d-9cb0-259dd9d8a655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:31.156346 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed7ae-4679-419d-9cb0-259dd9d8a655 admin admin] PATH_INFO: `/v3/projects/4f92bca4583043a1acab3fd2636e7615/users/0f05c185bea54bb0a78d80c83ac9349e/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:31.171387 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbed7ae-4679-419d-9cb0-259dd9d8a655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f92bca4583043a1acab3fd2636e7615, user_id=0f05c185bea54bb0a78d80c83ac9349e, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:31.174120 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbed7ae-4679-419d-9cb0-259dd9d8a655 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:31.241642 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1315/2654] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:31 2022] PUT /identity/v3/projects/4f92bca4583043a1acab3fd2636e7615/users/0f05c185bea54bb0a78d80c83ac9349e/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:31.245760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49743746-7e45-4827-ab94-b382b47e1754 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:31.256222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49743746-7e45-4827-ab94-b382b47e1754 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:31.263048 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:31.316957 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a19262-7076-4976-a82c-f813f5fca7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:31.317579 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19262-7076-4976-a82c-f813f5fca7ed admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:31.318000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19262-7076-4976-a82c-f813f5fca7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:31.318343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19262-7076-4976-a82c-f813f5fca7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:31.319869 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a19262-7076-4976-a82c-f813f5fca7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:31.321335 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a19262-7076-4976-a82c-f813f5fca7ed admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:31.331835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1340/2655] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:31.336038 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbed7ae-4679-419d-9cb0-259dd9d8a655 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:31.346542 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbed7ae-4679-419d-9cb0-259dd9d8a655 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:31.351450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39e0ec-8354-4e22-a7d5-67cc1f343dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:31.352136 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39e0ec-8354-4e22-a7d5-67cc1f343dff admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:31.352676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39e0ec-8354-4e22-a7d5-67cc1f343dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:31.352948 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39e0ec-8354-4e22-a7d5-67cc1f343dff admin admin] PATH_INFO: `/v3/projects/4f92bca4583043a1acab3fd2636e7615/users/0f05c185bea54bb0a78d80c83ac9349e/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:31.354924 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39e0ec-8354-4e22-a7d5-67cc1f343dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f92bca4583043a1acab3fd2636e7615, user_id=0f05c185bea54bb0a78d80c83ac9349e, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:31.357582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39e0ec-8354-4e22-a7d5-67cc1f343dff admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:31.369392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1316/2656] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:31 2022] PUT /identity/v3/projects/4f92bca4583043a1acab3fd2636e7615/users/0f05c185bea54bb0a78d80c83ac9349e/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:31.380782 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd6ae-a2f7-4172-bc77-6818deed5627 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:31.381094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd6ae-a2f7-4172-bc77-6818deed5627 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:31.381988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd6ae-a2f7-4172-bc77-6818deed5627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:31.409563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-56dfd6ae-a2f7-4172-bc77-6818deed5627 None None] MFA Rules not processed for user `0f05c185bea54bb0a78d80c83ac9349e`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:31.410847 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-56dfd6ae-a2f7-4172-bc77-6818deed5627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:31.480151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1341/2657] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:31.492036 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39e0ec-8354-4e22-a7d5-67cc1f343dff admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:31.493732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2c39e0ec-8354-4e22-a7d5-67cc1f343dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:31.552644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39e0ec-8354-4e22-a7d5-67cc1f343dff admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:31.556987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9450c-96b1-4eba-b812-e4cf5452e52d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:31.557586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9450c-96b1-4eba-b812-e4cf5452e52d service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:31.557857 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9450c-96b1-4eba-b812-e4cf5452e52d service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:31.558121 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9450c-96b1-4eba-b812-e4cf5452e52d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:31.566989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9450c-96b1-4eba-b812-e4cf5452e52d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:31.568448 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9450c-96b1-4eba-b812-e4cf5452e52d service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:31.577578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1317/2658] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:32.543730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd6ae-a2f7-4172-bc77-6818deed5627 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:32.604691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd6ae-a2f7-4172-bc77-6818deed5627 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:32.609240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:32.609850 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:32.610125 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:32.610391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] PATH_INFO: `/v3/users/30f3bcd90e5b4be6af66d689cafb8a96` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:32.611532 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f3bcd90e5b4be6af66d689cafb8a96)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:32.613426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:32.792590 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:32.804128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f3bcd90e5b4be6af66d689cafb8a96'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:32.811079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f3bcd90e5b4be6af66d689cafb8a96'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:32.811866 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f3bcd90e5b4be6af66d689cafb8a96'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:32.812507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f3bcd90e5b4be6af66d689cafb8a96'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:32.880766 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f3bcd90e5b4be6af66d689cafb8a96'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:32.899974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1342/2659] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:32 2022] DELETE /identity/v3/users/30f3bcd90e5b4be6af66d689cafb8a96 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:32.904695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b07ffe-2a13-4949-995f-ee95022e59f7 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:32.905201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b07ffe-2a13-4949-995f-ee95022e59f7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:32.905308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b07ffe-2a13-4949-995f-ee95022e59f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:32.929134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-18b07ffe-2a13-4949-995f-ee95022e59f7 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:32.929134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-18b07ffe-2a13-4949-995f-ee95022e59f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:32.987591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1318/2660] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:41:32.998380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:32.999858 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:33.056644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7bde0-d1e6-4389-bbbc-af445721daf7 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:33.060261 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12779e4-8dc4-48ab-a346-12b032d94544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:33.060859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12779e4-8dc4-48ab-a346-12b032d94544 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:33.063541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12779e4-8dc4-48ab-a346-12b032d94544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:33.063541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12779e4-8dc4-48ab-a346-12b032d94544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:33.070499 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12779e4-8dc4-48ab-a346-12b032d94544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:33.071908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12779e4-8dc4-48ab-a346-12b032d94544 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:33.081565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1343/2661] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:33.893815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b07ffe-2a13-4949-995f-ee95022e59f7 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:33.898797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-18b07ffe-2a13-4949-995f-ee95022e59f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:33.909922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b07ffe-2a13-4949-995f-ee95022e59f7 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:33.915224 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:33.915890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:33.916180 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:33.916639 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] PATH_INFO: `/v3/projects/40b88735fe7045cead0fd149ca648276` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:33.917787 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b88735fe7045cead0fd149ca648276)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:33.927677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:33.937881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:34.112563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b88735fe7045cead0fd149ca648276', 'request_id': 'req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:34.119394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b88735fe7045cead0fd149ca648276', 'request_id': 'req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:34.126398 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b88735fe7045cead0fd149ca648276', 'request_id': 'req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:34.264897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] The token cache is being invalidate because project 40b88735fe7045cead0fd149ca648276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:34.265202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:34.265828 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:34.267296 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1319/2662] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:33 2022] DELETE /identity/v3/projects/40b88735fe7045cead0fd149ca648276 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:34.271389 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12779e4-8dc4-48ab-a346-12b032d94544 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:34.281963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12779e4-8dc4-48ab-a346-12b032d94544 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:34.338430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4adf7a-5192-4420-a783-828611b790f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:34.339067 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4adf7a-5192-4420-a783-828611b790f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:34.339347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4adf7a-5192-4420-a783-828611b790f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:34.339622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4adf7a-5192-4420-a783-828611b790f7 admin admin] PATH_INFO: `/v3/users/0f05c185bea54bb0a78d80c83ac9349e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:34.340777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4adf7a-5192-4420-a783-828611b790f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f05c185bea54bb0a78d80c83ac9349e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:34.342772 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4adf7a-5192-4420-a783-828611b790f7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:34.536314 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0e4adf7a-5192-4420-a783-828611b790f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f05c185bea54bb0a78d80c83ac9349e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:34.542743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:34.545056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0e4adf7a-5192-4420-a783-828611b790f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f05c185bea54bb0a78d80c83ac9349e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:34.545814 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0e4adf7a-5192-4420-a783-828611b790f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f05c185bea54bb0a78d80c83ac9349e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:34.546480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0e4adf7a-5192-4420-a783-828611b790f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f05c185bea54bb0a78d80c83ac9349e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:34.675223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0e4adf7a-5192-4420-a783-828611b790f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f05c185bea54bb0a78d80c83ac9349e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:34.692691 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1344/2663] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:34 2022] DELETE /identity/v3/users/0f05c185bea54bb0a78d80c83ac9349e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:35.105751 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:35.107336 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:35.122606 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1a38a-b123-4409-b9bb-07ea66e9fca3 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:35.181771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:35.182398 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:35.182673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:35.182941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7 admin admin] PATH_INFO: `/v3/projects/4f92bca4583043a1acab3fd2636e7615` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:35.184087 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f92bca4583043a1acab3fd2636e7615)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:35.185979 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:35.293700 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f92bca4583043a1acab3fd2636e7615', 'request_id': 'req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:35.301819 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f92bca4583043a1acab3fd2636e7615', 'request_id': 'req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:35.309100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f92bca4583043a1acab3fd2636e7615', 'request_id': 'req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:35.360423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7 admin admin] The token cache is being invalidate because project 4f92bca4583043a1acab3fd2636e7615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:35.360720 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:35.361389 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d9c4494-6fa6-49f9-aa89-2ab474c26cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:35.366408 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1320/2664] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:35 2022] DELETE /identity/v3/projects/4f92bca4583043a1acab3fd2636e7615 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:35.368694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04283c5b-e18a-43b1-b50a-7253b7d7009f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:35.369177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04283c5b-e18a-43b1-b50a-7253b7d7009f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:35.369342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04283c5b-e18a-43b1-b50a-7253b7d7009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:35.390548 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-04283c5b-e18a-43b1-b50a-7253b7d7009f None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:35.391743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-04283c5b-e18a-43b1-b50a-7253b7d7009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:35.452948 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1345/2665] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:35.461102 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f893a-3da9-4d7c-998d-cdf94a3ee58d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:35.461385 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f893a-3da9-4d7c-998d-cdf94a3ee58d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:35.461662 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f893a-3da9-4d7c-998d-cdf94a3ee58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:35.482438 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-335f893a-3da9-4d7c-998d-cdf94a3ee58d None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:35.483645 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-335f893a-3da9-4d7c-998d-cdf94a3ee58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:35.492417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1321/2666] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:35.496699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04283c5b-e18a-43b1-b50a-7253b7d7009f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:35.506377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04283c5b-e18a-43b1-b50a-7253b7d7009f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:35.511107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb1beb-bd44-49ba-b160-b8c82619ca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:35.511698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb1beb-bd44-49ba-b160-b8c82619ca7c admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:35.512009 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb1beb-bd44-49ba-b160-b8c82619ca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:35.512289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb1beb-bd44-49ba-b160-b8c82619ca7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:35.512938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb1beb-bd44-49ba-b160-b8c82619ca7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:41:35.513243 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb1beb-bd44-49ba-b160-b8c82619ca7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:35.514853 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb1beb-bd44-49ba-b160-b8c82619ca7c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:35.526994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1346/2667] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:41:35.531321 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f893a-3da9-4d7c-998d-cdf94a3ee58d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:35.541095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f893a-3da9-4d7c-998d-cdf94a3ee58d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:35.545794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867256f-d27d-4963-a740-23debafa8927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:35.546432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867256f-d27d-4963-a740-23debafa8927 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:35.546716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867256f-d27d-4963-a740-23debafa8927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:35.546983 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867256f-d27d-4963-a740-23debafa8927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:35.547611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867256f-d27d-4963-a740-23debafa8927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:35.549504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867256f-d27d-4963-a740-23debafa8927 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:35.630783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1322/2668] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:35 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:41:35.635043 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb1beb-bd44-49ba-b160-b8c82619ca7c admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:35.645025 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb1beb-bd44-49ba-b160-b8c82619ca7c admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:35.700639 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5add2-8160-4fba-a6de-e32330a05c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:35.701231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5add2-8160-4fba-a6de-e32330a05c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:35.701503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5add2-8160-4fba-a6de-e32330a05c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:35.701768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5add2-8160-4fba-a6de-e32330a05c17 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:35.702380 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5add2-8160-4fba-a6de-e32330a05c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:35.704376 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5add2-8160-4fba-a6de-e32330a05c17 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:35.832770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1347/2669] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:35 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:35.834099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867256f-d27d-4963-a740-23debafa8927 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:35.844808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867256f-d27d-4963-a740-23debafa8927 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:35.849688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae9e8d-695e-41b7-854c-d559b030bdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:35.850857 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae9e8d-695e-41b7-854c-d559b030bdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:35.851128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae9e8d-695e-41b7-854c-d559b030bdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:35.851402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae9e8d-695e-41b7-854c-d559b030bdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:35.852065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae9e8d-695e-41b7-854c-d559b030bdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:35.853912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae9e8d-695e-41b7-854c-d559b030bdc2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:35.855134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:35.864547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1323/2670] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:35.871783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5add2-8160-4fba-a6de-e32330a05c17 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:35.881795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5add2-8160-4fba-a6de-e32330a05c17 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:35.886494 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6cc1c-a911-40fd-9418-b8a92f270e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:35.887024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6cc1c-a911-40fd-9418-b8a92f270e4b admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:35.887285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6cc1c-a911-40fd-9418-b8a92f270e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:35.887551 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6cc1c-a911-40fd-9418-b8a92f270e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:35.888256 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6cc1c-a911-40fd-9418-b8a92f270e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:35.889831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6cc1c-a911-40fd-9418-b8a92f270e4b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:35.902332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1348/2671] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:35.906384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae9e8d-695e-41b7-854c-d559b030bdc2 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:35.921967 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae9e8d-695e-41b7-854c-d559b030bdc2 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:35.926868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ffc94-2239-453b-bae6-801388f98bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:35.927611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ffc94-2239-453b-bae6-801388f98bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:35.927865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ffc94-2239-453b-bae6-801388f98bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:35.928229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ffc94-2239-453b-bae6-801388f98bc3 admin admin] PATH_INFO: `/v3/projects/d0b40066b2cb495d8e472afc82988ab7/users/4d2b6c33eb2b4ba69043282c75a49f29/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:35.942913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ffc94-2239-453b-bae6-801388f98bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b40066b2cb495d8e472afc82988ab7, user_id=4d2b6c33eb2b4ba69043282c75a49f29, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:35.946100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ffc94-2239-453b-bae6-801388f98bc3 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:36.099101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1324/2672] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:35 2022] PUT /identity/v3/projects/d0b40066b2cb495d8e472afc82988ab7/users/4d2b6c33eb2b4ba69043282c75a49f29/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:36.109716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715993e-8595-4b3b-905f-fa96aaf7732f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:36.109924 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715993e-8595-4b3b-905f-fa96aaf7732f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:36.110203 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715993e-8595-4b3b-905f-fa96aaf7732f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:36.138176 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e715993e-8595-4b3b-905f-fa96aaf7732f None None] MFA Rules not processed for user `4d2b6c33eb2b4ba69043282c75a49f29`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:36.139374 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e715993e-8595-4b3b-905f-fa96aaf7732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:36.165484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:36.202593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1349/2673] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:41:36.213115 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ffc94-2239-453b-bae6-801388f98bc3 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:36.274929 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ffc94-2239-453b-bae6-801388f98bc3 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:36.279638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7a0b7-92c9-49ed-821a-97cae34866da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:36.280271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7a0b7-92c9-49ed-821a-97cae34866da admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:36.280551 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7a0b7-92c9-49ed-821a-97cae34866da admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:36.280819 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7a0b7-92c9-49ed-821a-97cae34866da admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:36.281449 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7a0b7-92c9-49ed-821a-97cae34866da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:36.283457 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7a0b7-92c9-49ed-821a-97cae34866da admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:36.379961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1325/2674] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:36 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:36.384774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715993e-8595-4b3b-905f-fa96aaf7732f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:36.395804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715993e-8595-4b3b-905f-fa96aaf7732f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:36.451162 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eea06-b457-4a7f-a2b8-8a8c7e0e525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:36.451873 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eea06-b457-4a7f-a2b8-8a8c7e0e525e admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:36.452187 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eea06-b457-4a7f-a2b8-8a8c7e0e525e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:36.452459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eea06-b457-4a7f-a2b8-8a8c7e0e525e admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:36.453084 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eea06-b457-4a7f-a2b8-8a8c7e0e525e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:36.454960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eea06-b457-4a7f-a2b8-8a8c7e0e525e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:36.561631 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1350/2675] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:36 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:36.565731 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7a0b7-92c9-49ed-821a-97cae34866da admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:36.576634 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7a0b7-92c9-49ed-821a-97cae34866da admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:36.581396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d92f6-5f54-42a1-846e-689028c39200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:36.582041 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d92f6-5f54-42a1-846e-689028c39200 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:36.582319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d92f6-5f54-42a1-846e-689028c39200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:36.582589 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d92f6-5f54-42a1-846e-689028c39200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:36.583222 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d92f6-5f54-42a1-846e-689028c39200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:36.584900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d92f6-5f54-42a1-846e-689028c39200 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:36.595117 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1326/2676] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:36.599175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eea06-b457-4a7f-a2b8-8a8c7e0e525e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:36.609713 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eea06-b457-4a7f-a2b8-8a8c7e0e525e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:36.614284 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ade554-7c92-4c7b-837a-93a24e1fc3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:36.614921 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ade554-7c92-4c7b-837a-93a24e1fc3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:36.615201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ade554-7c92-4c7b-837a-93a24e1fc3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:36.615475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ade554-7c92-4c7b-837a-93a24e1fc3d6 admin admin] PATH_INFO: `/v3/projects/83080b080cad4a8dbff98c2cc8a9070a/users/30352745991d41158b7136dbb22fac08/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:36.630944 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ade554-7c92-4c7b-837a-93a24e1fc3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83080b080cad4a8dbff98c2cc8a9070a, user_id=30352745991d41158b7136dbb22fac08, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:36.633516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ade554-7c92-4c7b-837a-93a24e1fc3d6 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:36.737695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1351/2677] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:36 2022] PUT /identity/v3/projects/83080b080cad4a8dbff98c2cc8a9070a/users/30352745991d41158b7136dbb22fac08/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:36.741694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d92f6-5f54-42a1-846e-689028c39200 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:36.752505 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d92f6-5f54-42a1-846e-689028c39200 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:36.814219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb19b5c-6311-4233-bd37-64287f56185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:36.814219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb19b5c-6311-4233-bd37-64287f56185e admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:36.814219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb19b5c-6311-4233-bd37-64287f56185e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:36.814219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb19b5c-6311-4233-bd37-64287f56185e admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:36.814614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb19b5c-6311-4233-bd37-64287f56185e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:36.814614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb19b5c-6311-4233-bd37-64287f56185e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:36.826061 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1327/2678] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:36.827146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ade554-7c92-4c7b-837a-93a24e1fc3d6 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:36.850869 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ade554-7c92-4c7b-837a-93a24e1fc3d6 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:36.856105 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68500111-7e37-4b99-8f11-53c06559b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:36.856754 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500111-7e37-4b99-8f11-53c06559b080 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:36.857029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500111-7e37-4b99-8f11-53c06559b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:36.857297 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500111-7e37-4b99-8f11-53c06559b080 admin admin] PATH_INFO: `/v3/projects/83080b080cad4a8dbff98c2cc8a9070a/users/30352745991d41158b7136dbb22fac08/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:36.859399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68500111-7e37-4b99-8f11-53c06559b080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83080b080cad4a8dbff98c2cc8a9070a, user_id=30352745991d41158b7136dbb22fac08, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:36.862060 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68500111-7e37-4b99-8f11-53c06559b080 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:36.873372 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1352/2679] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:36 2022] PUT /identity/v3/projects/83080b080cad4a8dbff98c2cc8a9070a/users/30352745991d41158b7136dbb22fac08/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:41:36.884704 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d26ab3-ff8b-4f28-907a-42a2c439ae8c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:36.884997 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d26ab3-ff8b-4f28-907a-42a2c439ae8c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:36.885273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d26ab3-ff8b-4f28-907a-42a2c439ae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:36.914347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f7d26ab3-ff8b-4f28-907a-42a2c439ae8c None None] MFA Rules not processed for user `30352745991d41158b7136dbb22fac08`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:36.916193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f7d26ab3-ff8b-4f28-907a-42a2c439ae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:36.945661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:36.983527 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1328/2680] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:36.996482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68500111-7e37-4b99-8f11-53c06559b080 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:36.998172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-68500111-7e37-4b99-8f11-53c06559b080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:37.060673 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68500111-7e37-4b99-8f11-53c06559b080 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:37.064533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10191ef6-99c2-4646-9aec-1456f762e1c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:37.065137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10191ef6-99c2-4646-9aec-1456f762e1c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:37.065412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10191ef6-99c2-4646-9aec-1456f762e1c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:37.065668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10191ef6-99c2-4646-9aec-1456f762e1c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:37.076326 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10191ef6-99c2-4646-9aec-1456f762e1c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:37.077739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10191ef6-99c2-4646-9aec-1456f762e1c2 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:37.087786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1353/2681] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:38.334985 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d26ab3-ff8b-4f28-907a-42a2c439ae8c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:38.344253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d26ab3-ff8b-4f28-907a-42a2c439ae8c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:38.348809 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc40507-209b-438f-b74e-710c7749fb29 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30352745991d41158b7136dbb22fac08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83080b080cad4a8dbff98c2cc8a9070a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:38.349402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40507-209b-438f-b74e-710c7749fb29 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:38.349678 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40507-209b-438f-b74e-710c7749fb29 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:38.349949 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40507-209b-438f-b74e-710c7749fb29 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:38.350591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc40507-209b-438f-b74e-710c7749fb29 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:41:38.351000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc40507-209b-438f-b74e-710c7749fb29 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:38.353136 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc40507-209b-438f-b74e-710c7749fb29 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:38.367908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1329/2682] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:41:38.369837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10191ef6-99c2-4646-9aec-1456f762e1c2 service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:38.379350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10191ef6-99c2-4646-9aec-1456f762e1c2 service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:38.384032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52289dd7-5b90-4da7-8f16-b3e0e0bdac80 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30352745991d41158b7136dbb22fac08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83080b080cad4a8dbff98c2cc8a9070a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:38.389315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52289dd7-5b90-4da7-8f16-b3e0e0bdac80 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:38.389315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52289dd7-5b90-4da7-8f16-b3e0e0bdac80 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:38.389315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52289dd7-5b90-4da7-8f16-b3e0e0bdac80 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:38.389315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52289dd7-5b90-4da7-8f16-b3e0e0bdac80 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:38.389315 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52289dd7-5b90-4da7-8f16-b3e0e0bdac80 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:38.516501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:38.522898 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1354/2683] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:38 2022] POST /identity/v3/projects => generated 354 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:38.527463 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc40507-209b-438f-b74e-710c7749fb29 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:38.537455 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc40507-209b-438f-b74e-710c7749fb29 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:38.592304 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e8f8a-818c-4ae2-ba16-72271295d7fa tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30352745991d41158b7136dbb22fac08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83080b080cad4a8dbff98c2cc8a9070a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:38.592904 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e8f8a-818c-4ae2-ba16-72271295d7fa tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:38.593181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e8f8a-818c-4ae2-ba16-72271295d7fa tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:38.593450 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e8f8a-818c-4ae2-ba16-72271295d7fa tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:38.594081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e8f8a-818c-4ae2-ba16-72271295d7fa tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:41:38.594377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e8f8a-818c-4ae2-ba16-72271295d7fa tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:38.595975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e8f8a-818c-4ae2-ba16-72271295d7fa tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:38.608028 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1330/2684] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:41:38.650288 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52289dd7-5b90-4da7-8f16-b3e0e0bdac80 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:38.661064 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52289dd7-5b90-4da7-8f16-b3e0e0bdac80 tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:38.666369 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30352745991d41158b7136dbb22fac08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83080b080cad4a8dbff98c2cc8a9070a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:38.666982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:38.667264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:38.667616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] PATH_INFO: `/v3/projects/1103be7f160d43a3b4d8a4735cf21667` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:38.668794 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1103be7f160d43a3b4d8a4735cf21667)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:38.670663 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:38.823904 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1103be7f160d43a3b4d8a4735cf21667', 'request_id': 'req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:38.829279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1103be7f160d43a3b4d8a4735cf21667', 'request_id': 'req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:38.949594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1103be7f160d43a3b4d8a4735cf21667', 'request_id': 'req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:38.962977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] The token cache is being invalidate because project 1103be7f160d43a3b4d8a4735cf21667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:38.963262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:38.963906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-de28f1c8-5a31-400e-9678-0bfd4e0b47cb tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:38.965462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1355/2685] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:38 2022] DELETE /identity/v3/projects/1103be7f160d43a3b4d8a4735cf21667 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:39.849410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e8f8a-818c-4ae2-ba16-72271295d7fa tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:39.851288 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a62e8f8a-818c-4ae2-ba16-72271295d7fa tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:39.916688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e8f8a-818c-4ae2-ba16-72271295d7fa tempest-VolumeQuotaClassesTest-29610449 tempest-VolumeQuotaClassesTest-29610449-project-admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:39.966229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:39.972991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:39.973622 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:39.973899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:39.974307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] PATH_INFO: `/v3/users/4d2b6c33eb2b4ba69043282c75a49f29` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:39.975428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2b6c33eb2b4ba69043282c75a49f29)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:39.977638 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:40.227287 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2b6c33eb2b4ba69043282c75a49f29'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:40.241186 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2b6c33eb2b4ba69043282c75a49f29'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:40.242054 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2b6c33eb2b4ba69043282c75a49f29'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:40.343851 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2b6c33eb2b4ba69043282c75a49f29'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:40.357914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2b6c33eb2b4ba69043282c75a49f29'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:40.363864 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1331/2686] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:39 2022] DELETE /identity/v3/users/4d2b6c33eb2b4ba69043282c75a49f29 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:40.368461 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55bf32-e4cf-4886-affc-dc8c5cb9face None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:40.368917 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55bf32-e4cf-4886-affc-dc8c5cb9face None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:40.369036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55bf32-e4cf-4886-affc-dc8c5cb9face None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:40.388285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-cb55bf32-e4cf-4886-affc-dc8c5cb9face None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:40.389462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cb55bf32-e4cf-4886-affc-dc8c5cb9face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:40.450274 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1356/2687] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:41:40.460878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:40.463033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:40.527234 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceff27b-6c63-49bf-bb9b-318023d727cf admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:40.530965 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c51b12-8e67-4ead-b083-ad88bdc48f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:40.531568 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c51b12-8e67-4ead-b083-ad88bdc48f5a service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:40.531845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c51b12-8e67-4ead-b083-ad88bdc48f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:40.532151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c51b12-8e67-4ead-b083-ad88bdc48f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:40.541415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c51b12-8e67-4ead-b083-ad88bdc48f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:40.542939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c51b12-8e67-4ead-b083-ad88bdc48f5a service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:40.552683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1332/2688] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:41.139650 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55bf32-e4cf-4886-affc-dc8c5cb9face None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:41.141218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cb55bf32-e4cf-4886-affc-dc8c5cb9face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:41.155106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55bf32-e4cf-4886-affc-dc8c5cb9face None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:41.159776 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:41.160434 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:41.161221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:41.161521 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] PATH_INFO: `/v3/projects/d0b40066b2cb495d8e472afc82988ab7` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:41.162801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b40066b2cb495d8e472afc82988ab7)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:41.164704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:41.349799 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b40066b2cb495d8e472afc82988ab7', 'request_id': 'req-0550d961-d62e-4296-ac92-862b0a983f66'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:41.355545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b40066b2cb495d8e472afc82988ab7', 'request_id': 'req-0550d961-d62e-4296-ac92-862b0a983f66'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:41.468909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b40066b2cb495d8e472afc82988ab7', 'request_id': 'req-0550d961-d62e-4296-ac92-862b0a983f66'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:41.480317 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] The token cache is being invalidate because project d0b40066b2cb495d8e472afc82988ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:41.486133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:41.486133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:41.486133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1357/2689] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:41 2022] DELETE /identity/v3/projects/d0b40066b2cb495d8e472afc82988ab7 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:41.486753 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c51b12-8e67-4ead-b083-ad88bdc48f5a service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:41.497053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c51b12-8e67-4ead-b083-ad88bdc48f5a service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:41.552902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e867b-5e4d-45cf-8767-bb61f50be7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:41.553549 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e867b-5e4d-45cf-8767-bb61f50be7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:41.553834 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e867b-5e4d-45cf-8767-bb61f50be7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:41.554106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e867b-5e4d-45cf-8767-bb61f50be7f7 admin admin] PATH_INFO: `/v3/users/30352745991d41158b7136dbb22fac08` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:41.555214 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e867b-5e4d-45cf-8767-bb61f50be7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30352745991d41158b7136dbb22fac08)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:41.561468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e867b-5e4d-45cf-8767-bb61f50be7f7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:41.582946 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:41.832358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-417e867b-5e4d-45cf-8767-bb61f50be7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30352745991d41158b7136dbb22fac08'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:41.846077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-417e867b-5e4d-45cf-8767-bb61f50be7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30352745991d41158b7136dbb22fac08'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:41.846784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-417e867b-5e4d-45cf-8767-bb61f50be7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30352745991d41158b7136dbb22fac08'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:41.915813 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-417e867b-5e4d-45cf-8767-bb61f50be7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30352745991d41158b7136dbb22fac08'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:41.928817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-417e867b-5e4d-45cf-8767-bb61f50be7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30352745991d41158b7136dbb22fac08'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:41.934923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1333/2690] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:41 2022] DELETE /identity/v3/users/30352745991d41158b7136dbb22fac08 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:42.317452 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:42.324095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:42.361059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550d961-d62e-4296-ac92-862b0a983f66 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:42.364951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:42.419522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c4314-840f-4191-8525-d0b4169ce87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:42.420182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c4314-840f-4191-8525-d0b4169ce87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:42.420467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c4314-840f-4191-8525-d0b4169ce87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:42.420738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c4314-840f-4191-8525-d0b4169ce87b admin admin] PATH_INFO: `/v3/projects/83080b080cad4a8dbff98c2cc8a9070a` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:42.421841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c4314-840f-4191-8525-d0b4169ce87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83080b080cad4a8dbff98c2cc8a9070a)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:42.423689 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c4314-840f-4191-8525-d0b4169ce87b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:42.555037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ca2c4314-840f-4191-8525-d0b4169ce87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83080b080cad4a8dbff98c2cc8a9070a', 'request_id': 'req-ca2c4314-840f-4191-8525-d0b4169ce87b'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:42.561023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ca2c4314-840f-4191-8525-d0b4169ce87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83080b080cad4a8dbff98c2cc8a9070a', 'request_id': 'req-ca2c4314-840f-4191-8525-d0b4169ce87b'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:42.675419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ca2c4314-840f-4191-8525-d0b4169ce87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83080b080cad4a8dbff98c2cc8a9070a', 'request_id': 'req-ca2c4314-840f-4191-8525-d0b4169ce87b'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:42.688433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ca2c4314-840f-4191-8525-d0b4169ce87b admin admin] The token cache is being invalidate because project 83080b080cad4a8dbff98c2cc8a9070a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:42.688720 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ca2c4314-840f-4191-8525-d0b4169ce87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:42.689337 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ca2c4314-840f-4191-8525-d0b4169ce87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:42.690856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1358/2691] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:42 2022] DELETE /identity/v3/projects/83080b080cad4a8dbff98c2cc8a9070a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:42.695661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337eb3e-b1e0-4439-b1ca-396975b766a6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:42.696176 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337eb3e-b1e0-4439-b1ca-396975b766a6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:42.696290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337eb3e-b1e0-4439-b1ca-396975b766a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:42.715364 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0337eb3e-b1e0-4439-b1ca-396975b766a6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:42.716584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0337eb3e-b1e0-4439-b1ca-396975b766a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:42.776101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1334/2692] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:42.783960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806efbe-ace8-4553-9b18-34b2661d2d88 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:42.784254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806efbe-ace8-4553-9b18-34b2661d2d88 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:42.784530 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806efbe-ace8-4553-9b18-34b2661d2d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:42.803471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2806efbe-ace8-4553-9b18-34b2661d2d88 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:42.804704 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2806efbe-ace8-4553-9b18-34b2661d2d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:42.812525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1359/2693] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:42.824080 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337eb3e-b1e0-4439-b1ca-396975b766a6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:42.833878 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337eb3e-b1e0-4439-b1ca-396975b766a6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:42.839173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3228094-0fb1-4c62-b6d4-514203fdee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:42.839769 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3228094-0fb1-4c62-b6d4-514203fdee05 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:42.840083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3228094-0fb1-4c62-b6d4-514203fdee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:42.840355 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3228094-0fb1-4c62-b6d4-514203fdee05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:42.841001 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3228094-0fb1-4c62-b6d4-514203fdee05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:41:42.841302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3228094-0fb1-4c62-b6d4-514203fdee05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:42.842883 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3228094-0fb1-4c62-b6d4-514203fdee05 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:42.855057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1335/2694] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:41:42.859421 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806efbe-ace8-4553-9b18-34b2661d2d88 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:42.868653 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806efbe-ace8-4553-9b18-34b2661d2d88 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:42.873453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365190c-6450-4ec6-a0cb-6312ad70b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:42.874036 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365190c-6450-4ec6-a0cb-6312ad70b7fe admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:42.874313 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365190c-6450-4ec6-a0cb-6312ad70b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:42.874584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365190c-6450-4ec6-a0cb-6312ad70b7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:42.875221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365190c-6450-4ec6-a0cb-6312ad70b7fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:42.877128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365190c-6450-4ec6-a0cb-6312ad70b7fe admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:43.031231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1360/2695] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:42 2022] POST /identity/v3/projects => generated 407 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:41:43.035434 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3228094-0fb1-4c62-b6d4-514203fdee05 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:43.045511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3228094-0fb1-4c62-b6d4-514203fdee05 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:43.103503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42340a0c-4887-4a28-ba9a-5b1cae4cf6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:43.104128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42340a0c-4887-4a28-ba9a-5b1cae4cf6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:43.104406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42340a0c-4887-4a28-ba9a-5b1cae4cf6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:43.104675 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42340a0c-4887-4a28-ba9a-5b1cae4cf6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:43.105310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42340a0c-4887-4a28-ba9a-5b1cae4cf6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:43.107190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42340a0c-4887-4a28-ba9a-5b1cae4cf6b6 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:43.194873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1336/2696] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:43 2022] POST /identity/v3/users => generated 304 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:41:43.198974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365190c-6450-4ec6-a0cb-6312ad70b7fe admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:43.209059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365190c-6450-4ec6-a0cb-6312ad70b7fe admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:43.214199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459ad4-7cef-410f-895b-2f9409e3cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:43.214783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459ad4-7cef-410f-895b-2f9409e3cb1b admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:43.215545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459ad4-7cef-410f-895b-2f9409e3cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:43.215545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459ad4-7cef-410f-895b-2f9409e3cb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:43.215939 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba459ad4-7cef-410f-895b-2f9409e3cb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:43.217511 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba459ad4-7cef-410f-895b-2f9409e3cb1b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:43.227156 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1361/2697] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:43.231872 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42340a0c-4887-4a28-ba9a-5b1cae4cf6b6 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:43.241653 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42340a0c-4887-4a28-ba9a-5b1cae4cf6b6 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:43.246220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8cdad-1a73-43d9-98ae-4f29cba8d3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:43.246805 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8cdad-1a73-43d9-98ae-4f29cba8d3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:43.247084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8cdad-1a73-43d9-98ae-4f29cba8d3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:43.247351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8cdad-1a73-43d9-98ae-4f29cba8d3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:43.248032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8cdad-1a73-43d9-98ae-4f29cba8d3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:43.249599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8cdad-1a73-43d9-98ae-4f29cba8d3b3 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:43.259411 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1337/2698] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:43.263536 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459ad4-7cef-410f-895b-2f9409e3cb1b admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:43.273283 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459ad4-7cef-410f-895b-2f9409e3cb1b admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:43.278393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bd9e0-bb9e-4445-b4c4-0b340fc37959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:43.279018 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bd9e0-bb9e-4445-b4c4-0b340fc37959 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:43.279296 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bd9e0-bb9e-4445-b4c4-0b340fc37959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:43.279566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bd9e0-bb9e-4445-b4c4-0b340fc37959 admin admin] PATH_INFO: `/v3/projects/ada04e9d068343e38ca82b4215b9d8b8/users/8dbf051f67f540d5a22239a64693aec5/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:43.295482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bd9e0-bb9e-4445-b4c4-0b340fc37959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada04e9d068343e38ca82b4215b9d8b8, user_id=8dbf051f67f540d5a22239a64693aec5, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:43.298199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bd9e0-bb9e-4445-b4c4-0b340fc37959 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:43.365602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1362/2699] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:43 2022] PUT /identity/v3/projects/ada04e9d068343e38ca82b4215b9d8b8/users/8dbf051f67f540d5a22239a64693aec5/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:43.375897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255b47f-df3f-448e-9ad6-64b9d928d0a6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:43.376217 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255b47f-df3f-448e-9ad6-64b9d928d0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:43.376487 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255b47f-df3f-448e-9ad6-64b9d928d0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:43.383628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:43.405406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4255b47f-df3f-448e-9ad6-64b9d928d0a6 None None] MFA Rules not processed for user `8dbf051f67f540d5a22239a64693aec5`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:43.406609 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4255b47f-df3f-448e-9ad6-64b9d928d0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:43.472199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1338/2700] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:43 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:43.477755 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bd9e0-bb9e-4445-b4c4-0b340fc37959 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:43.516157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:43.543260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bd9e0-bb9e-4445-b4c4-0b340fc37959 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:43.547965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd665a-629f-411d-a66c-02b9f5e4eb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:43.548569 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd665a-629f-411d-a66c-02b9f5e4eb46 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:43.548846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd665a-629f-411d-a66c-02b9f5e4eb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:43.549116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd665a-629f-411d-a66c-02b9f5e4eb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:43.549752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd665a-629f-411d-a66c-02b9f5e4eb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:43.551621 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd665a-629f-411d-a66c-02b9f5e4eb46 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:43.665029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1363/2701] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:43 2022] POST /identity/v3/projects => generated 407 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:43.669090 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255b47f-df3f-448e-9ad6-64b9d928d0a6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:43.679626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255b47f-df3f-448e-9ad6-64b9d928d0a6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:43.735342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd863bc-5f54-4d9d-bfc2-3157cd95f652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:43.735973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd863bc-5f54-4d9d-bfc2-3157cd95f652 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:43.736194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd863bc-5f54-4d9d-bfc2-3157cd95f652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:43.736465 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd863bc-5f54-4d9d-bfc2-3157cd95f652 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:43.737083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd863bc-5f54-4d9d-bfc2-3157cd95f652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:43.739109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd863bc-5f54-4d9d-bfc2-3157cd95f652 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:43.835188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1339/2702] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:43 2022] POST /identity/v3/users => generated 310 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:43.839643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd665a-629f-411d-a66c-02b9f5e4eb46 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:43.849836 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd665a-629f-411d-a66c-02b9f5e4eb46 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:43.860368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944653cf-cfeb-4280-a6f7-4a2a40d9953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:43.860368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944653cf-cfeb-4280-a6f7-4a2a40d9953b admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:43.860368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944653cf-cfeb-4280-a6f7-4a2a40d9953b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:43.860368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944653cf-cfeb-4280-a6f7-4a2a40d9953b admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:43.861025 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944653cf-cfeb-4280-a6f7-4a2a40d9953b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:43.862593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944653cf-cfeb-4280-a6f7-4a2a40d9953b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:43.874739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1364/2703] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:43.879534 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd863bc-5f54-4d9d-bfc2-3157cd95f652 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:43.889659 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd863bc-5f54-4d9d-bfc2-3157cd95f652 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:43.894651 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79da897-5275-4916-97cf-1a0ea1fe751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:43.895368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79da897-5275-4916-97cf-1a0ea1fe751e admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:43.895647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79da897-5275-4916-97cf-1a0ea1fe751e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:43.902604 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79da897-5275-4916-97cf-1a0ea1fe751e admin admin] PATH_INFO: `/v3/projects/dc80fcb19d91426684a64b049bb05101/users/91f1e3d613294a8588c2ae43746899a3/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:43.916716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79da897-5275-4916-97cf-1a0ea1fe751e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc80fcb19d91426684a64b049bb05101, user_id=91f1e3d613294a8588c2ae43746899a3, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:43.919493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79da897-5275-4916-97cf-1a0ea1fe751e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:44.001611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1340/2704] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:43 2022] PUT /identity/v3/projects/dc80fcb19d91426684a64b049bb05101/users/91f1e3d613294a8588c2ae43746899a3/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:44.005625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944653cf-cfeb-4280-a6f7-4a2a40d9953b admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:44.015926 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944653cf-cfeb-4280-a6f7-4a2a40d9953b admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:44.071177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115adafe-7c08-471f-a916-4fac6b726a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:44.072455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115adafe-7c08-471f-a916-4fac6b726a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:44.072733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115adafe-7c08-471f-a916-4fac6b726a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:44.073000 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115adafe-7c08-471f-a916-4fac6b726a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:44.073633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115adafe-7c08-471f-a916-4fac6b726a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:44.075188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115adafe-7c08-471f-a916-4fac6b726a93 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:44.084666 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1365/2705] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:44.094814 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79da897-5275-4916-97cf-1a0ea1fe751e admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:44.106252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79da897-5275-4916-97cf-1a0ea1fe751e admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:44.110938 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e320a47-7d57-41ff-866b-d74474615ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:44.111584 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e320a47-7d57-41ff-866b-d74474615ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:44.111859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e320a47-7d57-41ff-866b-d74474615ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:44.112172 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e320a47-7d57-41ff-866b-d74474615ef1 admin admin] PATH_INFO: `/v3/projects/dc80fcb19d91426684a64b049bb05101/users/91f1e3d613294a8588c2ae43746899a3/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:44.114146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e320a47-7d57-41ff-866b-d74474615ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc80fcb19d91426684a64b049bb05101, user_id=91f1e3d613294a8588c2ae43746899a3, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:44.116886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e320a47-7d57-41ff-866b-d74474615ef1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:44.128203 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1341/2706] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:44 2022] PUT /identity/v3/projects/dc80fcb19d91426684a64b049bb05101/users/91f1e3d613294a8588c2ae43746899a3/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:44.139914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c2ca3-5c4f-4f9f-b82e-50da9394794f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:44.140238 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c2ca3-5c4f-4f9f-b82e-50da9394794f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:44.140516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c2ca3-5c4f-4f9f-b82e-50da9394794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:44.168714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e54c2ca3-5c4f-4f9f-b82e-50da9394794f None None] MFA Rules not processed for user `91f1e3d613294a8588c2ae43746899a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:44.169971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e54c2ca3-5c4f-4f9f-b82e-50da9394794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:44.238368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1366/2707] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:44 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:44.249719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e320a47-7d57-41ff-866b-d74474615ef1 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:44.251386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7e320a47-7d57-41ff-866b-d74474615ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:44.298205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:44.309474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e320a47-7d57-41ff-866b-d74474615ef1 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:44.313180 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec67a2-c6ac-4da6-ac63-89f260145939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:44.313779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec67a2-c6ac-4da6-ac63-89f260145939 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:44.314053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec67a2-c6ac-4da6-ac63-89f260145939 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:44.314317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec67a2-c6ac-4da6-ac63-89f260145939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:44.324112 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec67a2-c6ac-4da6-ac63-89f260145939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:44.325884 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec67a2-c6ac-4da6-ac63-89f260145939 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:44.335750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1342/2708] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:44 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:44.724176 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c2ca3-5c4f-4f9f-b82e-50da9394794f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:44.734625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c2ca3-5c4f-4f9f-b82e-50da9394794f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:44.738131 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eada03b-5368-4265-bd9b-d3a2dc200182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:44.738711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eada03b-5368-4265-bd9b-d3a2dc200182 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:44.738984 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eada03b-5368-4265-bd9b-d3a2dc200182 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:44.739248 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eada03b-5368-4265-bd9b-d3a2dc200182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:44.764675 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:44.795310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eada03b-5368-4265-bd9b-d3a2dc200182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:44.796743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eada03b-5368-4265-bd9b-d3a2dc200182 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:44.805310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1367/2709] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:44 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:52.520058 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec67a2-c6ac-4da6-ac63-89f260145939 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:52.582360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec67a2-c6ac-4da6-ac63-89f260145939 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:52.586939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:52.588217 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:52.588494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:52.588806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] PATH_INFO: `/v3/users/8dbf051f67f540d5a22239a64693aec5` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:52.589974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbf051f67f540d5a22239a64693aec5)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:52.594249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:52.802601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbf051f67f540d5a22239a64693aec5'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:52.810370 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbf051f67f540d5a22239a64693aec5'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:52.811199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbf051f67f540d5a22239a64693aec5'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:52.903333 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbf051f67f540d5a22239a64693aec5'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:52.916855 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbf051f67f540d5a22239a64693aec5'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:52.923161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1343/2710] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:52 2022] DELETE /identity/v3/users/8dbf051f67f540d5a22239a64693aec5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:52.927792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d2883-b46b-47cb-b1c9-fa19ac72cbcf None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:52.928340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d2883-b46b-47cb-b1c9-fa19ac72cbcf None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:52.928546 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d2883-b46b-47cb-b1c9-fa19ac72cbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:52.951997 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-379d2883-b46b-47cb-b1c9-fa19ac72cbcf None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:52.953207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-379d2883-b46b-47cb-b1c9-fa19ac72cbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:53.011188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1368/2711] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:53.020807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:53.022197 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:53.079019 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ea5d5-6cc7-4a1d-b2df-291e1bceeade admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:53.082755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c625b7a-101f-4eff-a6d4-c730099b9b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:53.083362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c625b7a-101f-4eff-a6d4-c730099b9b11 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:53.083636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c625b7a-101f-4eff-a6d4-c730099b9b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:53.083903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c625b7a-101f-4eff-a6d4-c730099b9b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:53.093478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c625b7a-101f-4eff-a6d4-c730099b9b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:53.094899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c625b7a-101f-4eff-a6d4-c730099b9b11 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:53.105128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1344/2712] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:41:53.846828 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d2883-b46b-47cb-b1c9-fa19ac72cbcf None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:53.848433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-379d2883-b46b-47cb-b1c9-fa19ac72cbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:53.877073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d2883-b46b-47cb-b1c9-fa19ac72cbcf None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:53.886179 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:53.886833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:53.887111 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:53.887422 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] PATH_INFO: `/v3/projects/ada04e9d068343e38ca82b4215b9d8b8` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:53.897239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada04e9d068343e38ca82b4215b9d8b8)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:53.897239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:54.018535 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada04e9d068343e38ca82b4215b9d8b8', 'request_id': 'req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:54.024225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada04e9d068343e38ca82b4215b9d8b8', 'request_id': 'req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:54.149394 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada04e9d068343e38ca82b4215b9d8b8', 'request_id': 'req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:54.165501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] The token cache is being invalidate because project ada04e9d068343e38ca82b4215b9d8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:54.165974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:54.166709 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:54.168520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1369/2713] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:53 2022] DELETE /identity/v3/projects/ada04e9d068343e38ca82b4215b9d8b8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:54.173683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c625b7a-101f-4eff-a6d4-c730099b9b11 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:54.185381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c625b7a-101f-4eff-a6d4-c730099b9b11 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:54.190335 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:54.243618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:54.244284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:54.244596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:54.244835 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] PATH_INFO: `/v3/users/91f1e3d613294a8588c2ae43746899a3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:54.245966 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f1e3d613294a8588c2ae43746899a3)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:54.247902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:54.335624 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:54.337461 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:54.404925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:54.427470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8a9a0-bdc5-49f8-a74e-44ec3d75c555 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:54.433316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd9048-9398-4f6d-b156-957e2b25a9d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:54.433780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9048-9398-4f6d-b156-957e2b25a9d9 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:54.434055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9048-9398-4f6d-b156-957e2b25a9d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:54.434323 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9048-9398-4f6d-b156-957e2b25a9d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:54.436050 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-39cd9048-9398-4f6d-b156-957e2b25a9d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:54.448266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd9048-9398-4f6d-b156-957e2b25a9d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:54.449907 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd9048-9398-4f6d-b156-957e2b25a9d9 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:54.459851 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1370/2714] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:41:54.563797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f1e3d613294a8588c2ae43746899a3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:54.574210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f1e3d613294a8588c2ae43746899a3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:54.575572 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f1e3d613294a8588c2ae43746899a3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:54.657771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f1e3d613294a8588c2ae43746899a3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:54.671404 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f1e3d613294a8588c2ae43746899a3'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:54.677696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1345/2715] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:54 2022] DELETE /identity/v3/users/91f1e3d613294a8588c2ae43746899a3 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:55.394182 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd9048-9398-4f6d-b156-957e2b25a9d9 service placement] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:55.395697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-39cd9048-9398-4f6d-b156-957e2b25a9d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:55.411738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd9048-9398-4f6d-b156-957e2b25a9d9 service placement] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:55.466236 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c71010-aae6-414b-a719-54e84a8c2d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:55.466816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c71010-aae6-414b-a719-54e84a8c2d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:55.467097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c71010-aae6-414b-a719-54e84a8c2d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:55.467397 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c71010-aae6-414b-a719-54e84a8c2d80 admin admin] PATH_INFO: `/v3/users/8b56e921832b460b9c6ece874065227a` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:55.468627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c71010-aae6-414b-a719-54e84a8c2d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b56e921832b460b9c6ece874065227a)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:55.470666 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c71010-aae6-414b-a719-54e84a8c2d80 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:55.489290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:55.491330 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:55.511248 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbeff37-68f1-4b44-8b61-e4113ff8d224 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:55.516015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc40ec-11d5-4eb0-8869-92aeaa969714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:55.516705 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc40ec-11d5-4eb0-8869-92aeaa969714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:55.516917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc40ec-11d5-4eb0-8869-92aeaa969714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:55.517290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc40ec-11d5-4eb0-8869-92aeaa969714 admin admin] PATH_INFO: `/v3/projects/dc80fcb19d91426684a64b049bb05101` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:55.518473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc40ec-11d5-4eb0-8869-92aeaa969714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc80fcb19d91426684a64b049bb05101)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:55.520438 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc40ec-11d5-4eb0-8869-92aeaa969714 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:55.679338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-33c71010-aae6-414b-a719-54e84a8c2d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b56e921832b460b9c6ece874065227a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:55.679532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-71cc40ec-11d5-4eb0-8869-92aeaa969714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc80fcb19d91426684a64b049bb05101', 'request_id': 'req-71cc40ec-11d5-4eb0-8869-92aeaa969714'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:55.686343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-71cc40ec-11d5-4eb0-8869-92aeaa969714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc80fcb19d91426684a64b049bb05101', 'request_id': 'req-71cc40ec-11d5-4eb0-8869-92aeaa969714'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:55.687505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-33c71010-aae6-414b-a719-54e84a8c2d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b56e921832b460b9c6ece874065227a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:55.688208 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-33c71010-aae6-414b-a719-54e84a8c2d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b56e921832b460b9c6ece874065227a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:55.688872 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-33c71010-aae6-414b-a719-54e84a8c2d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b56e921832b460b9c6ece874065227a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:55.693405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-71cc40ec-11d5-4eb0-8869-92aeaa969714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc80fcb19d91426684a64b049bb05101', 'request_id': 'req-71cc40ec-11d5-4eb0-8869-92aeaa969714'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:55.812040 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-33c71010-aae6-414b-a719-54e84a8c2d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b56e921832b460b9c6ece874065227a'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:55.829837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1371/2716] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:55 2022] DELETE /identity/v3/users/8b56e921832b460b9c6ece874065227a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:41:55.892081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-71cc40ec-11d5-4eb0-8869-92aeaa969714 admin admin] The token cache is being invalidate because project dc80fcb19d91426684a64b049bb05101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:55.898995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-71cc40ec-11d5-4eb0-8869-92aeaa969714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:55.898995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-71cc40ec-11d5-4eb0-8869-92aeaa969714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:55.898995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1346/2717] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:55 2022] DELETE /identity/v3/projects/dc80fcb19d91426684a64b049bb05101 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:55.903384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da27e5-5ea1-4c0e-ab4a-da32e2b9346c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:55.903672 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da27e5-5ea1-4c0e-ab4a-da32e2b9346c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:55.903964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da27e5-5ea1-4c0e-ab4a-da32e2b9346c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:55.935927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-48da27e5-5ea1-4c0e-ab4a-da32e2b9346c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:55.935927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-48da27e5-5ea1-4c0e-ab4a-da32e2b9346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:55.988010 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:55.998587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1372/2718] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:56.006614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f443ad-ddf4-4693-9b36-87bc69ad3d79 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:56.006898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f443ad-ddf4-4693-9b36-87bc69ad3d79 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:56.007169 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f443ad-ddf4-4693-9b36-87bc69ad3d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:56.028906 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-87f443ad-ddf4-4693-9b36-87bc69ad3d79 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:56.030090 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-87f443ad-ddf4-4693-9b36-87bc69ad3d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:56.038081 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1347/2719] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:56.042900 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da27e5-5ea1-4c0e-ab4a-da32e2b9346c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:56.052643 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da27e5-5ea1-4c0e-ab4a-da32e2b9346c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:56.057507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fee4c-4b65-402d-91a6-3495d0cff1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:56.058107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fee4c-4b65-402d-91a6-3495d0cff1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:56.058385 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fee4c-4b65-402d-91a6-3495d0cff1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:56.058658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fee4c-4b65-402d-91a6-3495d0cff1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:56.059302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fee4c-4b65-402d-91a6-3495d0cff1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:41:56.059607 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fee4c-4b65-402d-91a6-3495d0cff1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:56.061219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fee4c-4b65-402d-91a6-3495d0cff1eb admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:56.073457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1373/2720] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:41:56.078329 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f443ad-ddf4-4693-9b36-87bc69ad3d79 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:56.085119 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:56.091547 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fee4c-4b65-402d-91a6-3495d0cff1eb admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:56.092785 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f443ad-ddf4-4693-9b36-87bc69ad3d79 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:56.094832 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5f1fee4c-4b65-402d-91a6-3495d0cff1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:56.097776 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075957a2-3b3c-40a4-b8c5-5d4ee17ef1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:56.098391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075957a2-3b3c-40a4-b8c5-5d4ee17ef1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:56.098668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075957a2-3b3c-40a4-b8c5-5d4ee17ef1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:56.098939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075957a2-3b3c-40a4-b8c5-5d4ee17ef1d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:56.099631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075957a2-3b3c-40a4-b8c5-5d4ee17ef1d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:56.101740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075957a2-3b3c-40a4-b8c5-5d4ee17ef1d7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:56.127932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fee4c-4b65-402d-91a6-3495d0cff1eb admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:56.132662 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:56.133384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:56.133664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:56.134465 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] PATH_INFO: `/v3/projects/263198abba134024b5e9d008c1e2eb40` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:56.135662 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263198abba134024b5e9d008c1e2eb40)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:56.137564 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:56.214711 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1348/2721] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:56 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:56.218778 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075957a2-3b3c-40a4-b8c5-5d4ee17ef1d7 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:56.258591 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263198abba134024b5e9d008c1e2eb40', 'request_id': 'req-2df19376-b9e2-4ac9-871a-cac9edd14c13'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:56.264456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263198abba134024b5e9d008c1e2eb40', 'request_id': 'req-2df19376-b9e2-4ac9-871a-cac9edd14c13'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:56.278886 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075957a2-3b3c-40a4-b8c5-5d4ee17ef1d7 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:56.333374 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b035c88-f480-4b0e-8975-df1776b5e01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:56.333987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b035c88-f480-4b0e-8975-df1776b5e01a admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:56.334270 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b035c88-f480-4b0e-8975-df1776b5e01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:56.334540 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b035c88-f480-4b0e-8975-df1776b5e01a admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:56.335162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b035c88-f480-4b0e-8975-df1776b5e01a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:56.337898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b035c88-f480-4b0e-8975-df1776b5e01a admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:56.343141 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263198abba134024b5e9d008c1e2eb40', 'request_id': 'req-2df19376-b9e2-4ac9-871a-cac9edd14c13'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:56.355908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] The token cache is being invalidate because project 263198abba134024b5e9d008c1e2eb40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:56.356228 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:56.356876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:56.358363 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1374/2722] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:56 2022] DELETE /identity/v3/projects/263198abba134024b5e9d008c1e2eb40 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:56.362188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:56.363458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:56.375611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df19376-b9e2-4ac9-871a-cac9edd14c13 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:56.380280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:56.380877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:56.381153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:56.381418 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] PATH_INFO: `/v3/users/3ce9ebe99e7c45488915ceb1f462eb36` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:56.382608 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce9ebe99e7c45488915ceb1f462eb36)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:56.385047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:56.440773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1349/2723] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:56 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:41:56.445072 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b035c88-f480-4b0e-8975-df1776b5e01a admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:56.447240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8b035c88-f480-4b0e-8975-df1776b5e01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:56.459017 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b035c88-f480-4b0e-8975-df1776b5e01a admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:56.464308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2c8e6-5d0e-43a7-9fa2-1b434cac5e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:56.464892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2c8e6-5d0e-43a7-9fa2-1b434cac5e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:56.465170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2c8e6-5d0e-43a7-9fa2-1b434cac5e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:56.465440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2c8e6-5d0e-43a7-9fa2-1b434cac5e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:56.466073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2c8e6-5d0e-43a7-9fa2-1b434cac5e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:56.467766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2c8e6-5d0e-43a7-9fa2-1b434cac5e49 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:56.478042 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1350/2724] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:41:56.482127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2c8e6-5d0e-43a7-9fa2-1b434cac5e49 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:56.491557 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2c8e6-5d0e-43a7-9fa2-1b434cac5e49 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:56.496909 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0d1a5-89c5-438f-a5d6-8d73b309fcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:56.497478 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d1a5-89c5-438f-a5d6-8d73b309fcbb admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:56.497753 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d1a5-89c5-438f-a5d6-8d73b309fcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:56.498021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d1a5-89c5-438f-a5d6-8d73b309fcbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:56.498722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0d1a5-89c5-438f-a5d6-8d73b309fcbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:56.500336 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0d1a5-89c5-438f-a5d6-8d73b309fcbb admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:56.512563 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1351/2725] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:56.517616 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0d1a5-89c5-438f-a5d6-8d73b309fcbb admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:56.530023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0d1a5-89c5-438f-a5d6-8d73b309fcbb admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:56.537863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1618-6d53-49d1-9df5-091ea0d919dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:56.538548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1618-6d53-49d1-9df5-091ea0d919dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:56.538970 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1618-6d53-49d1-9df5-091ea0d919dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:56.539246 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1618-6d53-49d1-9df5-091ea0d919dd admin admin] PATH_INFO: `/v3/projects/345c75eba756443b90ad86b9a17df5e0/users/84f4a3a386164121b1ca978bc7343fd8/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:56.554290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f1618-6d53-49d1-9df5-091ea0d919dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=345c75eba756443b90ad86b9a17df5e0, user_id=84f4a3a386164121b1ca978bc7343fd8, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:56.557559 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f1618-6d53-49d1-9df5-091ea0d919dd admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:56.581501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce9ebe99e7c45488915ceb1f462eb36'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:56.589796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce9ebe99e7c45488915ceb1f462eb36'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:56.590479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce9ebe99e7c45488915ceb1f462eb36'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:56.591173 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce9ebe99e7c45488915ceb1f462eb36'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:56.629013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1352/2726] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:56 2022] PUT /identity/v3/projects/345c75eba756443b90ad86b9a17df5e0/users/84f4a3a386164121b1ca978bc7343fd8/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:41:56.641237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33378efd-85a1-4b74-9a79-32fa8a85d05d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:56.641709 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33378efd-85a1-4b74-9a79-32fa8a85d05d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:56.642056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33378efd-85a1-4b74-9a79-32fa8a85d05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:56.671298 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-33378efd-85a1-4b74-9a79-32fa8a85d05d None None] MFA Rules not processed for user `84f4a3a386164121b1ca978bc7343fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:56.672576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-33378efd-85a1-4b74-9a79-32fa8a85d05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:56.686038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce9ebe99e7c45488915ceb1f462eb36'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:56.705252 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1375/2727] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:41:56 2022] DELETE /identity/v3/users/3ce9ebe99e7c45488915ceb1f462eb36 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:41:56.738821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1353/2728] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:41:56.744148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:56.745331 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:56.793125 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:56.812160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182e710-11c2-44a8-a4fc-f851e21751fe admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:56.813262 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:56.816968 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4d6f5-1998-4be8-b61c-fa4af4a92955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:56.820410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4d6f5-1998-4be8-b61c-fa4af4a92955 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:56.820410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4d6f5-1998-4be8-b61c-fa4af4a92955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:56.820410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4d6f5-1998-4be8-b61c-fa4af4a92955 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:56.820410 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4d6f5-1998-4be8-b61c-fa4af4a92955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:56.820797 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4d6f5-1998-4be8-b61c-fa4af4a92955 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:56.928125 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1376/2729] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:56 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:56.932798 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33378efd-85a1-4b74-9a79-32fa8a85d05d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:56.951861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4d6f5-1998-4be8-b61c-fa4af4a92955 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:56.957435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-33e4d6f5-1998-4be8-b61c-fa4af4a92955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:57.003273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33378efd-85a1-4b74-9a79-32fa8a85d05d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.026957 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4d6f5-1998-4be8-b61c-fa4af4a92955 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.031670 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.032329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.032610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.032883 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1 admin admin] PATH_INFO: `/v3/projects/7486c9a81df841e89a53f5704e995562` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.034121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7486c9a81df841e89a53f5704e995562)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.036059 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:57.060664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95316e-d21e-4be9-97d5-83c7bc10e2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.061191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95316e-d21e-4be9-97d5-83c7bc10e2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.061530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95316e-d21e-4be9-97d5-83c7bc10e2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.061793 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95316e-d21e-4be9-97d5-83c7bc10e2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.062580 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95316e-d21e-4be9-97d5-83c7bc10e2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.064514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95316e-d21e-4be9-97d5-83c7bc10e2f0 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:57.235770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1354/2730] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:56 2022] POST /identity/v3/users => generated 288 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:57.239926 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95316e-d21e-4be9-97d5-83c7bc10e2f0 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:57.247931 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7486c9a81df841e89a53f5704e995562', 'request_id': 'req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:57.250287 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95316e-d21e-4be9-97d5-83c7bc10e2f0 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.253538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7486c9a81df841e89a53f5704e995562', 'request_id': 'req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:57.306405 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa17de9-a551-4e95-b920-f79f11f76ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.307014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa17de9-a551-4e95-b920-f79f11f76ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.307295 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa17de9-a551-4e95-b920-f79f11f76ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.307569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa17de9-a551-4e95-b920-f79f11f76ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.308257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa17de9-a551-4e95-b920-f79f11f76ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.310013 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa17de9-a551-4e95-b920-f79f11f76ff0 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:57.311307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:57.320251 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1355/2731] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:57.324162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa17de9-a551-4e95-b920-f79f11f76ff0 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:57.331647 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7486c9a81df841e89a53f5704e995562', 'request_id': 'req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:57.336493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa17de9-a551-4e95-b920-f79f11f76ff0 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.338960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df009-dc6b-4de4-ae12-36e7dac9ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.339550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df009-dc6b-4de4-ae12-36e7dac9ae7a admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.339890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df009-dc6b-4de4-ae12-36e7dac9ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.340188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df009-dc6b-4de4-ae12-36e7dac9ae7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.340820 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7df009-dc6b-4de4-ae12-36e7dac9ae7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.342421 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7df009-dc6b-4de4-ae12-36e7dac9ae7a admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:57.344951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1 admin admin] The token cache is being invalidate because project 7486c9a81df841e89a53f5704e995562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:41:57.345246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:57.345913 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-224ab5e9-3293-4398-a696-d2f1e1fe1fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:41:57.347409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1377/2732] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:41:56 2022] DELETE /identity/v3/projects/7486c9a81df841e89a53f5704e995562 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:57.352241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fca2ea-0614-47d6-8ff0-cd5615587b43 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.353335 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fca2ea-0614-47d6-8ff0-cd5615587b43 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.353676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fca2ea-0614-47d6-8ff0-cd5615587b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.358452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1356/2733] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:41:57.359407 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df009-dc6b-4de4-ae12-36e7dac9ae7a admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:57.361198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5b7df009-dc6b-4de4-ae12-36e7dac9ae7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:57.373474 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f6fca2ea-0614-47d6-8ff0-cd5615587b43 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:57.373636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df009-dc6b-4de4-ae12-36e7dac9ae7a admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.374676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f6fca2ea-0614-47d6-8ff0-cd5615587b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:57.378018 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d149b-455c-440a-9a59-eb4b73ba7929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.378648 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d149b-455c-440a-9a59-eb4b73ba7929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.378918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d149b-455c-440a-9a59-eb4b73ba7929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.379182 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d149b-455c-440a-9a59-eb4b73ba7929 admin admin] PATH_INFO: `/v3/projects/60fe5f06dc224ecea339db494bd50710/users/07674758d85d42ecbf8080d5adcec962/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.382638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1378/2734] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:41:57.390240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d379c1a-901a-4c46-a682-a133a7fb6aea None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.390529 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d379c1a-901a-4c46-a682-a133a7fb6aea None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.390804 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d379c1a-901a-4c46-a682-a133a7fb6aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.394789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d149b-455c-440a-9a59-eb4b73ba7929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fe5f06dc224ecea339db494bd50710, user_id=07674758d85d42ecbf8080d5adcec962, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.400050 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d149b-455c-440a-9a59-eb4b73ba7929 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:57.410430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3d379c1a-901a-4c46-a682-a133a7fb6aea None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:57.411632 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3d379c1a-901a-4c46-a682-a133a7fb6aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:57.419565 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1379/2735] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:41:57.423684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d379c1a-901a-4c46-a682-a133a7fb6aea None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:57.433027 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d379c1a-901a-4c46-a682-a133a7fb6aea None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.437711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bbd8e-40ca-47f4-aa09-59e4274b494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.438278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bbd8e-40ca-47f4-aa09-59e4274b494d admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.438558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bbd8e-40ca-47f4-aa09-59e4274b494d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.438831 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bbd8e-40ca-47f4-aa09-59e4274b494d admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.439462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bbd8e-40ca-47f4-aa09-59e4274b494d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:41:57.439765 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bbd8e-40ca-47f4-aa09-59e4274b494d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.441369 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bbd8e-40ca-47f4-aa09-59e4274b494d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:57.453415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1380/2736] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:41:57.457780 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bbd8e-40ca-47f4-aa09-59e4274b494d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:57.467216 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bbd8e-40ca-47f4-aa09-59e4274b494d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.471767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84849d8-25e9-490e-86e4-dce709177b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.472351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84849d8-25e9-490e-86e4-dce709177b00 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.472742 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84849d8-25e9-490e-86e4-dce709177b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.473024 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84849d8-25e9-490e-86e4-dce709177b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.473629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84849d8-25e9-490e-86e4-dce709177b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.475445 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84849d8-25e9-490e-86e4-dce709177b00 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:57.486605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1357/2737] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:57 2022] PUT /identity/v3/projects/60fe5f06dc224ecea339db494bd50710/users/07674758d85d42ecbf8080d5adcec962/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:41:57.497114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a537ae-7b1d-46a1-a9c0-3fd753f8b07d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.501352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a537ae-7b1d-46a1-a9c0-3fd753f8b07d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.501352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a537ae-7b1d-46a1-a9c0-3fd753f8b07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.525898 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-26a537ae-7b1d-46a1-a9c0-3fd753f8b07d None None] MFA Rules not processed for user `07674758d85d42ecbf8080d5adcec962`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:57.527165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-26a537ae-7b1d-46a1-a9c0-3fd753f8b07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:57.589391 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1358/2738] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:57.593713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a537ae-7b1d-46a1-a9c0-3fd753f8b07d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:57.608912 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1381/2739] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:57 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:41:57.613739 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84849d8-25e9-490e-86e4-dce709177b00 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:57.625374 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:57.656773 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a537ae-7b1d-46a1-a9c0-3fd753f8b07d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.676077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84849d8-25e9-490e-86e4-dce709177b00 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.682181 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61a21-4f61-4ad6-a1f8-e465b4edfe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.682771 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61a21-4f61-4ad6-a1f8-e465b4edfe0b admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.683081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61a21-4f61-4ad6-a1f8-e465b4edfe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.683354 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61a21-4f61-4ad6-a1f8-e465b4edfe0b admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.684014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff61a21-4f61-4ad6-a1f8-e465b4edfe0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.686007 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff61a21-4f61-4ad6-a1f8-e465b4edfe0b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:57.712260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:57.718454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f434c07-a8ee-4545-a38a-a2f61b04028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.719070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f434c07-a8ee-4545-a38a-a2f61b04028d admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.719434 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f434c07-a8ee-4545-a38a-a2f61b04028d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.719714 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f434c07-a8ee-4545-a38a-a2f61b04028d admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.720373 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f434c07-a8ee-4545-a38a-a2f61b04028d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.722468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f434c07-a8ee-4545-a38a-a2f61b04028d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:57.800978 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1382/2740] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:57 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:41:57.805004 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61a21-4f61-4ad6-a1f8-e465b4edfe0b admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:57.814982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61a21-4f61-4ad6-a1f8-e465b4edfe0b admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.819935 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb21c1-2d27-4b6a-8fa9-540b68259929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.820635 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb21c1-2d27-4b6a-8fa9-540b68259929 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.820926 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb21c1-2d27-4b6a-8fa9-540b68259929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.821756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb21c1-2d27-4b6a-8fa9-540b68259929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.822707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb21c1-2d27-4b6a-8fa9-540b68259929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.824505 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb21c1-2d27-4b6a-8fa9-540b68259929 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:57.831734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1359/2741] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:41:57 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:57.836123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f434c07-a8ee-4545-a38a-a2f61b04028d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:57.836251 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1383/2742] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:41:57.840990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb21c1-2d27-4b6a-8fa9-540b68259929 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:57.851244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb21c1-2d27-4b6a-8fa9-540b68259929 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.907186 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f434c07-a8ee-4545-a38a-a2f61b04028d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.911659 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb7115-f891-4657-8f2b-142db7c25c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.912451 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451416f5-17a0-4adf-a70b-ccf4d10f27d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.912735 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb7115-f891-4657-8f2b-142db7c25c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.913165 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451416f5-17a0-4adf-a70b-ccf4d10f27d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.913330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb7115-f891-4657-8f2b-142db7c25c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.913531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451416f5-17a0-4adf-a70b-ccf4d10f27d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.913868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451416f5-17a0-4adf-a70b-ccf4d10f27d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.914686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451416f5-17a0-4adf-a70b-ccf4d10f27d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.914854 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb7115-f891-4657-8f2b-142db7c25c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.915702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb7115-f891-4657-8f2b-142db7c25c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.916986 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451416f5-17a0-4adf-a70b-ccf4d10f27d5 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:57.917939 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb7115-f891-4657-8f2b-142db7c25c07 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:57.927889 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1384/2743] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:41:57.932221 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb7115-f891-4657-8f2b-142db7c25c07 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:57.941779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb7115-f891-4657-8f2b-142db7c25c07 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:57.946880 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51085aa7-7904-405a-b04a-3dec0b064f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:57.947522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085aa7-7904-405a-b04a-3dec0b064f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:57.947802 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085aa7-7904-405a-b04a-3dec0b064f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:57.948110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085aa7-7904-405a-b04a-3dec0b064f2b admin admin] PATH_INFO: `/v3/projects/7717d1042b454b9185d1fa9992686852/users/611c4e2df78645118b4d3be3268df15f/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:57.963367 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51085aa7-7904-405a-b04a-3dec0b064f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7717d1042b454b9185d1fa9992686852, user_id=611c4e2df78645118b4d3be3268df15f, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:57.968743 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51085aa7-7904-405a-b04a-3dec0b064f2b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:58.023249 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1360/2744] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:41:57 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:41:58.027195 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451416f5-17a0-4adf-a70b-ccf4d10f27d5 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:58.036781 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451416f5-17a0-4adf-a70b-ccf4d10f27d5 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:58.041475 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcd3b3-8222-44b4-83e5-d994c2889a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:58.042074 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcd3b3-8222-44b4-83e5-d994c2889a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:58.042353 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcd3b3-8222-44b4-83e5-d994c2889a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:58.042625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcd3b3-8222-44b4-83e5-d994c2889a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:58.043257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcd3b3-8222-44b4-83e5-d994c2889a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:58.044861 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcd3b3-8222-44b4-83e5-d994c2889a7b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:58.052190 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1385/2745] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:57 2022] PUT /identity/v3/projects/7717d1042b454b9185d1fa9992686852/users/611c4e2df78645118b4d3be3268df15f/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:41:58.057344 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1361/2746] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:41:58.063085 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9edd6-dc88-4367-bec3-0c0e05eea1bd None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:58.063383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9edd6-dc88-4367-bec3-0c0e05eea1bd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:58.063664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9edd6-dc88-4367-bec3-0c0e05eea1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:58.064161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcd3b3-8222-44b4-83e5-d994c2889a7b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:58.074902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcd3b3-8222-44b4-83e5-d994c2889a7b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:58.091365 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-47c9edd6-dc88-4367-bec3-0c0e05eea1bd None None] MFA Rules not processed for user `611c4e2df78645118b4d3be3268df15f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:58.092549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-47c9edd6-dc88-4367-bec3-0c0e05eea1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:58.132682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb5026-246e-4119-b394-0b05657c58ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:58.133385 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb5026-246e-4119-b394-0b05657c58ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:58.134345 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb5026-246e-4119-b394-0b05657c58ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:58.134711 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb5026-246e-4119-b394-0b05657c58ed admin admin] PATH_INFO: `/v3/projects/38c650dd363346bf8aa6359285ee0453/users/294afca3e9bd4c18aaf66811078bb222/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:58.143039 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:58.150506 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb5026-246e-4119-b394-0b05657c58ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c650dd363346bf8aa6359285ee0453, user_id=294afca3e9bd4c18aaf66811078bb222, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:58.153238 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb5026-246e-4119-b394-0b05657c58ed admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:58.161289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1386/2747] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:58.172796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9edd6-dc88-4367-bec3-0c0e05eea1bd None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:58.174123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-47c9edd6-dc88-4367-bec3-0c0e05eea1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:58.217969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1362/2748] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:58 2022] PUT /identity/v3/projects/38c650dd363346bf8aa6359285ee0453/users/294afca3e9bd4c18aaf66811078bb222/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:58.221791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb5026-246e-4119-b394-0b05657c58ed admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:58.238468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9edd6-dc88-4367-bec3-0c0e05eea1bd None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:58.275688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:41:58.290963 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7207f-4edf-4ec4-b9dc-5bffa30c9c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:58.291220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb5026-246e-4119-b394-0b05657c58ed admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:58.291696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7207f-4edf-4ec4-b9dc-5bffa30c9c2d service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:58.292077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7207f-4edf-4ec4-b9dc-5bffa30c9c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:58.292417 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7207f-4edf-4ec4-b9dc-5bffa30c9c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:58.296163 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6da2f-5ed8-40ee-8593-c1b7404573e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:58.296842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6da2f-5ed8-40ee-8593-c1b7404573e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:58.297191 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6da2f-5ed8-40ee-8593-c1b7404573e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:58.297535 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6da2f-5ed8-40ee-8593-c1b7404573e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:58.298254 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6da2f-5ed8-40ee-8593-c1b7404573e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:58.299842 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6da2f-5ed8-40ee-8593-c1b7404573e0 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:58.314207 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1363/2749] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:41:58.315377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6da2f-5ed8-40ee-8593-c1b7404573e0 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:58.325806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6da2f-5ed8-40ee-8593-c1b7404573e0 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:58.331224 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b5516-967a-4aa6-ad79-df3470f680e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:58.334384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b5516-967a-4aa6-ad79-df3470f680e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:58.334384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b5516-967a-4aa6-ad79-df3470f680e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:58.334384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b5516-967a-4aa6-ad79-df3470f680e3 admin admin] PATH_INFO: `/v3/projects/38c650dd363346bf8aa6359285ee0453/users/294afca3e9bd4c18aaf66811078bb222/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:58.334860 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b5516-967a-4aa6-ad79-df3470f680e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c650dd363346bf8aa6359285ee0453, user_id=294afca3e9bd4c18aaf66811078bb222, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:58.337656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b5516-967a-4aa6-ad79-df3470f680e3 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:58.349674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1364/2750] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:41:58 2022] PUT /identity/v3/projects/38c650dd363346bf8aa6359285ee0453/users/294afca3e9bd4c18aaf66811078bb222/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:41:58.358518 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7207f-4edf-4ec4-b9dc-5bffa30c9c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:58.360808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7207f-4edf-4ec4-b9dc-5bffa30c9c2d service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:58.361937 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371742c-9a11-447f-bc49-551d79e9a02c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:58.362677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371742c-9a11-447f-bc49-551d79e9a02c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:58.364509 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371742c-9a11-447f-bc49-551d79e9a02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:58.371320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1387/2751] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:41:58.394740 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a371742c-9a11-447f-bc49-551d79e9a02c None None] MFA Rules not processed for user `294afca3e9bd4c18aaf66811078bb222`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:41:58.395974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a371742c-9a11-447f-bc49-551d79e9a02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:58.472626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1365/2752] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:41:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:41:58.485060 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7207f-4edf-4ec4-b9dc-5bffa30c9c2d service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:58.487974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a5f7207f-4edf-4ec4-b9dc-5bffa30c9c2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:58.497425 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7207f-4edf-4ec4-b9dc-5bffa30c9c2d service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:58.555223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc87a9a-c067-49df-83df-511775e7277c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:58.555859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc87a9a-c067-49df-83df-511775e7277c service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:58.556172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc87a9a-c067-49df-83df-511775e7277c service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:58.556439 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc87a9a-c067-49df-83df-511775e7277c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:58.565999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc87a9a-c067-49df-83df-511775e7277c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:58.567430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc87a9a-c067-49df-83df-511775e7277c service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:58.578013 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1388/2753] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:41:58.694969 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371742c-9a11-447f-bc49-551d79e9a02c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:41:58.705810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371742c-9a11-447f-bc49-551d79e9a02c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:41:58.709620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca5fd-7337-49f1-9207-507012c612fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:41:58.714198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca5fd-7337-49f1-9207-507012c612fa service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:41:58.714198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca5fd-7337-49f1-9207-507012c612fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:41:58.714198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca5fd-7337-49f1-9207-507012c612fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:41:58.714198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-64cca5fd-7337-49f1-9207-507012c612fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:41:58.776890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cca5fd-7337-49f1-9207-507012c612fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:41:58.783202 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cca5fd-7337-49f1-9207-507012c612fa service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:41:58.787293 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1366/2754] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:41:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:42:03.214974 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc87a9a-c067-49df-83df-511775e7277c service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:03.219147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:03.276307 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc87a9a-c067-49df-83df-511775e7277c service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:03.280910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:03.281679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:03.281967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:03.282244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] PATH_INFO: `/v3/users/84f4a3a386164121b1ca978bc7343fd8` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:03.283368 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f4a3a386164121b1ca978bc7343fd8)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:03.285338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:03.500320 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f4a3a386164121b1ca978bc7343fd8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:03.507230 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f4a3a386164121b1ca978bc7343fd8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:03.507934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f4a3a386164121b1ca978bc7343fd8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:03.508567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f4a3a386164121b1ca978bc7343fd8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:03.572859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f4a3a386164121b1ca978bc7343fd8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:03.590899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1389/2755] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:42:03 2022] DELETE /identity/v3/users/84f4a3a386164121b1ca978bc7343fd8 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:03.595427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b13e5c-00a1-4fff-9e73-b34d10873392 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:03.595975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b13e5c-00a1-4fff-9e73-b34d10873392 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:03.595975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b13e5c-00a1-4fff-9e73-b34d10873392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:03.615518 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-06b13e5c-00a1-4fff-9e73-b34d10873392 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:03.616779 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-06b13e5c-00a1-4fff-9e73-b34d10873392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:03.660957 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:03.680260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1367/2756] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:03.695058 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:03.696549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:03.757597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e2cbd-ae37-4704-889b-b89a666380f4 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:03.761468 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609aba8-d3fe-4c00-9c72-6373f5839881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:03.762072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609aba8-d3fe-4c00-9c72-6373f5839881 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:03.762347 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609aba8-d3fe-4c00-9c72-6373f5839881 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:03.762637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609aba8-d3fe-4c00-9c72-6373f5839881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:03.779471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609aba8-d3fe-4c00-9c72-6373f5839881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:03.779471 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609aba8-d3fe-4c00-9c72-6373f5839881 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:03.783573 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1390/2757] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:42:04.512756 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b13e5c-00a1-4fff-9e73-b34d10873392 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:04.515823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-06b13e5c-00a1-4fff-9e73-b34d10873392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:04.527315 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b13e5c-00a1-4fff-9e73-b34d10873392 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:04.531844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb550-1093-42b1-8707-4855954be356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:04.533045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb550-1093-42b1-8707-4855954be356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:04.533045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb550-1093-42b1-8707-4855954be356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:04.533045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb550-1093-42b1-8707-4855954be356 admin admin] PATH_INFO: `/v3/projects/345c75eba756443b90ad86b9a17df5e0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:04.534151 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb550-1093-42b1-8707-4855954be356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=345c75eba756443b90ad86b9a17df5e0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:04.536066 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb550-1093-42b1-8707-4855954be356 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:04.642761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ad9bb550-1093-42b1-8707-4855954be356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '345c75eba756443b90ad86b9a17df5e0', 'request_id': 'req-ad9bb550-1093-42b1-8707-4855954be356'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:04.648629 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ad9bb550-1093-42b1-8707-4855954be356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '345c75eba756443b90ad86b9a17df5e0', 'request_id': 'req-ad9bb550-1093-42b1-8707-4855954be356'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:04.655626 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ad9bb550-1093-42b1-8707-4855954be356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '345c75eba756443b90ad86b9a17df5e0', 'request_id': 'req-ad9bb550-1093-42b1-8707-4855954be356'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:04.742596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ad9bb550-1093-42b1-8707-4855954be356 admin admin] The token cache is being invalidate because project 345c75eba756443b90ad86b9a17df5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:42:04.742925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ad9bb550-1093-42b1-8707-4855954be356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:04.743606 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-ad9bb550-1093-42b1-8707-4855954be356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:04.745676 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1368/2758] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:42:04 2022] DELETE /identity/v3/projects/345c75eba756443b90ad86b9a17df5e0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:04.749734 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609aba8-d3fe-4c00-9c72-6373f5839881 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:04.760360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609aba8-d3fe-4c00-9c72-6373f5839881 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:04.785579 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:04.825746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:04.826297 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:04.826577 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:04.826849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] PATH_INFO: `/v3/users/07674758d85d42ecbf8080d5adcec962` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:04.828001 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07674758d85d42ecbf8080d5adcec962)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:04.829952 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:04.927392 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c960231-2cdf-427e-b2e5-96c9c2438a42 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:04.927674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c960231-2cdf-427e-b2e5-96c9c2438a42 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:04.927989 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c960231-2cdf-427e-b2e5-96c9c2438a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:04.948816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-2c960231-2cdf-427e-b2e5-96c9c2438a42 None None] MFA Rules not processed for user `7d0fa8beb6954a5d8662e581345e2a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:04.950080 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2c960231-2cdf-427e-b2e5-96c9c2438a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:05.005303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1369/2759] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:42:05.055168 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07674758d85d42ecbf8080d5adcec962'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:05.062860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07674758d85d42ecbf8080d5adcec962'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:05.063566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07674758d85d42ecbf8080d5adcec962'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:05.064210 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07674758d85d42ecbf8080d5adcec962'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:05.217166 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07674758d85d42ecbf8080d5adcec962'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:05.236711 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1391/2760] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:42:04 2022] DELETE /identity/v3/users/07674758d85d42ecbf8080d5adcec962 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:05.716805 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c960231-2cdf-427e-b2e5-96c9c2438a42 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:05.718815 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2c960231-2cdf-427e-b2e5-96c9c2438a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:05.736250 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c960231-2cdf-427e-b2e5-96c9c2438a42 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:05.800840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:05.801512 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:05.801791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:05.802180 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] PATH_INFO: `/v3/projects/60fe5f06dc224ecea339db494bd50710` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:05.803337 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fe5f06dc224ecea339db494bd50710)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:05.805316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:05.834833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:05.939279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fe5f06dc224ecea339db494bd50710', 'request_id': 'req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:05.944905 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fe5f06dc224ecea339db494bd50710', 'request_id': 'req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:05.951853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fe5f06dc224ecea339db494bd50710', 'request_id': 'req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:06.063789 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] The token cache is being invalidate because project 60fe5f06dc224ecea339db494bd50710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:42:06.064120 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:06.064767 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:06.066386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1370/2761] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:42:05 2022] DELETE /identity/v3/projects/60fe5f06dc224ecea339db494bd50710 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:06.070356 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:06.072408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:06.086266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa075f5-a5db-49b7-9d52-2ac4959e5126 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:06.143355 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b776ca4-4583-4c97-ad96-06abb46ee56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:06.144014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776ca4-4583-4c97-ad96-06abb46ee56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:06.144294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776ca4-4583-4c97-ad96-06abb46ee56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:06.144563 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776ca4-4583-4c97-ad96-06abb46ee56b admin admin] PATH_INFO: `/v3/users/294afca3e9bd4c18aaf66811078bb222` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:06.145671 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b776ca4-4583-4c97-ad96-06abb46ee56b admin admin] RBAC: Authorizing `identity:delete_user(user_id=294afca3e9bd4c18aaf66811078bb222)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:06.147549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b776ca4-4583-4c97-ad96-06abb46ee56b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:06.413676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:06.416409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3b776ca4-4583-4c97-ad96-06abb46ee56b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294afca3e9bd4c18aaf66811078bb222'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:06.427087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3b776ca4-4583-4c97-ad96-06abb46ee56b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294afca3e9bd4c18aaf66811078bb222'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:06.427763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3b776ca4-4583-4c97-ad96-06abb46ee56b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294afca3e9bd4c18aaf66811078bb222'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:06.428408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3b776ca4-4583-4c97-ad96-06abb46ee56b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294afca3e9bd4c18aaf66811078bb222'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:06.546299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-3b776ca4-4583-4c97-ad96-06abb46ee56b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294afca3e9bd4c18aaf66811078bb222'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:06.567231 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1392/2762] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:42:06 2022] DELETE /identity/v3/users/294afca3e9bd4c18aaf66811078bb222 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:42:06.980715 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:06.982227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:06.997435 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd034d-7712-4cb5-a09b-f3c2da1f5353 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:07.063279 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:07.063911 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:07.064221 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:07.064491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243 admin admin] PATH_INFO: `/v3/projects/38c650dd363346bf8aa6359285ee0453` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:07.065592 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c650dd363346bf8aa6359285ee0453)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:07.067529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:07.219296 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c650dd363346bf8aa6359285ee0453', 'request_id': 'req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:07.225111 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c650dd363346bf8aa6359285ee0453', 'request_id': 'req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:07.233220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c650dd363346bf8aa6359285ee0453', 'request_id': 'req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:07.302319 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243 admin admin] The token cache is being invalidate because project 38c650dd363346bf8aa6359285ee0453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:42:07.302605 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:07.303212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c0f5c762-4d36-4f13-b9ca-2cc7a50c2243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:07.304724 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1371/2763] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:42:06 2022] DELETE /identity/v3/projects/38c650dd363346bf8aa6359285ee0453 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:42:07.310874 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98908-10f0-45a8-8373-11203b5c8872 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:07.311366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98908-10f0-45a8-8373-11203b5c8872 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:07.311475 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98908-10f0-45a8-8373-11203b5c8872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:07.331915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-25b98908-10f0-45a8-8373-11203b5c8872 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:07.333137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-25b98908-10f0-45a8-8373-11203b5c8872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:07.394207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1393/2764] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:07.460560 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f1ad0-3c1b-4e85-bd52-68e89aee654a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:07.460774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f1ad0-3c1b-4e85-bd52-68e89aee654a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:07.461029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f1ad0-3c1b-4e85-bd52-68e89aee654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:07.481982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-812f1ad0-3c1b-4e85-bd52-68e89aee654a None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:07.483174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-812f1ad0-3c1b-4e85-bd52-68e89aee654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:07.491158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1372/2765] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:07.496079 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b98908-10f0-45a8-8373-11203b5c8872 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:07.505509 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b98908-10f0-45a8-8373-11203b5c8872 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:07.510788 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb4d84-303a-4ca5-94cb-a5251609e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:07.511374 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb4d84-303a-4ca5-94cb-a5251609e281 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:07.511648 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb4d84-303a-4ca5-94cb-a5251609e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:07.511914 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb4d84-303a-4ca5-94cb-a5251609e281 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:07.512588 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb4d84-303a-4ca5-94cb-a5251609e281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:42:07.512886 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb4d84-303a-4ca5-94cb-a5251609e281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:07.514437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb4d84-303a-4ca5-94cb-a5251609e281 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:07.529493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1394/2766] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:42:07.535208 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f1ad0-3c1b-4e85-bd52-68e89aee654a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:07.543381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f1ad0-3c1b-4e85-bd52-68e89aee654a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:07.548303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5fcfd-b21f-4c3f-b688-bb50dd00ca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:07.548896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5fcfd-b21f-4c3f-b688-bb50dd00ca00 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:07.549175 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5fcfd-b21f-4c3f-b688-bb50dd00ca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:07.549445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5fcfd-b21f-4c3f-b688-bb50dd00ca00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:07.550077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5fcfd-b21f-4c3f-b688-bb50dd00ca00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:07.551985 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5fcfd-b21f-4c3f-b688-bb50dd00ca00 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:07.664361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1373/2767] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:42:07 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:42:07.668478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb4d84-303a-4ca5-94cb-a5251609e281 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:07.678287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb4d84-303a-4ca5-94cb-a5251609e281 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:07.733629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214bdf0-39bd-4f71-b95d-406eb6ec9a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:07.734157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214bdf0-39bd-4f71-b95d-406eb6ec9a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:07.734429 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214bdf0-39bd-4f71-b95d-406eb6ec9a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:07.734698 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214bdf0-39bd-4f71-b95d-406eb6ec9a9a admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:07.735312 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214bdf0-39bd-4f71-b95d-406eb6ec9a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:07.737215 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214bdf0-39bd-4f71-b95d-406eb6ec9a9a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:07.840399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1395/2768] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:42:07 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:42:07.844618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5fcfd-b21f-4c3f-b688-bb50dd00ca00 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:07.855123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5fcfd-b21f-4c3f-b688-bb50dd00ca00 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:07.859913 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f2bd9-e576-4195-a146-f8d05fe1e83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:07.865817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f2bd9-e576-4195-a146-f8d05fe1e83f admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:07.865817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f2bd9-e576-4195-a146-f8d05fe1e83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:07.865817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f2bd9-e576-4195-a146-f8d05fe1e83f admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:07.865817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f2bd9-e576-4195-a146-f8d05fe1e83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:07.865817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f2bd9-e576-4195-a146-f8d05fe1e83f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:07.868521 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:07.873859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1374/2769] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:42:07.877775 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214bdf0-39bd-4f71-b95d-406eb6ec9a9a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:07.888647 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214bdf0-39bd-4f71-b95d-406eb6ec9a9a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:07.893681 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde15e9-5025-4c3e-a954-5243f1b4a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:07.894269 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde15e9-5025-4c3e-a954-5243f1b4a72f admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:07.894604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde15e9-5025-4c3e-a954-5243f1b4a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:07.894877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde15e9-5025-4c3e-a954-5243f1b4a72f admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:07.895556 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde15e9-5025-4c3e-a954-5243f1b4a72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:07.897164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde15e9-5025-4c3e-a954-5243f1b4a72f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:07.911121 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1396/2770] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:42:07.912689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f2bd9-e576-4195-a146-f8d05fe1e83f admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:07.924415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f2bd9-e576-4195-a146-f8d05fe1e83f admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:07.929005 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc9b4b-8cac-495c-afc9-3f83591e1729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:07.929645 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc9b4b-8cac-495c-afc9-3f83591e1729 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:07.929918 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc9b4b-8cac-495c-afc9-3f83591e1729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:07.930185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc9b4b-8cac-495c-afc9-3f83591e1729 admin admin] PATH_INFO: `/v3/projects/231d5d10ce2f49ff80b17fe6ae523e16/users/9b7f17dc28344e4d9ae49aa518a1bc88/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:07.945417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc9b4b-8cac-495c-afc9-3f83591e1729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=231d5d10ce2f49ff80b17fe6ae523e16, user_id=9b7f17dc28344e4d9ae49aa518a1bc88, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:07.948880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc9b4b-8cac-495c-afc9-3f83591e1729 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:08.083290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1375/2771] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:42:07 2022] PUT /identity/v3/projects/231d5d10ce2f49ff80b17fe6ae523e16/users/9b7f17dc28344e4d9ae49aa518a1bc88/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:42:08.098823 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f609c2b-da45-44fb-9cda-28dbfaf99a17 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:08.099109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f609c2b-da45-44fb-9cda-28dbfaf99a17 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:08.099382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f609c2b-da45-44fb-9cda-28dbfaf99a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:08.128189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0f609c2b-da45-44fb-9cda-28dbfaf99a17 None None] MFA Rules not processed for user `9b7f17dc28344e4d9ae49aa518a1bc88`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:08.129394 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0f609c2b-da45-44fb-9cda-28dbfaf99a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:08.146346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:08.195686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1397/2772] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:08.206941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc9b4b-8cac-495c-afc9-3f83591e1729 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:08.209380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-87fc9b4b-8cac-495c-afc9-3f83591e1729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:08.277852 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc9b4b-8cac-495c-afc9-3f83591e1729 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:08.281484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ab21a-e92d-4e02-aa74-e69ee14a5670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:08.282085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ab21a-e92d-4e02-aa74-e69ee14a5670 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:08.282358 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ab21a-e92d-4e02-aa74-e69ee14a5670 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:08.282625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ab21a-e92d-4e02-aa74-e69ee14a5670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:08.291569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ab21a-e92d-4e02-aa74-e69ee14a5670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:08.293000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ab21a-e92d-4e02-aa74-e69ee14a5670 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:08.303289 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1376/2773] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:42:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:42:14.161364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f609c2b-da45-44fb-9cda-28dbfaf99a17 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:14.163011 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0f609c2b-da45-44fb-9cda-28dbfaf99a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:14.238435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f609c2b-da45-44fb-9cda-28dbfaf99a17 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:14.242959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:14.244275 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:14.244579 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:14.244861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] PATH_INFO: `/v3/users/611c4e2df78645118b4d3be3268df15f` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:14.245992 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=611c4e2df78645118b4d3be3268df15f)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:14.247885 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:14.493855 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611c4e2df78645118b4d3be3268df15f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:14.500665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611c4e2df78645118b4d3be3268df15f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:14.501318 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611c4e2df78645118b4d3be3268df15f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:14.501911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611c4e2df78645118b4d3be3268df15f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:14.600289 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611c4e2df78645118b4d3be3268df15f'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:14.619309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1398/2774] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:42:14 2022] DELETE /identity/v3/users/611c4e2df78645118b4d3be3268df15f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:14.630050 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3d093-0b9f-46fb-9787-f042a8c939f2 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:14.630532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3d093-0b9f-46fb-9787-f042a8c939f2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:14.630633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3d093-0b9f-46fb-9787-f042a8c939f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:14.649427 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-00f3d093-0b9f-46fb-9787-f042a8c939f2 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:14.651199 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-00f3d093-0b9f-46fb-9787-f042a8c939f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:14.710141 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1377/2775] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:14.720837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:14.722270 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:14.763774 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:14.778995 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661f5e8-dc31-4716-81b0-1fd3a859f320 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:14.782638 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3aac9-d341-44b6-b8e6-e6be4567aea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:14.783229 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3aac9-d341-44b6-b8e6-e6be4567aea2 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:14.783502 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3aac9-d341-44b6-b8e6-e6be4567aea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:14.783768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3aac9-d341-44b6-b8e6-e6be4567aea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:14.793099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3aac9-d341-44b6-b8e6-e6be4567aea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:14.794529 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3aac9-d341-44b6-b8e6-e6be4567aea2 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:14.803687 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1399/2776] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:42:15.258646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3d093-0b9f-46fb-9787-f042a8c939f2 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:15.260837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-00f3d093-0b9f-46fb-9787-f042a8c939f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:15.273150 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3d093-0b9f-46fb-9787-f042a8c939f2 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:15.278204 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:15.278868 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:15.279145 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:15.279414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] PATH_INFO: `/v3/projects/7717d1042b454b9185d1fa9992686852` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:15.280670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7717d1042b454b9185d1fa9992686852)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:15.283510 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:15.400880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7717d1042b454b9185d1fa9992686852', 'request_id': 'req-4ae99fbc-fd6c-4e25-8389-7d726746b018'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:15.406420 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7717d1042b454b9185d1fa9992686852', 'request_id': 'req-4ae99fbc-fd6c-4e25-8389-7d726746b018'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:15.412503 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7717d1042b454b9185d1fa9992686852', 'request_id': 'req-4ae99fbc-fd6c-4e25-8389-7d726746b018'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:15.515048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] The token cache is being invalidate because project 7717d1042b454b9185d1fa9992686852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:42:15.515343 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:15.515880 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:15.517432 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1378/2777] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:42:15 2022] DELETE /identity/v3/projects/7717d1042b454b9185d1fa9992686852 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:15.522519 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6105f-abce-4470-9045-8a81f4c1a291 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:15.526806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6105f-abce-4470-9045-8a81f4c1a291 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:15.526806 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6105f-abce-4470-9045-8a81f4c1a291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:15.542241 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b2a6105f-abce-4470-9045-8a81f4c1a291 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:15.543437 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b2a6105f-abce-4470-9045-8a81f4c1a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:15.603623 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1400/2778] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:15.607637 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:15.609061 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:15.613821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175db864-dc0f-4cbc-a8aa-4d4f64b8928e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:15.614103 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175db864-dc0f-4cbc-a8aa-4d4f64b8928e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:15.614370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175db864-dc0f-4cbc-a8aa-4d4f64b8928e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:15.617304 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:15.623200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99fbc-fd6c-4e25-8389-7d726746b018 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:15.628105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ae1de-856d-4c98-a081-7682144263a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:15.632679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ae1de-856d-4c98-a081-7682144263a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:15.632679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ae1de-856d-4c98-a081-7682144263a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:15.632679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ae1de-856d-4c98-a081-7682144263a7 admin admin] PATH_INFO: `/v3/users/9b7f17dc28344e4d9ae49aa518a1bc88` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:15.632679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ae1de-856d-4c98-a081-7682144263a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7f17dc28344e4d9ae49aa518a1bc88)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:15.632679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ae1de-856d-4c98-a081-7682144263a7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:15.635283 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-175db864-dc0f-4cbc-a8aa-4d4f64b8928e None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:15.636500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-175db864-dc0f-4cbc-a8aa-4d4f64b8928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:15.644196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1401/2779] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:42:15.648254 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175db864-dc0f-4cbc-a8aa-4d4f64b8928e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:15.657063 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175db864-dc0f-4cbc-a8aa-4d4f64b8928e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:15.661756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d32acf-07a8-4639-a073-694d66bda69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:15.662394 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d32acf-07a8-4639-a073-694d66bda69e admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:15.662677 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d32acf-07a8-4639-a073-694d66bda69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:15.662964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d32acf-07a8-4639-a073-694d66bda69e admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:15.663593 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d32acf-07a8-4639-a073-694d66bda69e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:42:15.663894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d32acf-07a8-4639-a073-694d66bda69e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:15.666202 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d32acf-07a8-4639-a073-694d66bda69e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:15.677696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1402/2780] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 10:42:15.687150 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d32acf-07a8-4639-a073-694d66bda69e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:15.696456 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d32acf-07a8-4639-a073-694d66bda69e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:15.701045 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c9125-43d8-4c32-95df-08b40c807af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:15.701596 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c9125-43d8-4c32-95df-08b40c807af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:15.701875 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c9125-43d8-4c32-95df-08b40c807af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:15.702147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c9125-43d8-4c32-95df-08b40c807af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:15.702750 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c9125-43d8-4c32-95df-08b40c807af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:15.704612 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c9125-43d8-4c32-95df-08b40c807af6 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:15.853200 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1403/2781] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:42:15 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:42:15.857243 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c9125-43d8-4c32-95df-08b40c807af6 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:15.912973 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b23ae1de-856d-4c98-a081-7682144263a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7f17dc28344e4d9ae49aa518a1bc88'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:15.922947 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b23ae1de-856d-4c98-a081-7682144263a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7f17dc28344e4d9ae49aa518a1bc88'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:15.923620 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b23ae1de-856d-4c98-a081-7682144263a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7f17dc28344e4d9ae49aa518a1bc88'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:15.924599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c9125-43d8-4c32-95df-08b40c807af6 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:15.929394 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719da84f-2a63-4741-9384-df2d8a9819ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:15.930022 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719da84f-2a63-4741-9384-df2d8a9819ee admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:15.930298 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719da84f-2a63-4741-9384-df2d8a9819ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:15.930567 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719da84f-2a63-4741-9384-df2d8a9819ee admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:15.931754 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719da84f-2a63-4741-9384-df2d8a9819ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:15.933895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719da84f-2a63-4741-9384-df2d8a9819ee admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:16.046941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b23ae1de-856d-4c98-a081-7682144263a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7f17dc28344e4d9ae49aa518a1bc88'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:16.052990 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1404/2782] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:42:15 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:42:16.057584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719da84f-2a63-4741-9384-df2d8a9819ee admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:16.059819 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-719da84f-2a63-4741-9384-df2d8a9819ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:16.061186 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-b23ae1de-856d-4c98-a081-7682144263a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7f17dc28344e4d9ae49aa518a1bc88'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:16.072352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719da84f-2a63-4741-9384-df2d8a9819ee admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:16.074232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1379/2783] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:42:15 2022] DELETE /identity/v3/users/9b7f17dc28344e4d9ae49aa518a1bc88 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:16.078457 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d623-e11e-4c8f-bd1c-e487f7f9adb0 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:16.078743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d623-e11e-4c8f-bd1c-e487f7f9adb0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:16.079016 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d623-e11e-4c8f-bd1c-e487f7f9adb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:16.098317 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d596d623-e11e-4c8f-bd1c-e487f7f9adb0 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:16.099539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d596d623-e11e-4c8f-bd1c-e487f7f9adb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:16.104204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:16.135710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb12fe6-432f-45b1-95d6-53b59018fe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:16.136393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb12fe6-432f-45b1-95d6-53b59018fe02 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:16.142257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb12fe6-432f-45b1-95d6-53b59018fe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:16.142257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb12fe6-432f-45b1-95d6-53b59018fe02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:16.142257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb12fe6-432f-45b1-95d6-53b59018fe02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:16.142257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb12fe6-432f-45b1-95d6-53b59018fe02 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:16.151243 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1405/2784] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:42:16.155038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb12fe6-432f-45b1-95d6-53b59018fe02 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:16.160425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1380/2785] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:16.166584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb12fe6-432f-45b1-95d6-53b59018fe02 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:16.170107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596d623-e11e-4c8f-bd1c-e487f7f9adb0 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:16.176690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d596d623-e11e-4c8f-bd1c-e487f7f9adb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:16.184710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a3276-f576-4140-bbb2-ae895023e093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:16.185343 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a3276-f576-4140-bbb2-ae895023e093 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:16.185627 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a3276-f576-4140-bbb2-ae895023e093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:16.186352 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a3276-f576-4140-bbb2-ae895023e093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:16.187157 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a3276-f576-4140-bbb2-ae895023e093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:16.188820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a3276-f576-4140-bbb2-ae895023e093 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:16.203100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1406/2786] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:42:16.207076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a3276-f576-4140-bbb2-ae895023e093 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:16.219595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a3276-f576-4140-bbb2-ae895023e093 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:16.224761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7a84b-b1ef-470c-922c-dfc4f5b45f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:16.228148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7a84b-b1ef-470c-922c-dfc4f5b45f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:16.228148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7a84b-b1ef-470c-922c-dfc4f5b45f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:16.228148 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7a84b-b1ef-470c-922c-dfc4f5b45f77 admin admin] PATH_INFO: `/v3/projects/58a9ef8bac1244dba4a23000f26e234a/users/3e67f5ad192541c6a67a18a41c5f44a8/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:16.245133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7a84b-b1ef-470c-922c-dfc4f5b45f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a9ef8bac1244dba4a23000f26e234a, user_id=3e67f5ad192541c6a67a18a41c5f44a8, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:16.247915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7a84b-b1ef-470c-922c-dfc4f5b45f77 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:16.250035 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596d623-e11e-4c8f-bd1c-e487f7f9adb0 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:16.254494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6e2a9-ed7e-4306-9d2b-8c5736c0cfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:16.255107 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6e2a9-ed7e-4306-9d2b-8c5736c0cfcb service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:16.255386 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6e2a9-ed7e-4306-9d2b-8c5736c0cfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:16.255655 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6e2a9-ed7e-4306-9d2b-8c5736c0cfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:16.266092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6e2a9-ed7e-4306-9d2b-8c5736c0cfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:16.267522 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6e2a9-ed7e-4306-9d2b-8c5736c0cfcb service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:16.277621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1381/2787] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:42:16.389078 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1407/2788] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:42:16 2022] PUT /identity/v3/projects/58a9ef8bac1244dba4a23000f26e234a/users/3e67f5ad192541c6a67a18a41c5f44a8/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:42:16.394292 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169009-74e7-48b6-a186-8439eea126f6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:16.394576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169009-74e7-48b6-a186-8439eea126f6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:16.394845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169009-74e7-48b6-a186-8439eea126f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:16.414417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5f169009-74e7-48b6-a186-8439eea126f6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:16.420588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5f169009-74e7-48b6-a186-8439eea126f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:16.431984 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:16.483766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1382/2789] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:16.494008 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7a84b-b1ef-470c-922c-dfc4f5b45f77 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:16.495752 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b3d7a84b-b1ef-470c-922c-dfc4f5b45f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:16.554363 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7a84b-b1ef-470c-922c-dfc4f5b45f77 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:16.558998 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e21dc-d3e3-4d75-917a-1019bd380603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:16.559721 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e21dc-d3e3-4d75-917a-1019bd380603 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:16.560115 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e21dc-d3e3-4d75-917a-1019bd380603 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:16.560461 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e21dc-d3e3-4d75-917a-1019bd380603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:16.570338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e21dc-d3e3-4d75-917a-1019bd380603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:16.571876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e21dc-d3e3-4d75-917a-1019bd380603 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:16.581993 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1408/2790] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:42:16.843870 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169009-74e7-48b6-a186-8439eea126f6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:16.845536 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5f169009-74e7-48b6-a186-8439eea126f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:16.861469 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169009-74e7-48b6-a186-8439eea126f6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:16.866260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cffd66-df9c-4775-b217-184eee3682ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:16.866910 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cffd66-df9c-4775-b217-184eee3682ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:16.867664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cffd66-df9c-4775-b217-184eee3682ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:16.867664 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cffd66-df9c-4775-b217-184eee3682ff admin admin] PATH_INFO: `/v3/projects/231d5d10ce2f49ff80b17fe6ae523e16` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:16.868974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cffd66-df9c-4775-b217-184eee3682ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=231d5d10ce2f49ff80b17fe6ae523e16)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:16.870980 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cffd66-df9c-4775-b217-184eee3682ff admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:16.972867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-07cffd66-df9c-4775-b217-184eee3682ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231d5d10ce2f49ff80b17fe6ae523e16', 'request_id': 'req-07cffd66-df9c-4775-b217-184eee3682ff'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:16.979212 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-07cffd66-df9c-4775-b217-184eee3682ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231d5d10ce2f49ff80b17fe6ae523e16', 'request_id': 'req-07cffd66-df9c-4775-b217-184eee3682ff'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:16.985644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-07cffd66-df9c-4775-b217-184eee3682ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231d5d10ce2f49ff80b17fe6ae523e16', 'request_id': 'req-07cffd66-df9c-4775-b217-184eee3682ff'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:17.070237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-07cffd66-df9c-4775-b217-184eee3682ff admin admin] The token cache is being invalidate because project 231d5d10ce2f49ff80b17fe6ae523e16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:42:17.070646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-07cffd66-df9c-4775-b217-184eee3682ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:17.075291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-07cffd66-df9c-4775-b217-184eee3682ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:17.075291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1383/2791] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:42:16 2022] DELETE /identity/v3/projects/231d5d10ce2f49ff80b17fe6ae523e16 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:17.079610 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fbe22-18b1-41fe-9797-c276ee8caed4 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:17.079895 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fbe22-18b1-41fe-9797-c276ee8caed4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:17.080196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fbe22-18b1-41fe-9797-c276ee8caed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:17.100072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2c8fbe22-18b1-41fe-9797-c276ee8caed4 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:17.101310 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2c8fbe22-18b1-41fe-9797-c276ee8caed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:17.169991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1409/2792] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:17.178994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52dd88-f5b8-4a00-9e40-f6f3fb3d3d65 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:17.184307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52dd88-f5b8-4a00-9e40-f6f3fb3d3d65 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:17.184307 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52dd88-f5b8-4a00-9e40-f6f3fb3d3d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:17.200316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9e52dd88-f5b8-4a00-9e40-f6f3fb3d3d65 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:17.201633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9e52dd88-f5b8-4a00-9e40-f6f3fb3d3d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:17.209746 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1384/2793] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:17.214609 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fbe22-18b1-41fe-9797-c276ee8caed4 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:17.224172 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fbe22-18b1-41fe-9797-c276ee8caed4 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:17.229584 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763cd13-b1f1-46da-b11a-2b30152448c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:17.230223 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763cd13-b1f1-46da-b11a-2b30152448c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:17.230500 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763cd13-b1f1-46da-b11a-2b30152448c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:17.230768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763cd13-b1f1-46da-b11a-2b30152448c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:17.231404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763cd13-b1f1-46da-b11a-2b30152448c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:42:17.231702 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763cd13-b1f1-46da-b11a-2b30152448c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:17.233302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763cd13-b1f1-46da-b11a-2b30152448c2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:17.245714 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1410/2794] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:42:17.252712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52dd88-f5b8-4a00-9e40-f6f3fb3d3d65 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:17.262845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52dd88-f5b8-4a00-9e40-f6f3fb3d3d65 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:17.276544 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585882d-988a-4690-ac26-30c93d5ac309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:17.277402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585882d-988a-4690-ac26-30c93d5ac309 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:17.277853 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585882d-988a-4690-ac26-30c93d5ac309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:17.278346 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585882d-988a-4690-ac26-30c93d5ac309 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:17.279129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585882d-988a-4690-ac26-30c93d5ac309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:17.281201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585882d-988a-4690-ac26-30c93d5ac309 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:17.391777 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1385/2795] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:42:17 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:42:17.395463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763cd13-b1f1-46da-b11a-2b30152448c2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:17.406486 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763cd13-b1f1-46da-b11a-2b30152448c2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:17.424177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:17.464264 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697ccb5-0c42-4dd3-a78f-0a5b2ce742cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:17.464868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697ccb5-0c42-4dd3-a78f-0a5b2ce742cf admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:17.465147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697ccb5-0c42-4dd3-a78f-0a5b2ce742cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:17.465419 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697ccb5-0c42-4dd3-a78f-0a5b2ce742cf admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:17.466062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697ccb5-0c42-4dd3-a78f-0a5b2ce742cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:17.468086 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697ccb5-0c42-4dd3-a78f-0a5b2ce742cf admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:17.557095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1411/2796] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:42:17 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:42:17.560244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585882d-988a-4690-ac26-30c93d5ac309 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:17.575977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585882d-988a-4690-ac26-30c93d5ac309 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:17.582381 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d08601-e3ce-4075-9ca8-88adaae52627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:17.595190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d08601-e3ce-4075-9ca8-88adaae52627 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:17.595190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d08601-e3ce-4075-9ca8-88adaae52627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:17.595190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d08601-e3ce-4075-9ca8-88adaae52627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:17.595190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d08601-e3ce-4075-9ca8-88adaae52627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:17.595190 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d08601-e3ce-4075-9ca8-88adaae52627 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:17.617662 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1386/2797] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:42:17.623983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697ccb5-0c42-4dd3-a78f-0a5b2ce742cf admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:17.637951 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697ccb5-0c42-4dd3-a78f-0a5b2ce742cf admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:17.649203 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dff6b-aca5-482d-b87f-d5f269f98d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:17.649859 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dff6b-aca5-482d-b87f-d5f269f98d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:17.650143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dff6b-aca5-482d-b87f-d5f269f98d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:17.650455 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dff6b-aca5-482d-b87f-d5f269f98d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:17.651151 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dff6b-aca5-482d-b87f-d5f269f98d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:17.652755 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dff6b-aca5-482d-b87f-d5f269f98d4b admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:17.673102 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1412/2798] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:42:17.678035 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d08601-e3ce-4075-9ca8-88adaae52627 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:17.691588 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d08601-e3ce-4075-9ca8-88adaae52627 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:17.699971 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71717c2-33cb-46c7-bc03-ff8cd0265c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:17.700648 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71717c2-33cb-46c7-bc03-ff8cd0265c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:17.700925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71717c2-33cb-46c7-bc03-ff8cd0265c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:17.701195 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71717c2-33cb-46c7-bc03-ff8cd0265c30 admin admin] PATH_INFO: `/v3/projects/b6dd972d217341de9c78983667704d68/users/de8f362c8b9c481e8a324b134d2e76e4/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:17.718811 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71717c2-33cb-46c7-bc03-ff8cd0265c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6dd972d217341de9c78983667704d68, user_id=de8f362c8b9c481e8a324b134d2e76e4, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:17.721504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71717c2-33cb-46c7-bc03-ff8cd0265c30 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:17.818410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1387/2799] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:42:17 2022] PUT /identity/v3/projects/b6dd972d217341de9c78983667704d68/users/de8f362c8b9c481e8a324b134d2e76e4/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:17.829764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffae9d7-f77b-42f9-88ee-c04e8b9d85b5 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:17.830450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffae9d7-f77b-42f9-88ee-c04e8b9d85b5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:17.830943 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffae9d7-f77b-42f9-88ee-c04e8b9d85b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:17.872371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1ffae9d7-f77b-42f9-88ee-c04e8b9d85b5 None None] MFA Rules not processed for user `de8f362c8b9c481e8a324b134d2e76e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:17.873854 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1ffae9d7-f77b-42f9-88ee-c04e8b9d85b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:17.963988 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1413/2800] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:17.975669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71717c2-33cb-46c7-bc03-ff8cd0265c30 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:17.978941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c71717c2-33cb-46c7-bc03-ff8cd0265c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:18.043491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71717c2-33cb-46c7-bc03-ff8cd0265c30 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:18.048181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6469ff-3acd-483a-80f9-d450393d36f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:18.048803 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6469ff-3acd-483a-80f9-d450393d36f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:18.049092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6469ff-3acd-483a-80f9-d450393d36f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:18.049375 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6469ff-3acd-483a-80f9-d450393d36f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:18.059282 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6469ff-3acd-483a-80f9-d450393d36f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:18.060825 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6469ff-3acd-483a-80f9-d450393d36f9 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:18.071028 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1388/2801] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:42:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:42:18.949755 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:22.667021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffae9d7-f77b-42f9-88ee-c04e8b9d85b5 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:22.670056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e231bb-78f4-406d-82d1-5b21eea232d3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:22.671143 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e231bb-78f4-406d-82d1-5b21eea232d3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:22.671608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e231bb-78f4-406d-82d1-5b21eea232d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:22.725822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-68e231bb-78f4-406d-82d1-5b21eea232d3 None None] MFA Rules not processed for user `3e67f5ad192541c6a67a18a41c5f44a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:22.725822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-68e231bb-78f4-406d-82d1-5b21eea232d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:22.758777 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffae9d7-f77b-42f9-88ee-c04e8b9d85b5 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:22.765188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b2f71-5c51-4bbb-a0f5-9f0d79b1cc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:22.766135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b2f71-5c51-4bbb-a0f5-9f0d79b1cc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:22.766622 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b2f71-5c51-4bbb-a0f5-9f0d79b1cc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:22.766911 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b2f71-5c51-4bbb-a0f5-9f0d79b1cc3c admin admin] PATH_INFO: `/v3/users/de8f362c8b9c481e8a324b134d2e76e4` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:22.768759 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b2f71-5c51-4bbb-a0f5-9f0d79b1cc3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8f362c8b9c481e8a324b134d2e76e4)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:22.771069 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b2f71-5c51-4bbb-a0f5-9f0d79b1cc3c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:22.814571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1389/2802] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:22.819273 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e231bb-78f4-406d-82d1-5b21eea232d3 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:22.825599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-68e231bb-78f4-406d-82d1-5b21eea232d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:22.834515 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e231bb-78f4-406d-82d1-5b21eea232d3 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:22.839817 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04366f-a4d7-41f3-b1cb-0ae4d7c305c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:22.840452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04366f-a4d7-41f3-b1cb-0ae4d7c305c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:22.840732 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04366f-a4d7-41f3-b1cb-0ae4d7c305c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:22.841005 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04366f-a4d7-41f3-b1cb-0ae4d7c305c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:22.841644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04366f-a4d7-41f3-b1cb-0ae4d7c305c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:22.843569 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04366f-a4d7-41f3-b1cb-0ae4d7c305c0 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:22.959554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1390/2803] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:42:22 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:42:22.961011 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04366f-a4d7-41f3-b1cb-0ae4d7c305c0 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:23.023764 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:23.026275 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04366f-a4d7-41f3-b1cb-0ae4d7c305c0 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:23.031303 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b38a5-818d-4461-b7fe-d9a98e4cda16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:23.034220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b38a5-818d-4461-b7fe-d9a98e4cda16 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:23.034220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b38a5-818d-4461-b7fe-d9a98e4cda16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:23.034220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b38a5-818d-4461-b7fe-d9a98e4cda16 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:23.034220 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b38a5-818d-4461-b7fe-d9a98e4cda16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:23.035229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b38a5-818d-4461-b7fe-d9a98e4cda16 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:23.040884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e33b2f71-5c51-4bbb-a0f5-9f0d79b1cc3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8f362c8b9c481e8a324b134d2e76e4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:23.048717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e33b2f71-5c51-4bbb-a0f5-9f0d79b1cc3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8f362c8b9c481e8a324b134d2e76e4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:23.049503 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e33b2f71-5c51-4bbb-a0f5-9f0d79b1cc3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8f362c8b9c481e8a324b134d2e76e4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:23.050158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e33b2f71-5c51-4bbb-a0f5-9f0d79b1cc3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8f362c8b9c481e8a324b134d2e76e4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:23.138843 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1391/2804] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:42:22 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:42:23.142529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b38a5-818d-4461-b7fe-d9a98e4cda16 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:23.147598 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f75b38a5-818d-4461-b7fe-d9a98e4cda16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:23.149055 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e33b2f71-5c51-4bbb-a0f5-9f0d79b1cc3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8f362c8b9c481e8a324b134d2e76e4'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:23.157692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b38a5-818d-4461-b7fe-d9a98e4cda16 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:23.162679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6cded-3cd3-49de-9604-11e8a121015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:23.163294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6cded-3cd3-49de-9604-11e8a121015c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:23.163576 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6cded-3cd3-49de-9604-11e8a121015c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:23.164053 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6cded-3cd3-49de-9604-11e8a121015c admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:23.164587 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6cded-3cd3-49de-9604-11e8a121015c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:23.166189 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6cded-3cd3-49de-9604-11e8a121015c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:23.170996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1414/2805] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:42:22 2022] DELETE /identity/v3/users/de8f362c8b9c481e8a324b134d2e76e4 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:23.181415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1392/2806] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 10:42:23.181583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f1dab-04bc-45ed-93fe-80ccba0630df None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:23.181583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f1dab-04bc-45ed-93fe-80ccba0630df None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:23.181583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f1dab-04bc-45ed-93fe-80ccba0630df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:23.182685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6cded-3cd3-49de-9604-11e8a121015c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:23.194375 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6cded-3cd3-49de-9604-11e8a121015c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:23.200795 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8e7f1dab-04bc-45ed-93fe-80ccba0630df None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:23.201996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8e7f1dab-04bc-45ed-93fe-80ccba0630df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:23.220233 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:23.252109 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b0e35-d687-44b1-99e4-92683669ad42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:23.252695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b0e35-d687-44b1-99e4-92683669ad42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:23.252975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b0e35-d687-44b1-99e4-92683669ad42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:23.253251 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b0e35-d687-44b1-99e4-92683669ad42 admin admin] PATH_INFO: `/v3/projects/5569757f0e1b46ff9eb1196e33c75984/users/26a3f08b8e8740a3bd7133e5c113d039/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:23.261757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1415/2807] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:42:23.269045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b0e35-d687-44b1-99e4-92683669ad42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5569757f0e1b46ff9eb1196e33c75984, user_id=26a3f08b8e8740a3bd7133e5c113d039, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:23.271663 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f1dab-04bc-45ed-93fe-80ccba0630df None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:23.271791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b0e35-d687-44b1-99e4-92683669ad42 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:23.273073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8e7f1dab-04bc-45ed-93fe-80ccba0630df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:23.327485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f1dab-04bc-45ed-93fe-80ccba0630df None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:23.331207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca11ef-32af-47ed-b1ec-9e766c7487f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:23.331827 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca11ef-32af-47ed-b1ec-9e766c7487f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:23.332135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca11ef-32af-47ed-b1ec-9e766c7487f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:23.332406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca11ef-32af-47ed-b1ec-9e766c7487f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:23.342683 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca11ef-32af-47ed-b1ec-9e766c7487f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:23.344153 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca11ef-32af-47ed-b1ec-9e766c7487f8 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:23.354101 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1416/2808] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:42:23.405850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1393/2809] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:42:23 2022] PUT /identity/v3/projects/5569757f0e1b46ff9eb1196e33c75984/users/26a3f08b8e8740a3bd7133e5c113d039/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:23.409901 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca11ef-32af-47ed-b1ec-9e766c7487f8 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:23.419902 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca11ef-32af-47ed-b1ec-9e766c7487f8 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:23.474916 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f80295-ff21-499f-8453-8b0b8363b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:23.475515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f80295-ff21-499f-8453-8b0b8363b669 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:23.475792 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f80295-ff21-499f-8453-8b0b8363b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:23.476103 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f80295-ff21-499f-8453-8b0b8363b669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:23.476732 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f80295-ff21-499f-8453-8b0b8363b669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:23.478537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f80295-ff21-499f-8453-8b0b8363b669 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:23.488533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1417/2810] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:42:23.496961 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b0e35-d687-44b1-99e4-92683669ad42 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:23.503138 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b0e35-d687-44b1-99e4-92683669ad42 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:23.507717 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fab185-a142-45da-8a94-683bad81a3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:23.508414 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fab185-a142-45da-8a94-683bad81a3a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:23.508690 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fab185-a142-45da-8a94-683bad81a3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:23.508962 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fab185-a142-45da-8a94-683bad81a3a1 admin admin] PATH_INFO: `/v3/projects/5569757f0e1b46ff9eb1196e33c75984/users/26a3f08b8e8740a3bd7133e5c113d039/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:23.510906 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fab185-a142-45da-8a94-683bad81a3a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5569757f0e1b46ff9eb1196e33c75984, user_id=26a3f08b8e8740a3bd7133e5c113d039, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:23.513582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fab185-a142-45da-8a94-683bad81a3a1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:23.526725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1394/2811] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:42:23 2022] PUT /identity/v3/projects/5569757f0e1b46ff9eb1196e33c75984/users/26a3f08b8e8740a3bd7133e5c113d039/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:23.835991 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f80295-ff21-499f-8453-8b0b8363b669 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:23.839169 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-06f80295-ff21-499f-8453-8b0b8363b669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:23.875450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f80295-ff21-499f-8453-8b0b8363b669 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:23.953319 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:23.953964 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:23.954247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:23.954523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] PATH_INFO: `/v3/projects/b6dd972d217341de9c78983667704d68` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:23.955717 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6dd972d217341de9c78983667704d68)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:23.957807 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:24.123684 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6dd972d217341de9c78983667704d68', 'request_id': 'req-88599447-a6fc-4228-8677-d6303bd48f05'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:24.129897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6dd972d217341de9c78983667704d68', 'request_id': 'req-88599447-a6fc-4228-8677-d6303bd48f05'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:24.279543 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6dd972d217341de9c78983667704d68', 'request_id': 'req-88599447-a6fc-4228-8677-d6303bd48f05'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:24.291605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] The token cache is being invalidate because project b6dd972d217341de9c78983667704d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:42:24.292019 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:24.292738 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:42:24.294285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1418/2812] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:42:23 2022] DELETE /identity/v3/projects/b6dd972d217341de9c78983667704d68 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:42:24.646928 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:29.189167 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72344-0189-4bfd-8fba-be8bd49af4b3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:29.189698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72344-0189-4bfd-8fba-be8bd49af4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:29.189698 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72344-0189-4bfd-8fba-be8bd49af4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:29.221565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ddb72344-0189-4bfd-8fba-be8bd49af4b3 None None] MFA Rules not processed for user `26a3f08b8e8740a3bd7133e5c113d039`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:29.221565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ddb72344-0189-4bfd-8fba-be8bd49af4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:29.299993 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1395/2813] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:29.315708 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:29.317253 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:29.393837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:29.429665 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88599447-a6fc-4228-8677-d6303bd48f05 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:29.447168 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe2693-0914-456d-b294-e118aac0758f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:29.448630 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe2693-0914-456d-b294-e118aac0758f service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:29.448835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe2693-0914-456d-b294-e118aac0758f service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:29.449130 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe2693-0914-456d-b294-e118aac0758f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:29.451828 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-20fe2693-0914-456d-b294-e118aac0758f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:29.517408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe2693-0914-456d-b294-e118aac0758f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:29.519045 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe2693-0914-456d-b294-e118aac0758f service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:29.528957 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1419/2814] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:42:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:42:32.772502 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea2c3e-022f-43d2-a91b-3a4fccfdf83a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:32.774867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea2c3e-022f-43d2-a91b-3a4fccfdf83a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:32.774867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea2c3e-022f-43d2-a91b-3a4fccfdf83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:32.793847 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-cfea2c3e-022f-43d2-a91b-3a4fccfdf83a None None] MFA Rules not processed for user `3e67f5ad192541c6a67a18a41c5f44a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:42:32.795061 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cfea2c3e-022f-43d2-a91b-3a4fccfdf83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:32.801916 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1396/2815] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:42:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:42:39.761340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=33 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:42.787582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=64,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:43.353487 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe2693-0914-456d-b294-e118aac0758f service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:43.355161 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-20fe2693-0914-456d-b294-e118aac0758f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:43.452270 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe2693-0914-456d-b294-e118aac0758f service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:43.457458 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5074d2d-bac6-4107-9c69-59b02db4fa79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:43.458093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5074d2d-bac6-4107-9c69-59b02db4fa79 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:43.458370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5074d2d-bac6-4107-9c69-59b02db4fa79 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:43.458644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5074d2d-bac6-4107-9c69-59b02db4fa79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:43.460406 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d5074d2d-bac6-4107-9c69-59b02db4fa79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:43.472694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5074d2d-bac6-4107-9c69-59b02db4fa79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:43.474240 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5074d2d-bac6-4107-9c69-59b02db4fa79 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:43.484342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1420/2816] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:42:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:42:53.480077 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=41 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:42:59.349501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea2c3e-022f-43d2-a91b-3a4fccfdf83a None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:42:59.350914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cfea2c3e-022f-43d2-a91b-3a4fccfdf83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:42:59.407667 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea2c3e-022f-43d2-a91b-3a4fccfdf83a None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:42:59.411223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819ca5c-d9bd-47e9-aba7-4fa745b2ec64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:42:59.411823 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819ca5c-d9bd-47e9-aba7-4fa745b2ec64 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:42:59.412137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819ca5c-d9bd-47e9-aba7-4fa745b2ec64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:42:59.412404 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819ca5c-d9bd-47e9-aba7-4fa745b2ec64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:42:59.421826 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819ca5c-d9bd-47e9-aba7-4fa745b2ec64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:42:59.423286 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819ca5c-d9bd-47e9-aba7-4fa745b2ec64 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:42:59.432582 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1397/2817] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:42:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:43:04.596690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5074d2d-bac6-4107-9c69-59b02db4fa79 service placement] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:43:04.598245 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d5074d2d-bac6-4107-9c69-59b02db4fa79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:43:04.614094 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5074d2d-bac6-4107-9c69-59b02db4fa79 service placement] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:43:04.619817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d1436-49d7-44f8-8b13-5d6f17e3c9df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:43:04.620516 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d1436-49d7-44f8-8b13-5d6f17e3c9df service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:43:04.620860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d1436-49d7-44f8-8b13-5d6f17e3c9df service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:43:04.621249 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d1436-49d7-44f8-8b13-5d6f17e3c9df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:43:04.623619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-074d1436-49d7-44f8-8b13-5d6f17e3c9df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:43:04.636491 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d1436-49d7-44f8-8b13-5d6f17e3c9df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:43:04.638745 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d1436-49d7-44f8-8b13-5d6f17e3c9df service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:43:04.652441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1421/2818] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:43:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:43:09.206661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd947315-f80d-4938-bf5a-1839f1cd93ae None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:43:09.218822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd947315-f80d-4938-bf5a-1839f1cd93ae None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:43:09.218822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd947315-f80d-4938-bf5a-1839f1cd93ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:43:09.225963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-bd947315-f80d-4938-bf5a-1839f1cd93ae None None] MFA Rules not processed for user `7d0fa8beb6954a5d8662e581345e2a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:43:09.227158 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bd947315-f80d-4938-bf5a-1839f1cd93ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:43:09.282360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1398/2819] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:43:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:43:14.644934 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:43:19.275848 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=51 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:18.039515 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d1436-49d7-44f8-8b13-5d6f17e3c9df service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:18.041212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-074d1436-49d7-44f8-8b13-5d6f17e3c9df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:18.106492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d1436-49d7-44f8-8b13-5d6f17e3c9df service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:18.111118 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9461c4d-f003-41f7-bd51-3cebe16f25eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:18.111760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9461c4d-f003-41f7-bd51-3cebe16f25eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:18.112065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9461c4d-f003-41f7-bd51-3cebe16f25eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:18.112342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9461c4d-f003-41f7-bd51-3cebe16f25eb admin admin] PATH_INFO: `/v3/users/7d0fa8beb6954a5d8662e581345e2a12` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:18.113440 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9461c4d-f003-41f7-bd51-3cebe16f25eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0fa8beb6954a5d8662e581345e2a12)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:18.115309 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9461c4d-f003-41f7-bd51-3cebe16f25eb admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:18.296550 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e9461c4d-f003-41f7-bd51-3cebe16f25eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0fa8beb6954a5d8662e581345e2a12'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:18.303712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e9461c4d-f003-41f7-bd51-3cebe16f25eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0fa8beb6954a5d8662e581345e2a12'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:18.304409 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e9461c4d-f003-41f7-bd51-3cebe16f25eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0fa8beb6954a5d8662e581345e2a12'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:18.305197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e9461c4d-f003-41f7-bd51-3cebe16f25eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0fa8beb6954a5d8662e581345e2a12'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:18.374956 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-e9461c4d-f003-41f7-bd51-3cebe16f25eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0fa8beb6954a5d8662e581345e2a12'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:18.392833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1422/2820] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:44:18 2022] DELETE /identity/v3/users/7d0fa8beb6954a5d8662e581345e2a12 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:44:18.713940 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd947315-f80d-4938-bf5a-1839f1cd93ae None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:18.730504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd947315-f80d-4938-bf5a-1839f1cd93ae None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:18.792354 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:18.795105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:18.795105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:18.795105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42 admin admin] PATH_INFO: `/v3/projects/fa548fc241a640efb2e63ebc7e27efdb` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:18.795105 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa548fc241a640efb2e63ebc7e27efdb)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:18.796565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:18.946728 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa548fc241a640efb2e63ebc7e27efdb', 'request_id': 'req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:18.952260 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa548fc241a640efb2e63ebc7e27efdb', 'request_id': 'req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:18.958440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa548fc241a640efb2e63ebc7e27efdb', 'request_id': 'req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:19.043341 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42 admin admin] The token cache is being invalidate because project fa548fc241a640efb2e63ebc7e27efdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:44:19.043634 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:19.044252 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-dc365935-39ab-4c0e-aaf9-ec2ae085fa42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:19.045749 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1399/2821] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:44:18 2022] DELETE /identity/v3/projects/fa548fc241a640efb2e63ebc7e27efdb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:19.050724 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a57db-2c89-48ed-96ed-f1de1e2cbd99 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:19.051212 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a57db-2c89-48ed-96ed-f1de1e2cbd99 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:19.051359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a57db-2c89-48ed-96ed-f1de1e2cbd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:19.071244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5a3a57db-2c89-48ed-96ed-f1de1e2cbd99 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:19.072481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5a3a57db-2c89-48ed-96ed-f1de1e2cbd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:19.130404 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1423/2822] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:19.138229 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec55a24-8312-4cc4-be0a-d6c658fbb14b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:19.138538 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec55a24-8312-4cc4-be0a-d6c658fbb14b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:19.138808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec55a24-8312-4cc4-be0a-d6c658fbb14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:19.158429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-8ec55a24-8312-4cc4-be0a-d6c658fbb14b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:19.159633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8ec55a24-8312-4cc4-be0a-d6c658fbb14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:19.168127 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1400/2823] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:19.172302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a57db-2c89-48ed-96ed-f1de1e2cbd99 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:19.181937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a57db-2c89-48ed-96ed-f1de1e2cbd99 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:19.187340 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce2062-6116-4e3c-9dcc-e08cd9b03237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:19.187939 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce2062-6116-4e3c-9dcc-e08cd9b03237 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:19.188250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce2062-6116-4e3c-9dcc-e08cd9b03237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:19.188522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce2062-6116-4e3c-9dcc-e08cd9b03237 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:19.189165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce2062-6116-4e3c-9dcc-e08cd9b03237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:44:19.189473 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce2062-6116-4e3c-9dcc-e08cd9b03237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:19.191043 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce2062-6116-4e3c-9dcc-e08cd9b03237 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:19.202559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1424/2824] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:44:19.206679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec55a24-8312-4cc4-be0a-d6c658fbb14b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:19.216302 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec55a24-8312-4cc4-be0a-d6c658fbb14b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:19.220888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88346521-fbcc-4a70-8013-378e107b8521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:19.221474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88346521-fbcc-4a70-8013-378e107b8521 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:19.221772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88346521-fbcc-4a70-8013-378e107b8521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:19.222040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88346521-fbcc-4a70-8013-378e107b8521 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:19.222668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88346521-fbcc-4a70-8013-378e107b8521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:19.225210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88346521-fbcc-4a70-8013-378e107b8521 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:19.444062 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1401/2825] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:44:19 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:19.448099 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce2062-6116-4e3c-9dcc-e08cd9b03237 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:19.458479 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce2062-6116-4e3c-9dcc-e08cd9b03237 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:19.462028 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:19.514668 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fec01c-e964-4132-b50a-4ffd9176c5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:19.515265 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fec01c-e964-4132-b50a-4ffd9176c5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:19.515540 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fec01c-e964-4132-b50a-4ffd9176c5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:19.515811 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fec01c-e964-4132-b50a-4ffd9176c5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:19.516537 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fec01c-e964-4132-b50a-4ffd9176c5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:19.518411 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fec01c-e964-4132-b50a-4ffd9176c5c5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:19.649578 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1425/2826] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:44:19 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:19.653261 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88346521-fbcc-4a70-8013-378e107b8521 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:19.664262 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88346521-fbcc-4a70-8013-378e107b8521 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:19.668770 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9177f-e146-4b00-8754-8a7e79d59afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:19.674734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9177f-e146-4b00-8754-8a7e79d59afd admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:19.674734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9177f-e146-4b00-8754-8a7e79d59afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:19.674734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9177f-e146-4b00-8754-8a7e79d59afd admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:19.674734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9177f-e146-4b00-8754-8a7e79d59afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:19.674734 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9177f-e146-4b00-8754-8a7e79d59afd admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:19.682804 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1402/2827] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:19.686801 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fec01c-e964-4132-b50a-4ffd9176c5c5 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:19.696589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fec01c-e964-4132-b50a-4ffd9176c5c5 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:19.701140 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fa71e-d374-48e2-8109-090ecadc1faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:19.701749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fa71e-d374-48e2-8109-090ecadc1faa admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:19.702026 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fa71e-d374-48e2-8109-090ecadc1faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:19.702294 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fa71e-d374-48e2-8109-090ecadc1faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:19.702967 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fa71e-d374-48e2-8109-090ecadc1faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:19.704558 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fa71e-d374-48e2-8109-090ecadc1faa admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:19.715734 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1426/2828] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:19.723083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9177f-e146-4b00-8754-8a7e79d59afd admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:19.734082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9177f-e146-4b00-8754-8a7e79d59afd admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:19.738601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2e797-4d15-4e9d-864c-e48e1a7a5cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:19.739237 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2e797-4d15-4e9d-864c-e48e1a7a5cab admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:19.739513 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2e797-4d15-4e9d-864c-e48e1a7a5cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:19.739783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2e797-4d15-4e9d-864c-e48e1a7a5cab admin admin] PATH_INFO: `/v3/projects/babc5727d65d425fbb5ccb0839a12505/users/c33bfa8bc92d4d7c953ac550a3975003/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:19.754124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2e797-4d15-4e9d-864c-e48e1a7a5cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=babc5727d65d425fbb5ccb0839a12505, user_id=c33bfa8bc92d4d7c953ac550a3975003, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:19.756771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2e797-4d15-4e9d-864c-e48e1a7a5cab admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:19.877995 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1403/2829] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:44:19 2022] PUT /identity/v3/projects/babc5727d65d425fbb5ccb0839a12505/users/c33bfa8bc92d4d7c953ac550a3975003/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:19.889371 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37e1f6-293c-4db9-91fc-72051bc38378 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:19.889654 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37e1f6-293c-4db9-91fc-72051bc38378 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:19.889925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37e1f6-293c-4db9-91fc-72051bc38378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:19.920225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7c37e1f6-293c-4db9-91fc-72051bc38378 None None] MFA Rules not processed for user `c33bfa8bc92d4d7c953ac550a3975003`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:19.921463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7c37e1f6-293c-4db9-91fc-72051bc38378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:19.985523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1427/2830] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:19.990051 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2e797-4d15-4e9d-864c-e48e1a7a5cab admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:20.019541 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:20.051180 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2e797-4d15-4e9d-864c-e48e1a7a5cab admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:20.056099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76674b81-ee0f-4a63-8b93-10f8e62cc3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:20.056737 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76674b81-ee0f-4a63-8b93-10f8e62cc3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:20.057015 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76674b81-ee0f-4a63-8b93-10f8e62cc3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:20.057285 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76674b81-ee0f-4a63-8b93-10f8e62cc3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:20.057922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76674b81-ee0f-4a63-8b93-10f8e62cc3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:20.059903 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76674b81-ee0f-4a63-8b93-10f8e62cc3e5 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:20.158896 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1404/2831] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:44:19 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:20.163023 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37e1f6-293c-4db9-91fc-72051bc38378 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:20.173597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37e1f6-293c-4db9-91fc-72051bc38378 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:20.230009 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072e896-2523-4ce2-bb97-08337a7b4676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:20.230604 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072e896-2523-4ce2-bb97-08337a7b4676 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:20.230879 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072e896-2523-4ce2-bb97-08337a7b4676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:20.231146 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072e896-2523-4ce2-bb97-08337a7b4676 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:20.231769 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072e896-2523-4ce2-bb97-08337a7b4676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:20.233730 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072e896-2523-4ce2-bb97-08337a7b4676 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:20.341359 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1428/2832] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:44:20 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:20.345360 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76674b81-ee0f-4a63-8b93-10f8e62cc3e5 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:20.356168 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76674b81-ee0f-4a63-8b93-10f8e62cc3e5 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:20.360712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d62e3-c512-4712-ad63-4abd038cebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:20.365125 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d62e3-c512-4712-ad63-4abd038cebee admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:20.365125 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d62e3-c512-4712-ad63-4abd038cebee admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:20.365125 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d62e3-c512-4712-ad63-4abd038cebee admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:20.365125 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d62e3-c512-4712-ad63-4abd038cebee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:20.365125 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d62e3-c512-4712-ad63-4abd038cebee admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:20.373686 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1405/2833] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:20.377958 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072e896-2523-4ce2-bb97-08337a7b4676 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:20.384796 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:20.388642 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072e896-2523-4ce2-bb97-08337a7b4676 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:20.393322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf41e5-31f9-4468-943f-da19c397412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:20.393959 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf41e5-31f9-4468-943f-da19c397412a admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:20.394239 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf41e5-31f9-4468-943f-da19c397412a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:20.394510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf41e5-31f9-4468-943f-da19c397412a admin admin] PATH_INFO: `/v3/projects/eefb4fa7796040289401f498b3039d37/users/562be72f58d444c0bdaacefc5ef86d57/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:20.409633 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf41e5-31f9-4468-943f-da19c397412a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefb4fa7796040289401f498b3039d37, user_id=562be72f58d444c0bdaacefc5ef86d57, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:20.412285 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf41e5-31f9-4468-943f-da19c397412a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:20.535544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1429/2834] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:44:20 2022] PUT /identity/v3/projects/eefb4fa7796040289401f498b3039d37/users/562be72f58d444c0bdaacefc5ef86d57/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:44:20.540328 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d62e3-c512-4712-ad63-4abd038cebee admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:20.550257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d62e3-c512-4712-ad63-4abd038cebee admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:20.606859 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2378d-a7d4-4bf5-a331-46b5af2fb9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:20.607402 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2378d-a7d4-4bf5-a331-46b5af2fb9cc admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:20.607673 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2378d-a7d4-4bf5-a331-46b5af2fb9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:20.607941 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2378d-a7d4-4bf5-a331-46b5af2fb9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:20.608602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2378d-a7d4-4bf5-a331-46b5af2fb9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:20.610162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2378d-a7d4-4bf5-a331-46b5af2fb9cc admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:20.619559 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1406/2835] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:20.623925 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf41e5-31f9-4468-943f-da19c397412a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:20.634353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf41e5-31f9-4468-943f-da19c397412a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:20.639332 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe8a02-81f0-42c2-9c8b-5c078e294072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:20.639996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe8a02-81f0-42c2-9c8b-5c078e294072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:20.640280 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe8a02-81f0-42c2-9c8b-5c078e294072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:20.640553 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe8a02-81f0-42c2-9c8b-5c078e294072 admin admin] PATH_INFO: `/v3/projects/eefb4fa7796040289401f498b3039d37/users/562be72f58d444c0bdaacefc5ef86d57/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:20.642525 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe8a02-81f0-42c2-9c8b-5c078e294072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefb4fa7796040289401f498b3039d37, user_id=562be72f58d444c0bdaacefc5ef86d57, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:20.645191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe8a02-81f0-42c2-9c8b-5c078e294072 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:20.655876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1430/2836] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:44:20 2022] PUT /identity/v3/projects/eefb4fa7796040289401f498b3039d37/users/562be72f58d444c0bdaacefc5ef86d57/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:20.666232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd8994-627d-4327-93ec-e74ad2332675 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:20.666581 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd8994-627d-4327-93ec-e74ad2332675 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:20.666922 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd8994-627d-4327-93ec-e74ad2332675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:20.695719 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ebcd8994-627d-4327-93ec-e74ad2332675 None None] MFA Rules not processed for user `562be72f58d444c0bdaacefc5ef86d57`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:20.696974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ebcd8994-627d-4327-93ec-e74ad2332675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:20.763106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1407/2837] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:20.774751 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe8a02-81f0-42c2-9c8b-5c078e294072 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:20.776522 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7cbe8a02-81f0-42c2-9c8b-5c078e294072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:20.834481 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe8a02-81f0-42c2-9c8b-5c078e294072 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:20.838218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfa892-b7e2-440d-986a-7fae6ba4c20c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:20.838817 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfa892-b7e2-440d-986a-7fae6ba4c20c service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:20.839096 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfa892-b7e2-440d-986a-7fae6ba4c20c service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:20.839369 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfa892-b7e2-440d-986a-7fae6ba4c20c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:20.848302 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfa892-b7e2-440d-986a-7fae6ba4c20c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:20.850246 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfa892-b7e2-440d-986a-7fae6ba4c20c service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:20.859890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1431/2838] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:44:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:44:21.085702 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd8994-627d-4327-93ec-e74ad2332675 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:21.095325 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd8994-627d-4327-93ec-e74ad2332675 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:21.098901 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912b5b0-c141-48e6-825c-9ab604f874f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:21.100059 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b5b0-c141-48e6-825c-9ab604f874f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:21.100336 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b5b0-c141-48e6-825c-9ab604f874f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:21.100608 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b5b0-c141-48e6-825c-9ab604f874f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:21.128184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:21.156999 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912b5b0-c141-48e6-825c-9ab604f874f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:21.158416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912b5b0-c141-48e6-825c-9ab604f874f5 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:21.167327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1408/2839] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:44:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:44:30.726756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfa892-b7e2-440d-986a-7fae6ba4c20c service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:30.787652 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfa892-b7e2-440d-986a-7fae6ba4c20c service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:30.792197 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:30.792894 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:30.793171 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:30.793443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] PATH_INFO: `/v3/users/c33bfa8bc92d4d7c953ac550a3975003` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:30.794560 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33bfa8bc92d4d7c953ac550a3975003)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:30.796483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:30.977718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33bfa8bc92d4d7c953ac550a3975003'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:30.985095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33bfa8bc92d4d7c953ac550a3975003'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:30.985820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33bfa8bc92d4d7c953ac550a3975003'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:30.986435 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33bfa8bc92d4d7c953ac550a3975003'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:31.059970 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33bfa8bc92d4d7c953ac550a3975003'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:31.066998 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:31.077299 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1432/2840] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:44:30 2022] DELETE /identity/v3/users/c33bfa8bc92d4d7c953ac550a3975003 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:31.081958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdddd9a-26ba-49d2-a9b4-f3b493ee7f2b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:31.082443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdddd9a-26ba-49d2-a9b4-f3b493ee7f2b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:31.082552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdddd9a-26ba-49d2-a9b4-f3b493ee7f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:31.102774 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0fdddd9a-26ba-49d2-a9b4-f3b493ee7f2b None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:31.105377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0fdddd9a-26ba-49d2-a9b4-f3b493ee7f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:31.161061 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1409/2841] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:31.171399 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:31.172833 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:31.231422 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfecc58-9dd8-4ed2-957c-9d37645015d9 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:31.235034 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1a5f-2388-4b3c-a498-9127955e6b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:31.235629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1a5f-2388-4b3c-a498-9127955e6b63 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:31.235905 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1a5f-2388-4b3c-a498-9127955e6b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:31.236207 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1a5f-2388-4b3c-a498-9127955e6b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:31.245057 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb1a5f-2388-4b3c-a498-9127955e6b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:31.246464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb1a5f-2388-4b3c-a498-9127955e6b63 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:31.256152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1433/2842] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:44:31.679452 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdddd9a-26ba-49d2-a9b4-f3b493ee7f2b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:31.680914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0fdddd9a-26ba-49d2-a9b4-f3b493ee7f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:31.696761 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdddd9a-26ba-49d2-a9b4-f3b493ee7f2b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:31.701394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:31.702082 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:31.702935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:31.702935 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] PATH_INFO: `/v3/projects/babc5727d65d425fbb5ccb0839a12505` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:31.703900 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=babc5727d65d425fbb5ccb0839a12505)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:31.706000 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:31.836999 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'babc5727d65d425fbb5ccb0839a12505', 'request_id': 'req-aebfeb04-1b03-46be-8d21-648c676bc596'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:31.842656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'babc5727d65d425fbb5ccb0839a12505', 'request_id': 'req-aebfeb04-1b03-46be-8d21-648c676bc596'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:31.848877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'babc5727d65d425fbb5ccb0839a12505', 'request_id': 'req-aebfeb04-1b03-46be-8d21-648c676bc596'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:31.917174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] The token cache is being invalidate because project babc5727d65d425fbb5ccb0839a12505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:44:31.917489 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:31.918116 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:31.919677 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1410/2843] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:44:31 2022] DELETE /identity/v3/projects/babc5727d65d425fbb5ccb0839a12505 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:31.923620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1a5f-2388-4b3c-a498-9127955e6b63 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:31.933857 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1a5f-2388-4b3c-a498-9127955e6b63 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:31.988966 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d501d51-e6eb-43ac-9ffc-1c4eb2eba740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:31.990086 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d501d51-e6eb-43ac-9ffc-1c4eb2eba740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:31.990366 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d501d51-e6eb-43ac-9ffc-1c4eb2eba740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:31.990634 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d501d51-e6eb-43ac-9ffc-1c4eb2eba740 admin admin] PATH_INFO: `/v3/users/562be72f58d444c0bdaacefc5ef86d57` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:31.991735 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d501d51-e6eb-43ac-9ffc-1c4eb2eba740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562be72f58d444c0bdaacefc5ef86d57)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:31.993644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d501d51-e6eb-43ac-9ffc-1c4eb2eba740 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:32.251247 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6d501d51-e6eb-43ac-9ffc-1c4eb2eba740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562be72f58d444c0bdaacefc5ef86d57'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:32.258137 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6d501d51-e6eb-43ac-9ffc-1c4eb2eba740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562be72f58d444c0bdaacefc5ef86d57'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:32.258835 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6d501d51-e6eb-43ac-9ffc-1c4eb2eba740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562be72f58d444c0bdaacefc5ef86d57'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:32.259454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6d501d51-e6eb-43ac-9ffc-1c4eb2eba740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562be72f58d444c0bdaacefc5ef86d57'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:32.328718 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-6d501d51-e6eb-43ac-9ffc-1c4eb2eba740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562be72f58d444c0bdaacefc5ef86d57'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:32.346443 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1434/2844] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:44:31 2022] DELETE /identity/v3/users/562be72f58d444c0bdaacefc5ef86d57 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:32.759575 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:32.761192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:32.775570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfeb04-1b03-46be-8d21-648c676bc596 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:32.818291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:32.832887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:32.834150 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:32.834426 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:32.834696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7 admin admin] PATH_INFO: `/v3/projects/eefb4fa7796040289401f498b3039d37` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:32.835863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eefb4fa7796040289401f498b3039d37)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:32.837787 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:32.969498 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eefb4fa7796040289401f498b3039d37', 'request_id': 'req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:32.975766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eefb4fa7796040289401f498b3039d37', 'request_id': 'req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:32.982182 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eefb4fa7796040289401f498b3039d37', 'request_id': 'req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:33.089033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7 admin admin] The token cache is being invalidate because project eefb4fa7796040289401f498b3039d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:44:33.089239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:33.089881 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-173c0f47-fbf0-49aa-a4b4-28fdd044bab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:33.091357 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1411/2845] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:44:32 2022] DELETE /identity/v3/projects/eefb4fa7796040289401f498b3039d37 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:33.097184 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaba8b-cec7-43c5-ab37-daaa0fcf9816 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:33.097641 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaba8b-cec7-43c5-ab37-daaa0fcf9816 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:33.097756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eaba8b-cec7-43c5-ab37-daaa0fcf9816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:33.118620 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d8eaba8b-cec7-43c5-ab37-daaa0fcf9816 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:33.119842 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d8eaba8b-cec7-43c5-ab37-daaa0fcf9816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:33.125390 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:33.179937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1435/2846] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:33.187617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a7de2-f133-491d-86bc-b75563760ab6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:33.187902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a7de2-f133-491d-86bc-b75563760ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:33.188205 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a7de2-f133-491d-86bc-b75563760ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:33.208378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ee8a7de2-f133-491d-86bc-b75563760ab6 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:33.209636 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ee8a7de2-f133-491d-86bc-b75563760ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:33.217832 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1412/2847] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:33.224301 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eaba8b-cec7-43c5-ab37-daaa0fcf9816 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:33.234032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eaba8b-cec7-43c5-ab37-daaa0fcf9816 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:33.238617 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ee4b9-b119-4d52-a118-845b831a0ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:33.239786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee4b9-b119-4d52-a118-845b831a0ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:33.240088 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee4b9-b119-4d52-a118-845b831a0ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:33.240360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee4b9-b119-4d52-a118-845b831a0ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:33.240994 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ee4b9-b119-4d52-a118-845b831a0ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:44:33.241290 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ee4b9-b119-4d52-a118-845b831a0ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:33.242848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ee4b9-b119-4d52-a118-845b831a0ac7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:33.254459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1436/2848] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:44:33.258625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a7de2-f133-491d-86bc-b75563760ab6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:33.267550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a7de2-f133-491d-86bc-b75563760ab6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:33.272655 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda2997-80c7-4bd3-b452-b31cbbb4d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:33.273236 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda2997-80c7-4bd3-b452-b31cbbb4d2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:33.273511 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda2997-80c7-4bd3-b452-b31cbbb4d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:33.273775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda2997-80c7-4bd3-b452-b31cbbb4d2c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:33.274398 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda2997-80c7-4bd3-b452-b31cbbb4d2c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:33.276313 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda2997-80c7-4bd3-b452-b31cbbb4d2c1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:33.391883 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1413/2849] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:44:33 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:33.395892 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ee4b9-b119-4d52-a118-845b831a0ac7 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:33.406186 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ee4b9-b119-4d52-a118-845b831a0ac7 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:33.461337 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7da56-e994-4533-966f-89d883877497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:33.461928 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7da56-e994-4533-966f-89d883877497 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:33.462204 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7da56-e994-4533-966f-89d883877497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:33.462478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7da56-e994-4533-966f-89d883877497 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:33.463107 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7da56-e994-4533-966f-89d883877497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:33.465047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7da56-e994-4533-966f-89d883877497 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:33.563482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1437/2850] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:44:33 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:33.568067 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda2997-80c7-4bd3-b452-b31cbbb4d2c1 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:33.578305 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda2997-80c7-4bd3-b452-b31cbbb4d2c1 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:33.582844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d736f79-a65b-4ed1-9302-7c4c74d85106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:33.587716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d736f79-a65b-4ed1-9302-7c4c74d85106 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:33.587716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d736f79-a65b-4ed1-9302-7c4c74d85106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:33.587716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d736f79-a65b-4ed1-9302-7c4c74d85106 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:33.587716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d736f79-a65b-4ed1-9302-7c4c74d85106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:33.587716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d736f79-a65b-4ed1-9302-7c4c74d85106 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:33.596650 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1414/2851] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:33.600524 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7da56-e994-4533-966f-89d883877497 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:33.610856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7da56-e994-4533-966f-89d883877497 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:33.615568 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd3c5e-ed7f-44ff-988d-a046f7550fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:33.616325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd3c5e-ed7f-44ff-988d-a046f7550fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:33.616600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd3c5e-ed7f-44ff-988d-a046f7550fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:33.616868 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd3c5e-ed7f-44ff-988d-a046f7550fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:33.617501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd3c5e-ed7f-44ff-988d-a046f7550fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:33.619049 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd3c5e-ed7f-44ff-988d-a046f7550fd2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:33.629679 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1438/2852] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:33.634096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d736f79-a65b-4ed1-9302-7c4c74d85106 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:33.644201 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d736f79-a65b-4ed1-9302-7c4c74d85106 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:33.649428 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7437edc-3fe4-4eb0-a924-feb123d5079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:33.650100 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7437edc-3fe4-4eb0-a924-feb123d5079e admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:33.650377 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7437edc-3fe4-4eb0-a924-feb123d5079e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:33.650674 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7437edc-3fe4-4eb0-a924-feb123d5079e admin admin] PATH_INFO: `/v3/projects/86697890a6c6436685d5b6ff3336af89/users/46ea7e5eb46c4a5ea1443516f4d913bb/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:33.664897 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7437edc-3fe4-4eb0-a924-feb123d5079e admin admin] RBAC: Authorizing `identity:create_grant(project_id=86697890a6c6436685d5b6ff3336af89, user_id=46ea7e5eb46c4a5ea1443516f4d913bb, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:33.667514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7437edc-3fe4-4eb0-a924-feb123d5079e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:33.769564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1415/2853] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:44:33 2022] PUT /identity/v3/projects/86697890a6c6436685d5b6ff3336af89/users/46ea7e5eb46c4a5ea1443516f4d913bb/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:33.781975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ce819-034d-4c69-8a2e-0e1f6cd5ac3b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:33.781975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ce819-034d-4c69-8a2e-0e1f6cd5ac3b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:33.781975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ce819-034d-4c69-8a2e-0e1f6cd5ac3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:33.809983 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-019ce819-034d-4c69-8a2e-0e1f6cd5ac3b None None] MFA Rules not processed for user `46ea7e5eb46c4a5ea1443516f4d913bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:33.811194 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-019ce819-034d-4c69-8a2e-0e1f6cd5ac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:33.874104 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1439/2854] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:33.878578 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7437edc-3fe4-4eb0-a924-feb123d5079e admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:33.941044 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7437edc-3fe4-4eb0-a924-feb123d5079e admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:33.945822 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f66095-e867-4c7d-8bfa-440eb01af7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:33.946423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f66095-e867-4c7d-8bfa-440eb01af7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:33.946696 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f66095-e867-4c7d-8bfa-440eb01af7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:33.946960 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f66095-e867-4c7d-8bfa-440eb01af7d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:33.947612 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f66095-e867-4c7d-8bfa-440eb01af7d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:33.949514 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f66095-e867-4c7d-8bfa-440eb01af7d4 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:33.964586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:34.050003 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1416/2855] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:44:33 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:34.054014 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ce819-034d-4c69-8a2e-0e1f6cd5ac3b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:34.064549 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ce819-034d-4c69-8a2e-0e1f6cd5ac3b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:34.068037 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:34.122325 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5e9c8-4366-4345-910d-02e8fe0a9d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:34.122999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5e9c8-4366-4345-910d-02e8fe0a9d1e admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:34.123191 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5e9c8-4366-4345-910d-02e8fe0a9d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:34.123464 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5e9c8-4366-4345-910d-02e8fe0a9d1e admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:34.124119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5e9c8-4366-4345-910d-02e8fe0a9d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:34.126029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5e9c8-4366-4345-910d-02e8fe0a9d1e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:34.358393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1440/2856] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:44:34 2022] POST /identity/v3/users => generated 297 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:34.362363 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f66095-e867-4c7d-8bfa-440eb01af7d4 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:34.372547 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f66095-e867-4c7d-8bfa-440eb01af7d4 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:34.377032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a7806-2cb9-4a7f-b1b2-adc8723d630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:34.377621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a7806-2cb9-4a7f-b1b2-adc8723d630b admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:34.377895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a7806-2cb9-4a7f-b1b2-adc8723d630b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:34.378162 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a7806-2cb9-4a7f-b1b2-adc8723d630b admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:34.378794 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a7806-2cb9-4a7f-b1b2-adc8723d630b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:34.380975 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a7806-2cb9-4a7f-b1b2-adc8723d630b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:34.391429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1417/2857] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:34.396250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5e9c8-4366-4345-910d-02e8fe0a9d1e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:34.406056 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5e9c8-4366-4345-910d-02e8fe0a9d1e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:34.410625 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07e136-d890-4362-84d3-c2e19e9738e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:34.411262 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07e136-d890-4362-84d3-c2e19e9738e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:34.411544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07e136-d890-4362-84d3-c2e19e9738e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:34.411821 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07e136-d890-4362-84d3-c2e19e9738e0 admin admin] PATH_INFO: `/v3/projects/85e37097d1dd4d77a922aa0b1ad1ba37/users/c6c353fc04bc4629be0ed0e23f89fce9/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:34.426841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07e136-d890-4362-84d3-c2e19e9738e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e37097d1dd4d77a922aa0b1ad1ba37, user_id=c6c353fc04bc4629be0ed0e23f89fce9, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:34.429498 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07e136-d890-4362-84d3-c2e19e9738e0 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:34.534802 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1441/2858] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:44:34 2022] PUT /identity/v3/projects/85e37097d1dd4d77a922aa0b1ad1ba37/users/c6c353fc04bc4629be0ed0e23f89fce9/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:34.538836 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a7806-2cb9-4a7f-b1b2-adc8723d630b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:34.548816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a7806-2cb9-4a7f-b1b2-adc8723d630b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:34.604084 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64af3b2-3aae-4789-bae7-10fb2879a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:34.604682 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64af3b2-3aae-4789-bae7-10fb2879a890 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:34.604958 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64af3b2-3aae-4789-bae7-10fb2879a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:34.605226 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64af3b2-3aae-4789-bae7-10fb2879a890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:34.605857 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64af3b2-3aae-4789-bae7-10fb2879a890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:34.607423 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64af3b2-3aae-4789-bae7-10fb2879a890 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:34.617599 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1418/2859] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:34.621496 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07e136-d890-4362-84d3-c2e19e9738e0 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:34.631969 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07e136-d890-4362-84d3-c2e19e9738e0 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:34.636527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c03d85-d1dc-404e-8216-0de4c3622034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:34.637154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c03d85-d1dc-404e-8216-0de4c3622034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:34.637430 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c03d85-d1dc-404e-8216-0de4c3622034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:34.637700 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c03d85-d1dc-404e-8216-0de4c3622034 admin admin] PATH_INFO: `/v3/projects/85e37097d1dd4d77a922aa0b1ad1ba37/users/c6c353fc04bc4629be0ed0e23f89fce9/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:34.639566 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c03d85-d1dc-404e-8216-0de4c3622034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e37097d1dd4d77a922aa0b1ad1ba37, user_id=c6c353fc04bc4629be0ed0e23f89fce9, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:34.642177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c03d85-d1dc-404e-8216-0de4c3622034 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:34.652234 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1442/2860] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:44:34 2022] PUT /identity/v3/projects/85e37097d1dd4d77a922aa0b1ad1ba37/users/c6c353fc04bc4629be0ed0e23f89fce9/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:34.662064 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ce50-5b94-4f27-8347-5dd1c7d855d4 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:34.662347 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ce50-5b94-4f27-8347-5dd1c7d855d4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:34.662618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ce50-5b94-4f27-8347-5dd1c7d855d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:34.690227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c3d1ce50-5b94-4f27-8347-5dd1c7d855d4 None None] MFA Rules not processed for user `c6c353fc04bc4629be0ed0e23f89fce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:34.691436 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c3d1ce50-5b94-4f27-8347-5dd1c7d855d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:34.759235 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1419/2861] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:34.769767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c03d85-d1dc-404e-8216-0de4c3622034 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:34.775109 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-01c03d85-d1dc-404e-8216-0de4c3622034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:34.827887 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c03d85-d1dc-404e-8216-0de4c3622034 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:34.831538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca0a9d-b6fd-4f38-b54d-1898d4b4f82c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:34.832232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca0a9d-b6fd-4f38-b54d-1898d4b4f82c service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:34.832510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca0a9d-b6fd-4f38-b54d-1898d4b4f82c service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:34.832779 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca0a9d-b6fd-4f38-b54d-1898d4b4f82c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:34.842415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca0a9d-b6fd-4f38-b54d-1898d4b4f82c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:34.844408 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca0a9d-b6fd-4f38-b54d-1898d4b4f82c service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:34.854351 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1443/2862] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:44:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:44:34.965196 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1ce50-5b94-4f27-8347-5dd1c7d855d4 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:34.975583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1ce50-5b94-4f27-8347-5dd1c7d855d4 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:34.979440 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55e576-2e40-47d9-9e54-af5530b75c5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:34.980065 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55e576-2e40-47d9-9e54-af5530b75c5d service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:34.980339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55e576-2e40-47d9-9e54-af5530b75c5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:34.980604 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55e576-2e40-47d9-9e54-af5530b75c5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:35.035888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55e576-2e40-47d9-9e54-af5530b75c5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:35.037454 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55e576-2e40-47d9-9e54-af5530b75c5d service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:35.046146 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1420/2863] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:44:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:44:38.154809 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca0a9d-b6fd-4f38-b54d-1898d4b4f82c service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:38.214353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca0a9d-b6fd-4f38-b54d-1898d4b4f82c service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:38.218825 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:38.219433 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:38.219712 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:38.220119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] PATH_INFO: `/v3/users/46ea7e5eb46c4a5ea1443516f4d913bb` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:38.221244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ea7e5eb46c4a5ea1443516f4d913bb)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:38.223163 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:38.225962 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:38.457097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ea7e5eb46c4a5ea1443516f4d913bb'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:38.463930 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ea7e5eb46c4a5ea1443516f4d913bb'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:38.464605 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ea7e5eb46c4a5ea1443516f4d913bb'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:38.465243 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ea7e5eb46c4a5ea1443516f4d913bb'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:38.533534 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ea7e5eb46c4a5ea1443516f4d913bb'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:38.551377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1444/2864] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:44:38 2022] DELETE /identity/v3/users/46ea7e5eb46c4a5ea1443516f4d913bb => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:38.556380 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eabd9-8998-4f40-9641-9b7250597c48 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:38.556890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eabd9-8998-4f40-9641-9b7250597c48 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:38.556890 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eabd9-8998-4f40-9641-9b7250597c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:38.564752 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:38.576122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4a7eabd9-8998-4f40-9641-9b7250597c48 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:38.579294 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4a7eabd9-8998-4f40-9641-9b7250597c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:38.635099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1421/2865] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:38.644656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:38.646180 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:38.701881 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a39fc3-bcbe-4f83-8081-065cad5f0aaa admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:38.705467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3e648-57ec-4cc3-a301-8f5068e69e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:38.706091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3e648-57ec-4cc3-a301-8f5068e69e45 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:38.706370 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3e648-57ec-4cc3-a301-8f5068e69e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:38.706637 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3e648-57ec-4cc3-a301-8f5068e69e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:38.723415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3e648-57ec-4cc3-a301-8f5068e69e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:38.723415 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3e648-57ec-4cc3-a301-8f5068e69e45 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:38.726611 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1445/2866] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:44:39.153783 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eabd9-8998-4f40-9641-9b7250597c48 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:39.155215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4a7eabd9-8998-4f40-9641-9b7250597c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:39.167123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eabd9-8998-4f40-9641-9b7250597c48 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:39.171925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:39.172733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:39.173012 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:39.173324 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] PATH_INFO: `/v3/projects/86697890a6c6436685d5b6ff3336af89` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:39.175029 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] RBAC: Authorizing `identity:delete_project(project_id=86697890a6c6436685d5b6ff3336af89)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:39.177907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:39.312455 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86697890a6c6436685d5b6ff3336af89', 'request_id': 'req-c6aa2c08-8b0d-4480-b004-b6c11547c2be'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:39.318718 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86697890a6c6436685d5b6ff3336af89', 'request_id': 'req-c6aa2c08-8b0d-4480-b004-b6c11547c2be'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:39.324964 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86697890a6c6436685d5b6ff3336af89', 'request_id': 'req-c6aa2c08-8b0d-4480-b004-b6c11547c2be'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:39.431263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] The token cache is being invalidate because project 86697890a6c6436685d5b6ff3336af89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:44:39.431550 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:39.432198 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:39.433703 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1422/2867] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:44:39 2022] DELETE /identity/v3/projects/86697890a6c6436685d5b6ff3336af89 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:39.437710 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3e648-57ec-4cc3-a301-8f5068e69e45 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:39.448227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3e648-57ec-4cc3-a301-8f5068e69e45 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:39.504416 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68f0a1-0420-4b87-b360-165a3fc12897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:39.505645 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68f0a1-0420-4b87-b360-165a3fc12897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:39.505926 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68f0a1-0420-4b87-b360-165a3fc12897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:39.506199 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68f0a1-0420-4b87-b360-165a3fc12897 admin admin] PATH_INFO: `/v3/users/c6c353fc04bc4629be0ed0e23f89fce9` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:39.507333 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68f0a1-0420-4b87-b360-165a3fc12897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c353fc04bc4629be0ed0e23f89fce9)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:39.509322 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68f0a1-0420-4b87-b360-165a3fc12897 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:39.598965 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:39.863602 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0c68f0a1-0420-4b87-b360-165a3fc12897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c353fc04bc4629be0ed0e23f89fce9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:39.871160 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0c68f0a1-0420-4b87-b360-165a3fc12897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c353fc04bc4629be0ed0e23f89fce9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:39.871816 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0c68f0a1-0420-4b87-b360-165a3fc12897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c353fc04bc4629be0ed0e23f89fce9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:39.872450 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0c68f0a1-0420-4b87-b360-165a3fc12897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c353fc04bc4629be0ed0e23f89fce9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:39.996154 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-0c68f0a1-0420-4b87-b360-165a3fc12897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c353fc04bc4629be0ed0e23f89fce9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:40.020021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1446/2868] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:44:39 2022] DELETE /identity/v3/users/c6c353fc04bc4629be0ed0e23f89fce9 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:40.811080 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:40.816245 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:40.828023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa2c08-8b0d-4480-b004-b6c11547c2be admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:40.886021 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d532b6d-1eff-42d8-9746-54eaeb36b993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:40.886646 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d532b6d-1eff-42d8-9746-54eaeb36b993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:40.886920 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d532b6d-1eff-42d8-9746-54eaeb36b993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:40.887188 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d532b6d-1eff-42d8-9746-54eaeb36b993 admin admin] PATH_INFO: `/v3/projects/85e37097d1dd4d77a922aa0b1ad1ba37` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:40.888312 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d532b6d-1eff-42d8-9746-54eaeb36b993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e37097d1dd4d77a922aa0b1ad1ba37)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:40.890192 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d532b6d-1eff-42d8-9746-54eaeb36b993 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:41.037446 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:41.050131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d532b6d-1eff-42d8-9746-54eaeb36b993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e37097d1dd4d77a922aa0b1ad1ba37', 'request_id': 'req-5d532b6d-1eff-42d8-9746-54eaeb36b993'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:41.056259 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d532b6d-1eff-42d8-9746-54eaeb36b993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e37097d1dd4d77a922aa0b1ad1ba37', 'request_id': 'req-5d532b6d-1eff-42d8-9746-54eaeb36b993'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:41.062326 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d532b6d-1eff-42d8-9746-54eaeb36b993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e37097d1dd4d77a922aa0b1ad1ba37', 'request_id': 'req-5d532b6d-1eff-42d8-9746-54eaeb36b993'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:41.162904 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d532b6d-1eff-42d8-9746-54eaeb36b993 admin admin] The token cache is being invalidate because project 85e37097d1dd4d77a922aa0b1ad1ba37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:44:41.163193 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d532b6d-1eff-42d8-9746-54eaeb36b993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:41.163845 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d532b6d-1eff-42d8-9746-54eaeb36b993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:41.165332 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1423/2869] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:44:40 2022] DELETE /identity/v3/projects/85e37097d1dd4d77a922aa0b1ad1ba37 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:41.170353 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d54a0-375f-4cb4-b8b3-9786b2278f8c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:41.170853 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d54a0-375f-4cb4-b8b3-9786b2278f8c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:41.171082 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d54a0-375f-4cb4-b8b3-9786b2278f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:41.190758 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a76d54a0-375f-4cb4-b8b3-9786b2278f8c None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:41.191938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a76d54a0-375f-4cb4-b8b3-9786b2278f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:41.249403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1447/2870] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:41.257004 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffb769-3547-4c31-88fd-128d5a618343 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:41.257284 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffb769-3547-4c31-88fd-128d5a618343 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:41.257554 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffb769-3547-4c31-88fd-128d5a618343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:41.276726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-eaffb769-3547-4c31-88fd-128d5a618343 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:41.277912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-eaffb769-3547-4c31-88fd-128d5a618343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:41.285621 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1424/2871] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:41.291539 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d54a0-375f-4cb4-b8b3-9786b2278f8c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:41.301164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d54a0-375f-4cb4-b8b3-9786b2278f8c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:41.306587 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c53e4-8bcb-430c-b7c3-1a93e6429f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:41.307117 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c53e4-8bcb-430c-b7c3-1a93e6429f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:41.307391 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c53e4-8bcb-430c-b7c3-1a93e6429f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:41.307658 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c53e4-8bcb-430c-b7c3-1a93e6429f7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:41.308364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c53e4-8bcb-430c-b7c3-1a93e6429f7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:44:41.308667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c53e4-8bcb-430c-b7c3-1a93e6429f7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:41.310230 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c53e4-8bcb-430c-b7c3-1a93e6429f7c admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:41.321527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1448/2872] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:44:41.325565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffb769-3547-4c31-88fd-128d5a618343 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:41.335144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffb769-3547-4c31-88fd-128d5a618343 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:41.339743 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c8831-2ccb-4c97-92c5-2a87ec90580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:41.340367 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c8831-2ccb-4c97-92c5-2a87ec90580d admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:41.340643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c8831-2ccb-4c97-92c5-2a87ec90580d admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:41.340912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c8831-2ccb-4c97-92c5-2a87ec90580d admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:41.341532 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c8831-2ccb-4c97-92c5-2a87ec90580d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:41.343411 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c8831-2ccb-4c97-92c5-2a87ec90580d admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:41.448614 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1425/2873] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:44:41 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:41.452783 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c53e4-8bcb-430c-b7c3-1a93e6429f7c admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:41.463233 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c53e4-8bcb-430c-b7c3-1a93e6429f7c admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:41.519436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56345e1-ba4f-4f26-b733-0cd9d4d0ea05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:41.520097 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56345e1-ba4f-4f26-b733-0cd9d4d0ea05 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:41.520381 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56345e1-ba4f-4f26-b733-0cd9d4d0ea05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:41.521206 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56345e1-ba4f-4f26-b733-0cd9d4d0ea05 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:41.521808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56345e1-ba4f-4f26-b733-0cd9d4d0ea05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:41.523694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56345e1-ba4f-4f26-b733-0cd9d4d0ea05 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:41.666384 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1449/2874] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:44:41 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:41.670800 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c8831-2ccb-4c97-92c5-2a87ec90580d admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:41.681219 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c8831-2ccb-4c97-92c5-2a87ec90580d admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:41.685907 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669075b5-30f0-4179-aa8b-1f854bcfa8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:41.686507 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669075b5-30f0-4179-aa8b-1f854bcfa8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:41.686784 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669075b5-30f0-4179-aa8b-1f854bcfa8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:41.687055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669075b5-30f0-4179-aa8b-1f854bcfa8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:41.687807 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669075b5-30f0-4179-aa8b-1f854bcfa8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:41.689453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669075b5-30f0-4179-aa8b-1f854bcfa8b7 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:41.699371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1426/2875] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:41.703304 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56345e1-ba4f-4f26-b733-0cd9d4d0ea05 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:41.714005 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56345e1-ba4f-4f26-b733-0cd9d4d0ea05 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:41.718676 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adf557-424b-471a-ad55-5fc4a835cad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:41.719259 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adf557-424b-471a-ad55-5fc4a835cad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:41.719541 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adf557-424b-471a-ad55-5fc4a835cad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:41.719815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adf557-424b-471a-ad55-5fc4a835cad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:41.720488 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adf557-424b-471a-ad55-5fc4a835cad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:41.722115 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adf557-424b-471a-ad55-5fc4a835cad3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:41.733719 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1450/2876] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:41.737689 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669075b5-30f0-4179-aa8b-1f854bcfa8b7 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:41.747429 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669075b5-30f0-4179-aa8b-1f854bcfa8b7 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:41.751844 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa653f8-7aa8-4a35-88c9-ad61deab50c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:41.752517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa653f8-7aa8-4a35-88c9-ad61deab50c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:41.752796 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa653f8-7aa8-4a35-88c9-ad61deab50c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:41.753066 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa653f8-7aa8-4a35-88c9-ad61deab50c2 admin admin] PATH_INFO: `/v3/projects/41328223b1f64cc9aa33cc57211e7136/users/784a8885c006484d9709283f0646a5ae/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:41.768131 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa653f8-7aa8-4a35-88c9-ad61deab50c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41328223b1f64cc9aa33cc57211e7136, user_id=784a8885c006484d9709283f0646a5ae, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:41.770744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa653f8-7aa8-4a35-88c9-ad61deab50c2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:41.877617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1427/2877] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:44:41 2022] PUT /identity/v3/projects/41328223b1f64cc9aa33cc57211e7136/users/784a8885c006484d9709283f0646a5ae/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:41.939377 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f151e-4a81-4b3d-8d7c-f6bdd91c9729 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:41.939594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f151e-4a81-4b3d-8d7c-f6bdd91c9729 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:41.939829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f151e-4a81-4b3d-8d7c-f6bdd91c9729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:41.959830 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:41.967741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-104f151e-4a81-4b3d-8d7c-f6bdd91c9729 None None] MFA Rules not processed for user `784a8885c006484d9709283f0646a5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:41.968987 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-104f151e-4a81-4b3d-8d7c-f6bdd91c9729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:42.032139 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1451/2878] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:42.036594 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa653f8-7aa8-4a35-88c9-ad61deab50c2 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:42.097040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa653f8-7aa8-4a35-88c9-ad61deab50c2 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:42.101631 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206256ef-b4fa-4609-bcdb-8dbfcb09028f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:42.102227 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206256ef-b4fa-4609-bcdb-8dbfcb09028f admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:42.102523 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206256ef-b4fa-4609-bcdb-8dbfcb09028f admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:42.102791 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206256ef-b4fa-4609-bcdb-8dbfcb09028f admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:42.103668 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206256ef-b4fa-4609-bcdb-8dbfcb09028f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:42.105583 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206256ef-b4fa-4609-bcdb-8dbfcb09028f admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:42.191565 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1428/2879] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:44:42 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:42.196218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f151e-4a81-4b3d-8d7c-f6bdd91c9729 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:42.206741 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f151e-4a81-4b3d-8d7c-f6bdd91c9729 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:42.261628 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081260fc-9c64-4416-8c66-a61187413e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:42.262217 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081260fc-9c64-4416-8c66-a61187413e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:42.262492 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081260fc-9c64-4416-8c66-a61187413e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:42.262760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081260fc-9c64-4416-8c66-a61187413e3a admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:42.263395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081260fc-9c64-4416-8c66-a61187413e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:42.265335 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081260fc-9c64-4416-8c66-a61187413e3a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:42.356538 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1452/2880] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:44:42 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:42.360352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206256ef-b4fa-4609-bcdb-8dbfcb09028f admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:42.371210 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206256ef-b4fa-4609-bcdb-8dbfcb09028f admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:42.375768 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e597b3-631c-464e-92d9-a615583f9f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:42.376404 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e597b3-631c-464e-92d9-a615583f9f63 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:42.376685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e597b3-631c-464e-92d9-a615583f9f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:42.376956 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e597b3-631c-464e-92d9-a615583f9f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:42.377601 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e597b3-631c-464e-92d9-a615583f9f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:42.379170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e597b3-631c-464e-92d9-a615583f9f63 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:42.390181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1429/2881] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:42.394205 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081260fc-9c64-4416-8c66-a61187413e3a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:42.404249 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081260fc-9c64-4416-8c66-a61187413e3a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:42.408897 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b6b9d-7ce0-4762-bf52-2f553a2a69a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:42.409533 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b6b9d-7ce0-4762-bf52-2f553a2a69a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:42.409808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b6b9d-7ce0-4762-bf52-2f553a2a69a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:42.410081 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b6b9d-7ce0-4762-bf52-2f553a2a69a4 admin admin] PATH_INFO: `/v3/projects/7298d72ac4f34e5a950bc99581925761/users/103bfa6f3d024d719f1adaecdd8c90f2/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:42.424338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b6b9d-7ce0-4762-bf52-2f553a2a69a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7298d72ac4f34e5a950bc99581925761, user_id=103bfa6f3d024d719f1adaecdd8c90f2, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:42.427459 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b6b9d-7ce0-4762-bf52-2f553a2a69a4 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:42.504820 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1453/2882] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:44:42 2022] PUT /identity/v3/projects/7298d72ac4f34e5a950bc99581925761/users/103bfa6f3d024d719f1adaecdd8c90f2/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:44:42.509396 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e597b3-631c-464e-92d9-a615583f9f63 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:42.519417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e597b3-631c-464e-92d9-a615583f9f63 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:42.545539 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:42.575645 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6eb1-c490-4e6c-99ab-308e2e9aa5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:42.576271 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6eb1-c490-4e6c-99ab-308e2e9aa5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:42.576548 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6eb1-c490-4e6c-99ab-308e2e9aa5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:42.576816 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6eb1-c490-4e6c-99ab-308e2e9aa5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:42.577445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab6eb1-c490-4e6c-99ab-308e2e9aa5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:42.579070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab6eb1-c490-4e6c-99ab-308e2e9aa5d9 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:42.589718 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1430/2883] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:42.598669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b6b9d-7ce0-4762-bf52-2f553a2a69a4 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:42.604690 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b6b9d-7ce0-4762-bf52-2f553a2a69a4 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:42.609412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2277-b6aa-4a9d-812a-5e45ffe1bfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:42.610047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2277-b6aa-4a9d-812a-5e45ffe1bfe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:42.610327 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2277-b6aa-4a9d-812a-5e45ffe1bfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:42.610603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2277-b6aa-4a9d-812a-5e45ffe1bfe3 admin admin] PATH_INFO: `/v3/projects/7298d72ac4f34e5a950bc99581925761/users/103bfa6f3d024d719f1adaecdd8c90f2/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:42.612594 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2277-b6aa-4a9d-812a-5e45ffe1bfe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7298d72ac4f34e5a950bc99581925761, user_id=103bfa6f3d024d719f1adaecdd8c90f2, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:42.615225 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2277-b6aa-4a9d-812a-5e45ffe1bfe3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:42.625373 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1454/2884] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:44:42 2022] PUT /identity/v3/projects/7298d72ac4f34e5a950bc99581925761/users/103bfa6f3d024d719f1adaecdd8c90f2/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:42.635632 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b9564-5263-4d63-b102-a98b77f85dc4 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:42.635912 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b9564-5263-4d63-b102-a98b77f85dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:42.636213 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b9564-5263-4d63-b102-a98b77f85dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:42.663480 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-331b9564-5263-4d63-b102-a98b77f85dc4 None None] MFA Rules not processed for user `103bfa6f3d024d719f1adaecdd8c90f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:42.664744 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-331b9564-5263-4d63-b102-a98b77f85dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:42.735300 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1431/2885] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:42.746482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2277-b6aa-4a9d-812a-5e45ffe1bfe3 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:42.748158 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fe9f2277-b6aa-4a9d-812a-5e45ffe1bfe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:42.804278 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2277-b6aa-4a9d-812a-5e45ffe1bfe3 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:42.807862 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d814ab-cbb7-4dc8-806b-6969c5ebe840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:42.808488 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d814ab-cbb7-4dc8-806b-6969c5ebe840 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:42.808761 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d814ab-cbb7-4dc8-806b-6969c5ebe840 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:42.809028 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d814ab-cbb7-4dc8-806b-6969c5ebe840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:42.814725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:42.818350 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d814ab-cbb7-4dc8-806b-6969c5ebe840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:42.820493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d814ab-cbb7-4dc8-806b-6969c5ebe840 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:42.828960 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1455/2886] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:44:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:44:42.964681 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b9564-5263-4d63-b102-a98b77f85dc4 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:43.024309 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b9564-5263-4d63-b102-a98b77f85dc4 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:43.028670 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:43.029290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:43.029564 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:43.029833 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] PATH_INFO: `/v3/users/784a8885c006484d9709283f0646a5ae` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:43.030930 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=784a8885c006484d9709283f0646a5ae)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:43.032866 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:43.199533 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784a8885c006484d9709283f0646a5ae'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:43.204101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:43.206971 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784a8885c006484d9709283f0646a5ae'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:43.207628 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784a8885c006484d9709283f0646a5ae'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:43.294641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784a8885c006484d9709283f0646a5ae'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:43.306963 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784a8885c006484d9709283f0646a5ae'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:43.312987 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1432/2887] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:44:42 2022] DELETE /identity/v3/users/784a8885c006484d9709283f0646a5ae => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:43.317999 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f3cc6-fefe-47df-bd00-298895ff1ac3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:43.318483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f3cc6-fefe-47df-bd00-298895ff1ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:43.318603 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f3cc6-fefe-47df-bd00-298895ff1ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:43.338729 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fe2f3cc6-fefe-47df-bd00-298895ff1ac3 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:43.339909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fe2f3cc6-fefe-47df-bd00-298895ff1ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:43.395196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1456/2888] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:43.406215 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:43.407684 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:43.463874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede5a3d-5dc8-4f8f-986d-8323e6c15d1b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:43.467453 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45ee01-05d5-451c-be22-7ad4c597726d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:43.468080 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45ee01-05d5-451c-be22-7ad4c597726d service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:43.468356 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45ee01-05d5-451c-be22-7ad4c597726d service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:43.468623 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45ee01-05d5-451c-be22-7ad4c597726d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:43.477491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45ee01-05d5-451c-be22-7ad4c597726d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:43.479240 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45ee01-05d5-451c-be22-7ad4c597726d service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:43.488766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1433/2889] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:44:43.896942 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f3cc6-fefe-47df-bd00-298895ff1ac3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:43.898760 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fe2f3cc6-fefe-47df-bd00-298895ff1ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:43.918618 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f3cc6-fefe-47df-bd00-298895ff1ac3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:43.926582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:43.928216 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:43.928700 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:43.929174 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] PATH_INFO: `/v3/projects/41328223b1f64cc9aa33cc57211e7136` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:43.931085 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41328223b1f64cc9aa33cc57211e7136)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:43.934177 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:44.021043 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41328223b1f64cc9aa33cc57211e7136', 'request_id': 'req-a74b0c52-02fa-4172-bcea-29cf669683c3'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:44.026571 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41328223b1f64cc9aa33cc57211e7136', 'request_id': 'req-a74b0c52-02fa-4172-bcea-29cf669683c3'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:44.071768 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41328223b1f64cc9aa33cc57211e7136', 'request_id': 'req-a74b0c52-02fa-4172-bcea-29cf669683c3'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:44.083076 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] The token cache is being invalidate because project 41328223b1f64cc9aa33cc57211e7136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:44:44.083412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:44.084123 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:44.085586 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1457/2890] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:44:43 2022] DELETE /identity/v3/projects/41328223b1f64cc9aa33cc57211e7136 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:44.089610 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45ee01-05d5-451c-be22-7ad4c597726d service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:44.100316 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45ee01-05d5-451c-be22-7ad4c597726d service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:44.156194 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76aa181-fc15-44e4-a284-648eec0827d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:44.156821 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76aa181-fc15-44e4-a284-648eec0827d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:44.157094 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76aa181-fc15-44e4-a284-648eec0827d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:44.157359 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76aa181-fc15-44e4-a284-648eec0827d2 admin admin] PATH_INFO: `/v3/users/103bfa6f3d024d719f1adaecdd8c90f2` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:44.158439 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76aa181-fc15-44e4-a284-648eec0827d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=103bfa6f3d024d719f1adaecdd8c90f2)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:44.160378 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76aa181-fc15-44e4-a284-648eec0827d2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:44.330738 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c76aa181-fc15-44e4-a284-648eec0827d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103bfa6f3d024d719f1adaecdd8c90f2'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:44.337727 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c76aa181-fc15-44e4-a284-648eec0827d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103bfa6f3d024d719f1adaecdd8c90f2'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:44.338379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c76aa181-fc15-44e4-a284-648eec0827d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103bfa6f3d024d719f1adaecdd8c90f2'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:44.626073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c76aa181-fc15-44e4-a284-648eec0827d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103bfa6f3d024d719f1adaecdd8c90f2'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:44.634618 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:44.639134 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-c76aa181-fc15-44e4-a284-648eec0827d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103bfa6f3d024d719f1adaecdd8c90f2'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:44.645124 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1434/2891] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:44:44 2022] DELETE /identity/v3/users/103bfa6f3d024d719f1adaecdd8c90f2 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:45.107664 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:45.109133 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:45.122574 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b0c52-02fa-4172-bcea-29cf669683c3 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:45.180808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca941f-e583-4680-ac03-058f323071a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:45.181436 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca941f-e583-4680-ac03-058f323071a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:45.181716 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca941f-e583-4680-ac03-058f323071a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:45.181989 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca941f-e583-4680-ac03-058f323071a9 admin admin] PATH_INFO: `/v3/projects/7298d72ac4f34e5a950bc99581925761` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:45.183093 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca941f-e583-4680-ac03-058f323071a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7298d72ac4f34e5a950bc99581925761)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:45.185061 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca941f-e583-4680-ac03-058f323071a9 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:45.205270 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:45.328562 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4bca941f-e583-4680-ac03-058f323071a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7298d72ac4f34e5a950bc99581925761', 'request_id': 'req-4bca941f-e583-4680-ac03-058f323071a9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:45.334546 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4bca941f-e583-4680-ac03-058f323071a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7298d72ac4f34e5a950bc99581925761', 'request_id': 'req-4bca941f-e583-4680-ac03-058f323071a9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:45.414304 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4bca941f-e583-4680-ac03-058f323071a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7298d72ac4f34e5a950bc99581925761', 'request_id': 'req-4bca941f-e583-4680-ac03-058f323071a9'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:45.425480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4bca941f-e583-4680-ac03-058f323071a9 admin admin] The token cache is being invalidate because project 7298d72ac4f34e5a950bc99581925761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:44:45.425773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4bca941f-e583-4680-ac03-058f323071a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:45.426441 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-4bca941f-e583-4680-ac03-058f323071a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:45.428485 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1458/2892] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:44:45 2022] DELETE /identity/v3/projects/7298d72ac4f34e5a950bc99581925761 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:45.434517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a05d8-8a3a-44a6-8e8c-af7037576b20 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:45.435008 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a05d8-8a3a-44a6-8e8c-af7037576b20 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:45.435126 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a05d8-8a3a-44a6-8e8c-af7037576b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:45.456264 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e86a05d8-8a3a-44a6-8e8c-af7037576b20 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:45.457451 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e86a05d8-8a3a-44a6-8e8c-af7037576b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:45.515037 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1435/2893] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:45.524033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7b333-ee4a-47bc-bed2-fa63bd36ad00 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:45.524324 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7b333-ee4a-47bc-bed2-fa63bd36ad00 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:45.524600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7b333-ee4a-47bc-bed2-fa63bd36ad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:45.544763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6ac7b333-ee4a-47bc-bed2-fa63bd36ad00 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:45.545969 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6ac7b333-ee4a-47bc-bed2-fa63bd36ad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:45.554482 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1459/2894] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:45.558615 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a05d8-8a3a-44a6-8e8c-af7037576b20 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:45.568310 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a05d8-8a3a-44a6-8e8c-af7037576b20 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:45.572906 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6ad59-3ad9-441a-8b8c-17f0b30e4926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:45.573501 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ad59-3ad9-441a-8b8c-17f0b30e4926 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:45.573778 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ad59-3ad9-441a-8b8c-17f0b30e4926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:45.574045 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ad59-3ad9-441a-8b8c-17f0b30e4926 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:45.574695 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6ad59-3ad9-441a-8b8c-17f0b30e4926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:44:45.574991 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6ad59-3ad9-441a-8b8c-17f0b30e4926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:45.576596 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6ad59-3ad9-441a-8b8c-17f0b30e4926 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:45.587763 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1436/2895] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:44:45.591667 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7b333-ee4a-47bc-bed2-fa63bd36ad00 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:45.601403 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7b333-ee4a-47bc-bed2-fa63bd36ad00 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:45.606383 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734abca-6ff7-49e9-8eb7-91abc0e7656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:45.606969 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734abca-6ff7-49e9-8eb7-91abc0e7656a admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:45.607277 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734abca-6ff7-49e9-8eb7-91abc0e7656a admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:45.607580 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734abca-6ff7-49e9-8eb7-91abc0e7656a admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:45.608257 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734abca-6ff7-49e9-8eb7-91abc0e7656a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:45.610127 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734abca-6ff7-49e9-8eb7-91abc0e7656a admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:45.713106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1460/2896] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:44:45 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:45.717001 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6ad59-3ad9-441a-8b8c-17f0b30e4926 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:45.727707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6ad59-3ad9-441a-8b8c-17f0b30e4926 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:45.782545 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c704d8-cb55-41e5-8e03-06cd32b1d6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:45.783139 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c704d8-cb55-41e5-8e03-06cd32b1d6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:45.783418 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c704d8-cb55-41e5-8e03-06cd32b1d6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:45.783692 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c704d8-cb55-41e5-8e03-06cd32b1d6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:45.784345 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c704d8-cb55-41e5-8e03-06cd32b1d6e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:45.786862 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c704d8-cb55-41e5-8e03-06cd32b1d6e5 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:45.871795 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1437/2897] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:44:45 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:45.875890 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734abca-6ff7-49e9-8eb7-91abc0e7656a admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:45.886793 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734abca-6ff7-49e9-8eb7-91abc0e7656a admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:45.891444 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadce5c-70eb-4409-969c-fd62506530f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:45.892089 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadce5c-70eb-4409-969c-fd62506530f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:45.892373 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadce5c-70eb-4409-969c-fd62506530f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:45.892648 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadce5c-70eb-4409-969c-fd62506530f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:45.893288 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadce5c-70eb-4409-969c-fd62506530f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:45.894861 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadce5c-70eb-4409-969c-fd62506530f4 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:45.905467 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1461/2898] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:45.909371 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c704d8-cb55-41e5-8e03-06cd32b1d6e5 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:45.920996 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c704d8-cb55-41e5-8e03-06cd32b1d6e5 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:45.925595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7790c6-3b98-46bd-8c9f-95d00e729853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:45.926270 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7790c6-3b98-46bd-8c9f-95d00e729853 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:45.926570 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7790c6-3b98-46bd-8c9f-95d00e729853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:45.926837 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7790c6-3b98-46bd-8c9f-95d00e729853 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:45.927647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7790c6-3b98-46bd-8c9f-95d00e729853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:45.929257 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7790c6-3b98-46bd-8c9f-95d00e729853 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:45.940553 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1438/2899] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:45.944846 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadce5c-70eb-4409-969c-fd62506530f4 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:45.954773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadce5c-70eb-4409-969c-fd62506530f4 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:45.959932 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0f252-c9e1-4d3b-9448-9ad3d8337962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:45.960598 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0f252-c9e1-4d3b-9448-9ad3d8337962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:45.960884 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0f252-c9e1-4d3b-9448-9ad3d8337962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:45.961159 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0f252-c9e1-4d3b-9448-9ad3d8337962 admin admin] PATH_INFO: `/v3/projects/754e2e1bee4640458f5e3c3dd18054b7/users/68e4e1eb65db4f95b435a82d40ca72a7/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:45.976164 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0f252-c9e1-4d3b-9448-9ad3d8337962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=754e2e1bee4640458f5e3c3dd18054b7, user_id=68e4e1eb65db4f95b435a82d40ca72a7, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:45.978984 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0f252-c9e1-4d3b-9448-9ad3d8337962 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:46.077147 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1462/2900] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:44:45 2022] PUT /identity/v3/projects/754e2e1bee4640458f5e3c3dd18054b7/users/68e4e1eb65db4f95b435a82d40ca72a7/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:46.087939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d303179-c452-4f07-9c4b-749280114283 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:46.088253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d303179-c452-4f07-9c4b-749280114283 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:46.088521 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d303179-c452-4f07-9c4b-749280114283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:46.117014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0d303179-c452-4f07-9c4b-749280114283 None None] MFA Rules not processed for user `68e4e1eb65db4f95b435a82d40ca72a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:46.118314 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0d303179-c452-4f07-9c4b-749280114283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:46.162679 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:46.182110 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1439/2901] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:46.192824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0f252-c9e1-4d3b-9448-9ad3d8337962 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:46.194507 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-05f0f252-c9e1-4d3b-9448-9ad3d8337962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:46.252559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0f252-c9e1-4d3b-9448-9ad3d8337962 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:46.256757 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cece2-4b5e-4ee5-895d-cad8a8a9e66a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf4d6e392fd4f8dadb37527f1750fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:46.257358 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cece2-4b5e-4ee5-895d-cad8a8a9e66a service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:46.257639 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cece2-4b5e-4ee5-895d-cad8a8a9e66a service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:46.257910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cece2-4b5e-4ee5-895d-cad8a8a9e66a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:46.266279 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cece2-4b5e-4ee5-895d-cad8a8a9e66a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:46.267695 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cece2-4b5e-4ee5-895d-cad8a8a9e66a service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:46.277193 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1463/2902] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:44:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:44:54.549917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d303179-c452-4f07-9c4b-749280114283 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:54.551327 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0d303179-c452-4f07-9c4b-749280114283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:54.607400 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d303179-c452-4f07-9c4b-749280114283 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:54.611023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10b35-e448-424d-afbd-8a21d5b41bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:54.611688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10b35-e448-424d-afbd-8a21d5b41bed service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:54.611994 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10b35-e448-424d-afbd-8a21d5b41bed service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:54.612267 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10b35-e448-424d-afbd-8a21d5b41bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:54.614184 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-08f10b35-e448-424d-afbd-8a21d5b41bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:54.684982 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f10b35-e448-424d-afbd-8a21d5b41bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:54.686352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f10b35-e448-424d-afbd-8a21d5b41bed service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:54.698470 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1440/2903] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:44:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:44:55.883196 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cece2-4b5e-4ee5-895d-cad8a8a9e66a service cinder] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:55.885038 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ec8cece2-4b5e-4ee5-895d-cad8a8a9e66a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:55.898249 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cece2-4b5e-4ee5-895d-cad8a8a9e66a service cinder] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:55.902051 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130711c-2be8-4ae3-bf5d-bd0a963361a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:55.902696 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130711c-2be8-4ae3-bf5d-bd0a963361a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:55.902981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130711c-2be8-4ae3-bf5d-bd0a963361a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:55.903250 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130711c-2be8-4ae3-bf5d-bd0a963361a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:55.904984 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f130711c-2be8-4ae3-bf5d-bd0a963361a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:55.920903 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130711c-2be8-4ae3-bf5d-bd0a963361a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:55.922595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130711c-2be8-4ae3-bf5d-bd0a963361a4 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:55.934876 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1464/2904] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:44:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 10:44:58.134493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10b35-e448-424d-afbd-8a21d5b41bed service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:58.195156 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10b35-e448-424d-afbd-8a21d5b41bed service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:58.199531 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:58.200173 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:58.200445 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:58.200712 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] PATH_INFO: `/v3/users/68e4e1eb65db4f95b435a82d40ca72a7` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:58.201806 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e4e1eb65db4f95b435a82d40ca72a7)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:58.203701 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:58.391497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:58.405339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e4e1eb65db4f95b435a82d40ca72a7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:58.413175 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e4e1eb65db4f95b435a82d40ca72a7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:58.413873 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e4e1eb65db4f95b435a82d40ca72a7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:58.482874 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e4e1eb65db4f95b435a82d40ca72a7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:58.496033 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e4e1eb65db4f95b435a82d40ca72a7'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:58.502368 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1441/2905] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:44:58 2022] DELETE /identity/v3/users/68e4e1eb65db4f95b435a82d40ca72a7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:58.506906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942b3a-ca69-4556-9209-dbe345c3ba24 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:58.507329 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942b3a-ca69-4556-9209-dbe345c3ba24 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:58.507453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942b3a-ca69-4556-9209-dbe345c3ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:58.526394 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-03942b3a-ca69-4556-9209-dbe345c3ba24 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:58.527583 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-03942b3a-ca69-4556-9209-dbe345c3ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:58.556746 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:58.584971 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1465/2906] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:58.594888 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:58.596339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:58.654775 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd8866-e78d-49f1-a703-3e34430e088e admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:58.658443 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7494ad7-b2e2-44fb-a5bb-c41da557539e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:58.659070 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7494ad7-b2e2-44fb-a5bb-c41da557539e service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:58.659352 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7494ad7-b2e2-44fb-a5bb-c41da557539e service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:58.659627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7494ad7-b2e2-44fb-a5bb-c41da557539e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:58.669361 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7494ad7-b2e2-44fb-a5bb-c41da557539e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:58.670787 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7494ad7-b2e2-44fb-a5bb-c41da557539e service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:58.680917 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1442/2907] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:44:59.101686 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03942b3a-ca69-4556-9209-dbe345c3ba24 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:59.103175 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-03942b3a-ca69-4556-9209-dbe345c3ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:59.117072 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03942b3a-ca69-4556-9209-dbe345c3ba24 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:59.121927 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369246d-0fd0-4419-8b77-c15e0f8c68f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:59.122483 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369246d-0fd0-4419-8b77-c15e0f8c68f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:59.123559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369246d-0fd0-4419-8b77-c15e0f8c68f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:59.123559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369246d-0fd0-4419-8b77-c15e0f8c68f1 admin admin] PATH_INFO: `/v3/projects/754e2e1bee4640458f5e3c3dd18054b7` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:59.124214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369246d-0fd0-4419-8b77-c15e0f8c68f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=754e2e1bee4640458f5e3c3dd18054b7)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:59.126095 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369246d-0fd0-4419-8b77-c15e0f8c68f1 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:59.237426 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1369246d-0fd0-4419-8b77-c15e0f8c68f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754e2e1bee4640458f5e3c3dd18054b7', 'request_id': 'req-1369246d-0fd0-4419-8b77-c15e0f8c68f1'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:59.243523 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1369246d-0fd0-4419-8b77-c15e0f8c68f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754e2e1bee4640458f5e3c3dd18054b7', 'request_id': 'req-1369246d-0fd0-4419-8b77-c15e0f8c68f1'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:59.328600 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1369246d-0fd0-4419-8b77-c15e0f8c68f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754e2e1bee4640458f5e3c3dd18054b7', 'request_id': 'req-1369246d-0fd0-4419-8b77-c15e0f8c68f1'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:59.339966 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1369246d-0fd0-4419-8b77-c15e0f8c68f1 admin admin] The token cache is being invalidate because project 754e2e1bee4640458f5e3c3dd18054b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:44:59.340266 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1369246d-0fd0-4419-8b77-c15e0f8c68f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:59.340881 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-1369246d-0fd0-4419-8b77-c15e0f8c68f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:44:59.342341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1466/2908] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:44:59 2022] DELETE /identity/v3/projects/754e2e1bee4640458f5e3c3dd18054b7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:44:59.347291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4ef46-3956-44f6-9077-5228020932eb None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:59.347748 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4ef46-3956-44f6-9077-5228020932eb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:59.347860 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4ef46-3956-44f6-9077-5228020932eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:59.368416 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-2db4ef46-3956-44f6-9077-5228020932eb None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:59.369617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2db4ef46-3956-44f6-9077-5228020932eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:59.430265 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1443/2909] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:59.438219 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2576893-4e08-4571-96d2-126fa6dc4efa None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:59.438506 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2576893-4e08-4571-96d2-126fa6dc4efa None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:59.438815 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2576893-4e08-4571-96d2-126fa6dc4efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:59.461073 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d2576893-4e08-4571-96d2-126fa6dc4efa None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:44:59.462316 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d2576893-4e08-4571-96d2-126fa6dc4efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:44:59.470398 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1467/2910] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:44:59.475073 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4ef46-3956-44f6-9077-5228020932eb None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:59.485122 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4ef46-3956-44f6-9077-5228020932eb None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:59.489877 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf1e7f-6040-4232-8ec1-cfad587a21b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:59.490481 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf1e7f-6040-4232-8ec1-cfad587a21b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:59.490750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf1e7f-6040-4232-8ec1-cfad587a21b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:59.491022 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf1e7f-6040-4232-8ec1-cfad587a21b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:59.491669 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf1e7f-6040-4232-8ec1-cfad587a21b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 10:44:59.491999 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf1e7f-6040-4232-8ec1-cfad587a21b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:59.493580 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf1e7f-6040-4232-8ec1-cfad587a21b2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:59.506304 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1444/2911] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 10:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 10:44:59.511168 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2576893-4e08-4571-96d2-126fa6dc4efa None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:59.520837 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2576893-4e08-4571-96d2-126fa6dc4efa None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:59.526227 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863d085-bf6a-4c24-9af1-afed08b44855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:59.526937 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863d085-bf6a-4c24-9af1-afed08b44855 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:59.527334 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863d085-bf6a-4c24-9af1-afed08b44855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:59.527703 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863d085-bf6a-4c24-9af1-afed08b44855 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:59.528480 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863d085-bf6a-4c24-9af1-afed08b44855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:59.530669 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863d085-bf6a-4c24-9af1-afed08b44855 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:59.646135 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1468/2912] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:44:59 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:59.669661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf1e7f-6040-4232-8ec1-cfad587a21b2 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:59.680148 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf1e7f-6040-4232-8ec1-cfad587a21b2 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:59.713656 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:44:59.737526 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf77dcf-eeef-4ac6-aaf1-88dbb0fbf78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:59.738129 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf77dcf-eeef-4ac6-aaf1-88dbb0fbf78b admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:59.738403 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf77dcf-eeef-4ac6-aaf1-88dbb0fbf78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:59.738716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf77dcf-eeef-4ac6-aaf1-88dbb0fbf78b admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:59.739342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf77dcf-eeef-4ac6-aaf1-88dbb0fbf78b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:59.741256 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf77dcf-eeef-4ac6-aaf1-88dbb0fbf78b admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:59.923561 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1445/2913] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:44:59 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:44:59.928572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863d085-bf6a-4c24-9af1-afed08b44855 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:59.937869 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863d085-bf6a-4c24-9af1-afed08b44855 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:59.943080 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eae46-72d8-486d-8ba9-fd337a3fcbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:59.943678 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eae46-72d8-486d-8ba9-fd337a3fcbbf admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:59.943996 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eae46-72d8-486d-8ba9-fd337a3fcbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:59.944271 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eae46-72d8-486d-8ba9-fd337a3fcbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:59.944906 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40eae46-72d8-486d-8ba9-fd337a3fcbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:59.946463 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40eae46-72d8-486d-8ba9-fd337a3fcbbf admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:59.957165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1469/2914] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:59.961797 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf77dcf-eeef-4ac6-aaf1-88dbb0fbf78b admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:44:59.971790 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf77dcf-eeef-4ac6-aaf1-88dbb0fbf78b admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:44:59.976342 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263932c-e993-46ab-b031-1ca8674d0713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:44:59.976925 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263932c-e993-46ab-b031-1ca8674d0713 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:44:59.977200 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263932c-e993-46ab-b031-1ca8674d0713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:44:59.977493 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263932c-e993-46ab-b031-1ca8674d0713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:44:59.978128 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263932c-e993-46ab-b031-1ca8674d0713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:44:59.980218 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263932c-e993-46ab-b031-1ca8674d0713 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:44:59.991394 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1446/2915] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:44:59.995360 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eae46-72d8-486d-8ba9-fd337a3fcbbf admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:00.005624 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eae46-72d8-486d-8ba9-fd337a3fcbbf admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:00.010222 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb790fb8-09a5-4ff8-aa37-627363f4c483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:00.010849 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb790fb8-09a5-4ff8-aa37-627363f4c483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:00.011124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb790fb8-09a5-4ff8-aa37-627363f4c483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:00.011395 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb790fb8-09a5-4ff8-aa37-627363f4c483 admin admin] PATH_INFO: `/v3/projects/67ab0032a84d497aa0bf51cce5f2e623/users/9e33c95eafec48f4b6825baf3373562d/roles/c071e1d121a643a48556e6287cde21c0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:00.026909 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb790fb8-09a5-4ff8-aa37-627363f4c483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ab0032a84d497aa0bf51cce5f2e623, user_id=9e33c95eafec48f4b6825baf3373562d, role_id=c071e1d121a643a48556e6287cde21c0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:00.029597 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb790fb8-09a5-4ff8-aa37-627363f4c483 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:00.111824 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1470/2916] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:44:59 2022] PUT /identity/v3/projects/67ab0032a84d497aa0bf51cce5f2e623/users/9e33c95eafec48f4b6825baf3373562d/roles/c071e1d121a643a48556e6287cde21c0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:45:00.117415 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679c4e1-a0e1-4135-8577-c9ed475e4bd5 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:00.118771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679c4e1-a0e1-4135-8577-c9ed475e4bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:00.118771 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679c4e1-a0e1-4135-8577-c9ed475e4bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:00.137726 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6679c4e1-a0e1-4135-8577-c9ed475e4bd5 None None] MFA Rules not processed for user `a9b9514cc6bc4f96b9c765b74b45116f`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:45:00.138938 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6679c4e1-a0e1-4135-8577-c9ed475e4bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:00.195641 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1447/2917] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:45:00.205033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb790fb8-09a5-4ff8-aa37-627363f4c483 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:00.206767 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bb790fb8-09a5-4ff8-aa37-627363f4c483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:00.262527 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb790fb8-09a5-4ff8-aa37-627363f4c483 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:00.266192 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1660ce-2521-49b8-8455-22c73f84b1c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:00.266786 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1660ce-2521-49b8-8455-22c73f84b1c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:00.267065 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1660ce-2521-49b8-8455-22c73f84b1c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:00.267338 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1660ce-2521-49b8-8455-22c73f84b1c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:00.274457 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:00.276628 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1660ce-2521-49b8-8455-22c73f84b1c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:00.278032 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1660ce-2521-49b8-8455-22c73f84b1c6 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:00.287218 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1471/2918] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:45:05.187892 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679c4e1-a0e1-4135-8577-c9ed475e4bd5 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:05.198556 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679c4e1-a0e1-4135-8577-c9ed475e4bd5 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:05.202230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7b641-3433-4c82-a8b0-a90db7a15c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:05.202840 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7b641-3433-4c82-a8b0-a90db7a15c60 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:05.203125 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7b641-3433-4c82-a8b0-a90db7a15c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:05.203397 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7b641-3433-4c82-a8b0-a90db7a15c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:05.205410 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a0f7b641-3433-4c82-a8b0-a90db7a15c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:05.216351 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7b641-3433-4c82-a8b0-a90db7a15c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:05.217709 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7b641-3433-4c82-a8b0-a90db7a15c60 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:05.226914 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1448/2919] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:45:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:45:06.418152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130487e-7b5b-4f5f-a3f9-ab45c43cfb58 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:06.418660 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130487e-7b5b-4f5f-a3f9-ab45c43cfb58 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:06.418778 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130487e-7b5b-4f5f-a3f9-ab45c43cfb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:06.445453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d130487e-7b5b-4f5f-a3f9-ab45c43cfb58 None None] MFA Rules not processed for user `9e33c95eafec48f4b6825baf3373562d`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:45:06.446654 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d130487e-7b5b-4f5f-a3f9-ab45c43cfb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:06.512982 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1472/2920] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:45:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:45:06.517504 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7b641-3433-4c82-a8b0-a90db7a15c60 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:06.530401 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7b641-3433-4c82-a8b0-a90db7a15c60 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:06.536083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770894e-ce89-475a-a877-0f48534cb9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:06.536716 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770894e-ce89-475a-a877-0f48534cb9ea admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:06.536992 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770894e-ce89-475a-a877-0f48534cb9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:06.537264 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770894e-ce89-475a-a877-0f48534cb9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:06.537908 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770894e-ce89-475a-a877-0f48534cb9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:06.539802 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770894e-ce89-475a-a877-0f48534cb9ea admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:06.634425 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1449/2921] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 10:45:06 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 10:45:06.638544 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130487e-7b5b-4f5f-a3f9-ab45c43cfb58 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:06.655110 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130487e-7b5b-4f5f-a3f9-ab45c43cfb58 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:06.714877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d72b-e54e-40ab-b65d-d6f11704130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:06.715478 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d72b-e54e-40ab-b65d-d6f11704130f admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:06.715755 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d72b-e54e-40ab-b65d-d6f11704130f admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:06.716053 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d72b-e54e-40ab-b65d-d6f11704130f admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:06.716680 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d72b-e54e-40ab-b65d-d6f11704130f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:06.718699 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d72b-e54e-40ab-b65d-d6f11704130f admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:06.836192 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1473/2922] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 10:45:06 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 10:45:06.837485 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770894e-ce89-475a-a877-0f48534cb9ea admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:06.849494 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770894e-ce89-475a-a877-0f48534cb9ea admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:06.854552 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1861-015f-4ce9-850d-1b53987a9886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:06.855206 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1861-015f-4ce9-850d-1b53987a9886 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:06.855497 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1861-015f-4ce9-850d-1b53987a9886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:06.855772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1861-015f-4ce9-850d-1b53987a9886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:06.856464 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b1861-015f-4ce9-850d-1b53987a9886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:06.858085 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b1861-015f-4ce9-850d-1b53987a9886 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:06.873040 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1450/2923] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:45:06.874303 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d72b-e54e-40ab-b65d-d6f11704130f admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:06.886189 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d72b-e54e-40ab-b65d-d6f11704130f admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:06.893047 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67c06f-ce9d-4ddb-baae-ea7f5dc0a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:06.893981 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67c06f-ce9d-4ddb-baae-ea7f5dc0a931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:06.894328 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67c06f-ce9d-4ddb-baae-ea7f5dc0a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:06.895378 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67c06f-ce9d-4ddb-baae-ea7f5dc0a931 admin admin] PATH_INFO: `/v3/projects/4c9ce50524fb4edfb11cb146c7bba39e/users/3767a2d25ad048e9bdec8419c758715c/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:06.921258 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67c06f-ce9d-4ddb-baae-ea7f5dc0a931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c9ce50524fb4edfb11cb146c7bba39e, user_id=3767a2d25ad048e9bdec8419c758715c, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:06.924599 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67c06f-ce9d-4ddb-baae-ea7f5dc0a931 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:07.027260 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1474/2924] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:45:06 2022] PUT /identity/v3/projects/4c9ce50524fb4edfb11cb146c7bba39e/users/3767a2d25ad048e9bdec8419c758715c/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:45:07.031460 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1861-015f-4ce9-850d-1b53987a9886 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:07.043278 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1861-015f-4ce9-850d-1b53987a9886 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:07.103133 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf7551-04c0-420c-8f11-460a0eb82f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:07.104055 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf7551-04c0-420c-8f11-460a0eb82f44 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:07.107722 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf7551-04c0-420c-8f11-460a0eb82f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:07.108099 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf7551-04c0-420c-8f11-460a0eb82f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:07.108808 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf7551-04c0-420c-8f11-460a0eb82f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:07.110932 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf7551-04c0-420c-8f11-460a0eb82f44 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:07.124683 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1451/2925] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 10:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 10:45:07.125910 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67c06f-ce9d-4ddb-baae-ea7f5dc0a931 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:07.136697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67c06f-ce9d-4ddb-baae-ea7f5dc0a931 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:07.141495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa608e-ea1f-4cb0-93de-897a779cd57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:07.143882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa608e-ea1f-4cb0-93de-897a779cd57d admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:07.143882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa608e-ea1f-4cb0-93de-897a779cd57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:07.143882 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa608e-ea1f-4cb0-93de-897a779cd57d admin admin] PATH_INFO: `/v3/projects/4c9ce50524fb4edfb11cb146c7bba39e/users/3767a2d25ad048e9bdec8419c758715c/roles/6f40bb5616cd47bd8a43ef05c2643557` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:07.144572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa608e-ea1f-4cb0-93de-897a779cd57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c9ce50524fb4edfb11cb146c7bba39e, user_id=3767a2d25ad048e9bdec8419c758715c, role_id=6f40bb5616cd47bd8a43ef05c2643557)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:07.147697 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa608e-ea1f-4cb0-93de-897a779cd57d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:07.158495 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1475/2926] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 10:45:07 2022] PUT /identity/v3/projects/4c9ce50524fb4edfb11cb146c7bba39e/users/3767a2d25ad048e9bdec8419c758715c/roles/6f40bb5616cd47bd8a43ef05c2643557 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:45:10.105375 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf7551-04c0-420c-8f11-460a0eb82f44 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:10.107123 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4bcf7551-04c0-420c-8f11-460a0eb82f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:10.117571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:10.178088 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf7551-04c0-420c-8f11-460a0eb82f44 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:10.237707 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eec297-be78-4501-a0f4-0ce99cdffb3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:10.238339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eec297-be78-4501-a0f4-0ce99cdffb3c service placement] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:10.238627 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eec297-be78-4501-a0f4-0ce99cdffb3c service placement] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:10.238899 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eec297-be78-4501-a0f4-0ce99cdffb3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:10.240647 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-76eec297-be78-4501-a0f4-0ce99cdffb3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:10.252477 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eec297-be78-4501-a0f4-0ce99cdffb3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:10.254643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eec297-be78-4501-a0f4-0ce99cdffb3c service placement] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:10.265810 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1452/2927] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:45:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:45:12.928029 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e242d85-c5d7-4385-b7e2-24663605db4c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:12.928969 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e242d85-c5d7-4385-b7e2-24663605db4c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:12.929484 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e242d85-c5d7-4385-b7e2-24663605db4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:12.963062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6e242d85-c5d7-4385-b7e2-24663605db4c None None] MFA Rules not processed for user `3767a2d25ad048e9bdec8419c758715c`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:45:12.964422 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6e242d85-c5d7-4385-b7e2-24663605db4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:12.995387 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:13.044656 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1476/2928] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:45:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:45:13.057939 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eec297-be78-4501-a0f4-0ce99cdffb3c service placement] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:13.059923 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-76eec297-be78-4501-a0f4-0ce99cdffb3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:13.134185 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eec297-be78-4501-a0f4-0ce99cdffb3c service placement] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:13.141625 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a5337-e7f8-4535-80cf-d9b4896f7fd9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6462736c485545d8a26766360ebe0c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:13.142573 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a5337-e7f8-4535-80cf-d9b4896f7fd9 service glance] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:13.143014 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a5337-e7f8-4535-80cf-d9b4896f7fd9 service glance] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:13.143458 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a5337-e7f8-4535-80cf-d9b4896f7fd9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:13.214602 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:13.218974 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a5337-e7f8-4535-80cf-d9b4896f7fd9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:13.220473 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a5337-e7f8-4535-80cf-d9b4896f7fd9 service glance] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:13.231170 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1453/2929] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:45:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:45:13.495595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68062b-bee7-4e58-ba63-9f23a202e890 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:13.495917 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68062b-bee7-4e58-ba63-9f23a202e890 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:13.496244 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68062b-bee7-4e58-ba63-9f23a202e890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:13.575572 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-bf68062b-bee7-4e58-ba63-9f23a202e890 None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:45:13.576949 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bf68062b-bee7-4e58-ba63-9f23a202e890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:13.653723 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1477/2930] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:45:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:45:13.787902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a5337-e7f8-4535-80cf-d9b4896f7fd9 service glance] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:13.787902 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-356a5337-e7f8-4535-80cf-d9b4896f7fd9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:13.897933 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a5337-e7f8-4535-80cf-d9b4896f7fd9 service glance] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:13.905713 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821bf64-7f02-4396-a04e-3547007b73a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:13.906346 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821bf64-7f02-4396-a04e-3547007b73a8 service swift] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:13.911481 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821bf64-7f02-4396-a04e-3547007b73a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:13.911481 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821bf64-7f02-4396-a04e-3547007b73a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:13.920571 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821bf64-7f02-4396-a04e-3547007b73a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:13.922161 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821bf64-7f02-4396-a04e-3547007b73a8 service swift] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:13.934114 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1454/2931] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:45:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:45:23.650756 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=61 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:23.930688 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=44 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:24.443052 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66eddc-a23a-4435-9b7f-515b1b6ada01 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:24.443393 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66eddc-a23a-4435-9b7f-515b1b6ada01 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:24.443644 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66eddc-a23a-4435-9b7f-515b1b6ada01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:24.462401 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9b66eddc-a23a-4435-9b7f-515b1b6ada01 None None] MFA Rules not processed for user `9e33c95eafec48f4b6825baf3373562d`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:45:24.463595 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9b66eddc-a23a-4435-9b7f-515b1b6ada01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:24.470489 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1478/2932] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 10:45:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:45:28.514661 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368069b4-0536-41a4-baff-2245a63f2980 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:28.515153 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368069b4-0536-41a4-baff-2245a63f2980 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:28.515253 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368069b4-0536-41a4-baff-2245a63f2980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:28.540937 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-368069b4-0536-41a4-baff-2245a63f2980 None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:45:28.542149 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-368069b4-0536-41a4-baff-2245a63f2980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:28.550095 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1455/2933] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 10:45:28.567938 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66eddc-a23a-4435-9b7f-515b1b6ada01 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:28.580725 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66eddc-a23a-4435-9b7f-515b1b6ada01 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:28.586501 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a14df-62fa-42c0-9e33-91814c1572f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:28.587112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a14df-62fa-42c0-9e33-91814c1572f7 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:28.587470 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a14df-62fa-42c0-9e33-91814c1572f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:28.587748 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a14df-62fa-42c0-9e33-91814c1572f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:28.596287 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a14df-62fa-42c0-9e33-91814c1572f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:28.597853 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a14df-62fa-42c0-9e33-91814c1572f7 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:28.606512 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1479/2934] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:45:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:45:38.535643 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:38.602694 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=9 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:45:42.834232 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368069b4-0536-41a4-baff-2245a63f2980 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:42.836406 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-368069b4-0536-41a4-baff-2245a63f2980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:42.919106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368069b4-0536-41a4-baff-2245a63f2980 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:42.924741 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ae280-4466-46e0-a8ce-f29dbf07f170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:42.925350 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ae280-4466-46e0-a8ce-f29dbf07f170 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:42.925633 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ae280-4466-46e0-a8ce-f29dbf07f170 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:42.926530 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ae280-4466-46e0-a8ce-f29dbf07f170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:42.928297 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9b2ae280-4466-46e0-a8ce-f29dbf07f170 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:45:42.941023 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ae280-4466-46e0-a8ce-f29dbf07f170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:42.945871 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ae280-4466-46e0-a8ce-f29dbf07f170 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:42.953617 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1456/2935] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:45:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:45:50.946923 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a14df-62fa-42c0-9e33-91814c1572f7 service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:45:51.000510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a14df-62fa-42c0-9e33-91814c1572f7 service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:45:51.004152 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56af3f-c9a1-4a79-b611-57fd4138272c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b040de20aa6f4e7b8366c7daa54c093c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:45:51.004742 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56af3f-c9a1-4a79-b611-57fd4138272c service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:45:51.005021 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56af3f-c9a1-4a79-b611-57fd4138272c service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:45:51.005292 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56af3f-c9a1-4a79-b611-57fd4138272c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:45:51.014388 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56af3f-c9a1-4a79-b611-57fd4138272c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:45:51.015840 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56af3f-c9a1-4a79-b611-57fd4138272c service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:45:51.025666 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1480/2936] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:45:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:45:52.948990 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=34 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:46:01.021062 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=26 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:46:43.545186 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ae280-4466-46e0-a8ce-f29dbf07f170 service nova] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:46:43.548474 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9b2ae280-4466-46e0-a8ce-f29dbf07f170 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:46:43.563591 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ae280-4466-46e0-a8ce-f29dbf07f170 service nova] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:46:43.571101 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dd3a2-90ce-46e3-a4cf-93af6fb045c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:46:43.571725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dd3a2-90ce-46e3-a4cf-93af6fb045c5 service placement] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:46:43.572056 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dd3a2-90ce-46e3-a4cf-93af6fb045c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:46:43.572339 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dd3a2-90ce-46e3-a4cf-93af6fb045c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:46:43.574106 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-907dd3a2-90ce-46e3-a4cf-93af6fb045c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:46:43.586527 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dd3a2-90ce-46e3-a4cf-93af6fb045c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:46:43.588142 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dd3a2-90ce-46e3-a4cf-93af6fb045c5 service placement] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:46:43.601174 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1457/2937] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:46:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:46:47.568838 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56af3f-c9a1-4a79-b611-57fd4138272c service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:46:47.591427 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1c56af3f-c9a1-4a79-b611-57fd4138272c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:46:47.634986 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56af3f-c9a1-4a79-b611-57fd4138272c service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:46:47.639554 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:46:47.640214 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:46:47.640493 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:46:47.640765 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] PATH_INFO: `/v3/users/3e67f5ad192541c6a67a18a41c5f44a8` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:46:47.641877 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e67f5ad192541c6a67a18a41c5f44a8)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:46:47.643773 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:46:47.811349 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e67f5ad192541c6a67a18a41c5f44a8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:47.818382 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e67f5ad192541c6a67a18a41c5f44a8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:47.819043 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e67f5ad192541c6a67a18a41c5f44a8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:47.819651 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e67f5ad192541c6a67a18a41c5f44a8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:47.868216 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e67f5ad192541c6a67a18a41c5f44a8'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:47.886087 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1481/2938] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:46:47 2022] DELETE /identity/v3/users/3e67f5ad192541c6a67a18a41c5f44a8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:46:48.174863 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dd3a2-90ce-46e3-a4cf-93af6fb045c5 service placement] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:46:48.191239 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dd3a2-90ce-46e3-a4cf-93af6fb045c5 service placement] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:46:48.243136 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:46:48.243772 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:46:48.244144 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:46:48.244417 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] PATH_INFO: `/v3/projects/58a9ef8bac1244dba4a23000f26e234a` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:46:48.245529 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58a9ef8bac1244dba4a23000f26e234a)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:46:48.247484 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:46:48.345181 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a9ef8bac1244dba4a23000f26e234a', 'request_id': 'req-fcbfe812-c748-4437-8179-bab8eab98d85'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:48.350733 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a9ef8bac1244dba4a23000f26e234a', 'request_id': 'req-fcbfe812-c748-4437-8179-bab8eab98d85'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:48.357375 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a9ef8bac1244dba4a23000f26e234a', 'request_id': 'req-fcbfe812-c748-4437-8179-bab8eab98d85'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:48.440586 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] The token cache is being invalidate because project 58a9ef8bac1244dba4a23000f26e234a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:46:48.440805 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:48.441422 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:48.442977 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1458/2939] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:46:48 2022] DELETE /identity/v3/projects/58a9ef8bac1244dba4a23000f26e234a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:46:48.447030 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:46:48.448490 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:46:48.461848 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88782e-4843-452b-b749-cf2d2d5432b5 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:46:48.517545 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:46:48.518168 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:46:48.518453 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:46:48.518722 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] PATH_INFO: `/v3/users/26a3f08b8e8740a3bd7133e5c113d039` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:46:48.519841 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a3f08b8e8740a3bd7133e5c113d039)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:46:48.521754 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:46:48.543428 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:46:48.707601 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a3f08b8e8740a3bd7133e5c113d039'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:48.714462 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a3f08b8e8740a3bd7133e5c113d039'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:48.715142 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a3f08b8e8740a3bd7133e5c113d039'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:48.715770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a3f08b8e8740a3bd7133e5c113d039'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:48.830520 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a3f08b8e8740a3bd7133e5c113d039'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:48.848124 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1482/2940] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:46:48 2022] DELETE /identity/v3/users/26a3f08b8e8740a3bd7133e5c113d039 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 10:46:49.083005 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:46:49.084466 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:46:49.097230 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfe812-c748-4437-8179-bab8eab98d85 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:46:49.155066 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91803b9-ce94-4614-a923-582ed8084df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:46:49.155694 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91803b9-ce94-4614-a923-582ed8084df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:46:49.156010 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91803b9-ce94-4614-a923-582ed8084df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:46:49.156290 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91803b9-ce94-4614-a923-582ed8084df1 admin admin] PATH_INFO: `/v3/projects/5569757f0e1b46ff9eb1196e33c75984` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:46:49.157412 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91803b9-ce94-4614-a923-582ed8084df1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5569757f0e1b46ff9eb1196e33c75984)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:46:49.159308 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91803b9-ce94-4614-a923-582ed8084df1 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:46:49.180096 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:46:49.258750 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d91803b9-ce94-4614-a923-582ed8084df1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5569757f0e1b46ff9eb1196e33c75984', 'request_id': 'req-d91803b9-ce94-4614-a923-582ed8084df1'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:49.264098 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d91803b9-ce94-4614-a923-582ed8084df1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5569757f0e1b46ff9eb1196e33c75984', 'request_id': 'req-d91803b9-ce94-4614-a923-582ed8084df1'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:49.270326 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d91803b9-ce94-4614-a923-582ed8084df1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5569757f0e1b46ff9eb1196e33c75984', 'request_id': 'req-d91803b9-ce94-4614-a923-582ed8084df1'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:49.355967 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d91803b9-ce94-4614-a923-582ed8084df1 admin admin] The token cache is being invalidate because project 5569757f0e1b46ff9eb1196e33c75984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:46:49.356263 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d91803b9-ce94-4614-a923-582ed8084df1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:49.356887 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-d91803b9-ce94-4614-a923-582ed8084df1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:46:49.358362 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1459/2941] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:46:49 2022] DELETE /identity/v3/projects/5569757f0e1b46ff9eb1196e33c75984 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:46:58.882100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:46:59.352092 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:07.500899 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:47:07.502636 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:47:07.601975 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6a092-e3b1-4da8-9e9f-fd81c5e2a975 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:47:07.681922 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2020ff-8559-4991-a90b-16834cac8134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '567188b7c4fe40c1a1623d2f60092d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:47:07.682553 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2020ff-8559-4991-a90b-16834cac8134 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:47:07.682834 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2020ff-8559-4991-a90b-16834cac8134 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:47:07.683106 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2020ff-8559-4991-a90b-16834cac8134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:47:07.684985 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ae2020ff-8559-4991-a90b-16834cac8134 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:47:07.698143 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2020ff-8559-4991-a90b-16834cac8134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:47:07.699770 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2020ff-8559-4991-a90b-16834cac8134 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:47:07.712071 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1483/2942] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:47:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:47:16.867611 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433c43-3043-47dc-8aa7-858098649045 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:47:16.868115 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433c43-3043-47dc-8aa7-858098649045 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:47:16.868223 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433c43-3043-47dc-8aa7-858098649045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:47:16.887850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e7433c43-3043-47dc-8aa7-858098649045 None None] MFA Rules not processed for user `347ab0ce405c4deba9295d5395cb1d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 10:47:16.892595 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e7433c43-3043-47dc-8aa7-858098649045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:47:16.942867 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1460/2943] 10.222.0.33 () {58 vars in 967 bytes} [Tue Oct 4 10:47:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 10:47:16.982100 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2020ff-8559-4991-a90b-16834cac8134 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:47:16.984447 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ae2020ff-8559-4991-a90b-16834cac8134 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:47:17.051342 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2020ff-8559-4991-a90b-16834cac8134 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:47:17.056357 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78ce8c-9cdf-4389-92b8-48717912d1cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe9c03800bc6451aa9e5a39ca4ea0bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:47:17.056950 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78ce8c-9cdf-4389-92b8-48717912d1cd service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:47:17.057232 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78ce8c-9cdf-4389-92b8-48717912d1cd service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:47:17.057504 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78ce8c-9cdf-4389-92b8-48717912d1cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:47:17.066116 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78ce8c-9cdf-4389-92b8-48717912d1cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:47:17.067670 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78ce8c-9cdf-4389-92b8-48717912d1cd service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:47:17.075559 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1484/2944] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 10:47:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 10:47:25.299519 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7433c43-3043-47dc-8aa7-858098649045 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:47:25.301083 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e7433c43-3043-47dc-8aa7-858098649045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:47:25.373603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7433c43-3043-47dc-8aa7-858098649045 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:47:25.378685 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f92ad5-2e11-4eb2-a5d2-88e3d1f978d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:47:25.379291 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f92ad5-2e11-4eb2-a5d2-88e3d1f978d4 service placement] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:47:25.379567 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f92ad5-2e11-4eb2-a5d2-88e3d1f978d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:47:25.379839 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f92ad5-2e11-4eb2-a5d2-88e3d1f978d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:47:25.381644 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-18f92ad5-2e11-4eb2-a5d2-88e3d1f978d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:47:25.393178 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f92ad5-2e11-4eb2-a5d2-88e3d1f978d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:47:25.394787 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f92ad5-2e11-4eb2-a5d2-88e3d1f978d4 service placement] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:47:25.405077 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1461/2945] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:47:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:47:25.462829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78ce8c-9cdf-4389-92b8-48717912d1cd service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:47:25.462829 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4b78ce8c-9cdf-4389-92b8-48717912d1cd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:47:25.477808 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:25.526923 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78ce8c-9cdf-4389-92b8-48717912d1cd service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:47:25.532128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:47:25.532749 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:47:25.533033 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:47:25.533304 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] PATH_INFO: `/v3/users/9e33c95eafec48f4b6825baf3373562d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:47:25.534412 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e33c95eafec48f4b6825baf3373562d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:47:25.536346 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:47:25.729589 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e33c95eafec48f4b6825baf3373562d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:25.736915 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e33c95eafec48f4b6825baf3373562d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:25.737619 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e33c95eafec48f4b6825baf3373562d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:25.738330 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e33c95eafec48f4b6825baf3373562d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:25.789735 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e33c95eafec48f4b6825baf3373562d'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:25.807165 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1485/2946] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:47:25 2022] DELETE /identity/v3/users/9e33c95eafec48f4b6825baf3373562d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:47:26.046597 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f92ad5-2e11-4eb2-a5d2-88e3d1f978d4 service placement] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:47:26.057491 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f92ad5-2e11-4eb2-a5d2-88e3d1f978d4 service placement] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:47:26.115439 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:47:26.116104 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:47:26.116384 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:47:26.116654 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] PATH_INFO: `/v3/projects/67ab0032a84d497aa0bf51cce5f2e623` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:47:26.117762 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ab0032a84d497aa0bf51cce5f2e623)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:47:26.119654 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:47:26.202819 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:26.211272 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ab0032a84d497aa0bf51cce5f2e623', 'request_id': 'req-5d048c0e-4f7f-4432-abc5-e93d5dad6833'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:26.216787 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ab0032a84d497aa0bf51cce5f2e623', 'request_id': 'req-5d048c0e-4f7f-4432-abc5-e93d5dad6833'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:26.222665 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ab0032a84d497aa0bf51cce5f2e623', 'request_id': 'req-5d048c0e-4f7f-4432-abc5-e93d5dad6833'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:26.289967 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] The token cache is being invalidate because project 67ab0032a84d497aa0bf51cce5f2e623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:47:26.290244 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:26.290895 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:26.292517 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1462/2947] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:47:26 2022] DELETE /identity/v3/projects/67ab0032a84d497aa0bf51cce5f2e623 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:47:26.296682 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:47:26.298201 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:47:26.311707 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2f585-5e7d-4dea-9001-5a6e9a3e8ab9 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:47:26.368261 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:47:26.368908 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:47:26.369188 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:47:26.369460 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] PATH_INFO: `/v3/users/3767a2d25ad048e9bdec8419c758715c` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:47:26.370585 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3767a2d25ad048e9bdec8419c758715c)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:47:26.372510 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:47:26.531860 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:26.540852 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3767a2d25ad048e9bdec8419c758715c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:26.548364 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3767a2d25ad048e9bdec8419c758715c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:26.548977 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3767a2d25ad048e9bdec8419c758715c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:26.549582 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3767a2d25ad048e9bdec8419c758715c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:26.641341 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3767a2d25ad048e9bdec8419c758715c'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:26.661091 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1486/2948] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 10:47:26 2022] DELETE /identity/v3/users/3767a2d25ad048e9bdec8419c758715c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:47:26.897603 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:47:26.899057 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:47:26.915725 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d048c0e-4f7f-4432-abc5-e93d5dad6833 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:47:26.973865 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ea615-69fd-4954-8b15-a75dd90177d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9514cc6bc4f96b9c765b74b45116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e736e1303d7f49068590b8ec9f283f71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:47:26.974490 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ea615-69fd-4954-8b15-a75dd90177d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:47:26.974766 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ea615-69fd-4954-8b15-a75dd90177d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:47:26.975032 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ea615-69fd-4954-8b15-a75dd90177d9 admin admin] PATH_INFO: `/v3/projects/4c9ce50524fb4edfb11cb146c7bba39e` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:47:26.976167 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ea615-69fd-4954-8b15-a75dd90177d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c9ce50524fb4edfb11cb146c7bba39e)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:47:26.978048 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ea615-69fd-4954-8b15-a75dd90177d9 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:47:27.079457 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-087ea615-69fd-4954-8b15-a75dd90177d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c9ce50524fb4edfb11cb146c7bba39e', 'request_id': 'req-087ea615-69fd-4954-8b15-a75dd90177d9'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:27.085138 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-087ea615-69fd-4954-8b15-a75dd90177d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c9ce50524fb4edfb11cb146c7bba39e', 'request_id': 'req-087ea615-69fd-4954-8b15-a75dd90177d9'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:27.091137 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-087ea615-69fd-4954-8b15-a75dd90177d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c9ce50524fb4edfb11cb146c7bba39e', 'request_id': 'req-087ea615-69fd-4954-8b15-a75dd90177d9'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:27.170648 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-087ea615-69fd-4954-8b15-a75dd90177d9 admin admin] The token cache is being invalidate because project 4c9ce50524fb4edfb11cb146c7bba39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 10:47:27.170850 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-087ea615-69fd-4954-8b15-a75dd90177d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:27.171468 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-087ea615-69fd-4954-8b15-a75dd90177d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 10:47:27.172998 dv-cinder-859193-3-smb devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1463/2949] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 10:47:26 2022] DELETE /identity/v3/projects/4c9ce50524fb4edfb11cb146c7bba39e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 10:47:36.692954 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:37.167379 dv-cinder-859193-3-smb devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:47:47.009128 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 10:47:47.010518 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:47:47.077119 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110969a-162a-4f17-8bba-9d4d2d36ea47 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 10:47:47.134856 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27d2d1-59f7-432d-958d-abfdf839654f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505c7c48b0d14dc9af8006cc7e8eea53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c41ae2f9d03c48be8017a1ca480bf7db', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 10:47:47.135454 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27d2d1-59f7-432d-958d-abfdf839654f service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 10:47:47.135733 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27d2d1-59f7-432d-958d-abfdf839654f service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 10:47:47.136030 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27d2d1-59f7-432d-958d-abfdf839654f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 10:47:47.137763 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4f27d2d1-59f7-432d-958d-abfdf839654f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 10:47:47.149561 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27d2d1-59f7-432d-958d-abfdf839654f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 10:47:47.151112 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27d2d1-59f7-432d-958d-abfdf839654f service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 10:47:47.161629 dv-cinder-859193-3-smb devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1487/2950] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 10:47:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 10:47:57.156616 dv-cinder-859193-3-smb devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=58 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}